00:00:00.000 Started by upstream project "autotest-per-patch" build number 130870 00:00:00.000 originally caused by: 00:00:00.000 Started by user sys_sgci 00:00:00.016 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:04.672 The recommended git tool is: git 00:00:04.673 using credential 00000000-0000-0000-0000-000000000002 00:00:04.675 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:04.687 Fetching changes from the remote Git repository 00:00:04.689 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:04.701 Using shallow fetch with depth 1 00:00:04.701 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:04.701 > git --version # timeout=10 00:00:04.712 > git --version # 'git version 2.39.2' 00:00:04.712 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:04.724 Setting http proxy: proxy-dmz.intel.com:911 00:00:04.724 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:11.263 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:11.278 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:11.291 Checking out Revision f95f9907808933a1db7196e15e13478e0f322ee7 (FETCH_HEAD) 00:00:11.291 > git config core.sparsecheckout # timeout=10 00:00:11.303 > git read-tree -mu HEAD # timeout=10 00:00:11.320 > git checkout -f f95f9907808933a1db7196e15e13478e0f322ee7 # timeout=5 00:00:11.339 Commit message: "Revert "autotest-phy: replace deprecated label for nvmf-cvl"" 00:00:11.339 > git rev-list --no-walk f95f9907808933a1db7196e15e13478e0f322ee7 # timeout=10 00:00:11.468 [Pipeline] Start of Pipeline 00:00:11.481 [Pipeline] library 00:00:11.482 Loading library shm_lib@master 00:00:11.482 Library shm_lib@master is cached. Copying from home. 00:00:11.500 [Pipeline] node 00:00:11.510 Running on GP8 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:11.512 [Pipeline] { 00:00:11.522 [Pipeline] catchError 00:00:11.524 [Pipeline] { 00:00:11.537 [Pipeline] wrap 00:00:11.547 [Pipeline] { 00:00:11.556 [Pipeline] stage 00:00:11.558 [Pipeline] { (Prologue) 00:00:11.898 [Pipeline] sh 00:00:12.189 + logger -p user.info -t JENKINS-CI 00:00:12.211 [Pipeline] echo 00:00:12.212 Node: GP8 00:00:12.220 [Pipeline] sh 00:00:12.527 [Pipeline] setCustomBuildProperty 00:00:12.538 [Pipeline] echo 00:00:12.539 Cleanup processes 00:00:12.544 [Pipeline] sh 00:00:12.850 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:12.850 438328 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:12.863 [Pipeline] sh 00:00:13.150 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:13.150 ++ grep -v 'sudo pgrep' 00:00:13.150 ++ awk '{print $1}' 00:00:13.150 + sudo kill -9 00:00:13.150 + true 00:00:13.166 [Pipeline] cleanWs 00:00:13.175 [WS-CLEANUP] Deleting project workspace... 00:00:13.175 [WS-CLEANUP] Deferred wipeout is used... 00:00:13.182 [WS-CLEANUP] done 00:00:13.186 [Pipeline] setCustomBuildProperty 00:00:13.199 [Pipeline] sh 00:00:13.484 + sudo git config --global --replace-all safe.directory '*' 00:00:13.611 [Pipeline] httpRequest 00:00:13.986 [Pipeline] echo 00:00:13.988 Sorcerer 10.211.164.101 is alive 00:00:13.998 [Pipeline] retry 00:00:14.000 [Pipeline] { 00:00:14.015 [Pipeline] httpRequest 00:00:14.019 HttpMethod: GET 00:00:14.019 URL: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:14.021 Sending request to url: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:14.048 Response Code: HTTP/1.1 200 OK 00:00:14.048 Success: Status code 200 is in the accepted range: 200,404 00:00:14.049 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:26.349 [Pipeline] } 00:00:26.366 [Pipeline] // retry 00:00:26.374 [Pipeline] sh 00:00:26.663 + tar --no-same-owner -xf jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:26.681 [Pipeline] httpRequest 00:00:27.060 [Pipeline] echo 00:00:27.062 Sorcerer 10.211.164.101 is alive 00:00:27.071 [Pipeline] retry 00:00:27.074 [Pipeline] { 00:00:27.087 [Pipeline] httpRequest 00:00:27.091 HttpMethod: GET 00:00:27.091 URL: http://10.211.164.101/packages/spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:00:27.092 Sending request to url: http://10.211.164.101/packages/spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:00:27.099 Response Code: HTTP/1.1 200 OK 00:00:27.099 Success: Status code 200 is in the accepted range: 200,404 00:00:27.100 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:03:13.857 [Pipeline] } 00:03:13.873 [Pipeline] // retry 00:03:13.880 [Pipeline] sh 00:03:14.175 + tar --no-same-owner -xf spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:03:16.720 [Pipeline] sh 00:03:17.009 + git -C spdk log --oneline -n5 00:03:17.009 2a4f56c54 bdev/nvme: controller failover/multipath doc change 00:03:17.009 d16db39ee bdev/nvme: removed 'multipath' param from spdk_bdev_nvme_create() 00:03:17.009 32fb30b70 bdev/nvme: changed default config to multipath 00:03:17.009 397c5fc31 bdev/nvme: ctrl config consistency check 00:03:17.009 3950cd1bb bdev/nvme: Change spdk_bdev_reset() to succeed if at least one nvme_ctrlr is reconnected 00:03:17.022 [Pipeline] } 00:03:17.036 [Pipeline] // stage 00:03:17.044 [Pipeline] stage 00:03:17.046 [Pipeline] { (Prepare) 00:03:17.062 [Pipeline] writeFile 00:03:17.076 [Pipeline] sh 00:03:17.363 + logger -p user.info -t JENKINS-CI 00:03:17.377 [Pipeline] sh 00:03:17.665 + logger -p user.info -t JENKINS-CI 00:03:17.677 [Pipeline] sh 00:03:17.964 + cat autorun-spdk.conf 00:03:17.964 SPDK_RUN_FUNCTIONAL_TEST=1 00:03:17.964 SPDK_TEST_NVMF=1 00:03:17.964 SPDK_TEST_NVME_CLI=1 00:03:17.964 SPDK_TEST_NVMF_TRANSPORT=tcp 00:03:17.964 SPDK_TEST_NVMF_NICS=e810 00:03:17.964 SPDK_TEST_VFIOUSER=1 00:03:17.964 SPDK_RUN_UBSAN=1 00:03:17.964 NET_TYPE=phy 00:03:17.972 RUN_NIGHTLY=0 00:03:17.976 [Pipeline] readFile 00:03:17.999 [Pipeline] withEnv 00:03:18.002 [Pipeline] { 00:03:18.013 [Pipeline] sh 00:03:18.315 + set -ex 00:03:18.315 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:03:18.315 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:03:18.315 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:03:18.315 ++ SPDK_TEST_NVMF=1 00:03:18.315 ++ SPDK_TEST_NVME_CLI=1 00:03:18.315 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:03:18.315 ++ SPDK_TEST_NVMF_NICS=e810 00:03:18.315 ++ SPDK_TEST_VFIOUSER=1 00:03:18.315 ++ SPDK_RUN_UBSAN=1 00:03:18.315 ++ NET_TYPE=phy 00:03:18.315 ++ RUN_NIGHTLY=0 00:03:18.315 + case $SPDK_TEST_NVMF_NICS in 00:03:18.315 + DRIVERS=ice 00:03:18.315 + [[ tcp == \r\d\m\a ]] 00:03:18.315 + [[ -n ice ]] 00:03:18.315 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:03:18.315 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:03:18.315 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:03:18.315 rmmod: ERROR: Module irdma is not currently loaded 00:03:18.315 rmmod: ERROR: Module i40iw is not currently loaded 00:03:18.315 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:03:18.315 + true 00:03:18.315 + for D in $DRIVERS 00:03:18.315 + sudo modprobe ice 00:03:18.315 + exit 0 00:03:18.363 [Pipeline] } 00:03:18.378 [Pipeline] // withEnv 00:03:18.382 [Pipeline] } 00:03:18.396 [Pipeline] // stage 00:03:18.405 [Pipeline] catchError 00:03:18.407 [Pipeline] { 00:03:18.420 [Pipeline] timeout 00:03:18.420 Timeout set to expire in 1 hr 0 min 00:03:18.422 [Pipeline] { 00:03:18.436 [Pipeline] stage 00:03:18.438 [Pipeline] { (Tests) 00:03:18.452 [Pipeline] sh 00:03:18.740 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:03:18.740 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:03:18.740 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:03:18.740 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:03:18.740 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:18.740 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:03:18.740 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:03:18.740 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:03:18.740 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:03:18.740 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:03:18.740 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:03:18.740 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:03:18.740 + source /etc/os-release 00:03:18.740 ++ NAME='Fedora Linux' 00:03:18.740 ++ VERSION='39 (Cloud Edition)' 00:03:18.740 ++ ID=fedora 00:03:18.740 ++ VERSION_ID=39 00:03:18.740 ++ VERSION_CODENAME= 00:03:18.740 ++ PLATFORM_ID=platform:f39 00:03:18.740 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:03:18.740 ++ ANSI_COLOR='0;38;2;60;110;180' 00:03:18.740 ++ LOGO=fedora-logo-icon 00:03:18.740 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:03:18.740 ++ HOME_URL=https://fedoraproject.org/ 00:03:18.740 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:03:18.740 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:03:18.740 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:03:18.740 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:03:18.740 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:03:18.740 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:03:18.740 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:03:18.740 ++ SUPPORT_END=2024-11-12 00:03:18.740 ++ VARIANT='Cloud Edition' 00:03:18.740 ++ VARIANT_ID=cloud 00:03:18.740 + uname -a 00:03:18.740 Linux spdk-gp-08 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:03:18.740 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:20.121 Hugepages 00:03:20.121 node hugesize free / total 00:03:20.121 node0 1048576kB 0 / 0 00:03:20.121 node0 2048kB 0 / 0 00:03:20.121 node1 1048576kB 0 / 0 00:03:20.121 node1 2048kB 0 / 0 00:03:20.121 00:03:20.121 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:20.121 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:20.121 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:20.121 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:20.121 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:20.121 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:20.121 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:20.121 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:20.121 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:20.121 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:20.121 NVMe 0000:82:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:20.121 + rm -f /tmp/spdk-ld-path 00:03:20.121 + source autorun-spdk.conf 00:03:20.121 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:03:20.121 ++ SPDK_TEST_NVMF=1 00:03:20.121 ++ SPDK_TEST_NVME_CLI=1 00:03:20.121 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:03:20.121 ++ SPDK_TEST_NVMF_NICS=e810 00:03:20.121 ++ SPDK_TEST_VFIOUSER=1 00:03:20.121 ++ SPDK_RUN_UBSAN=1 00:03:20.121 ++ NET_TYPE=phy 00:03:20.121 ++ RUN_NIGHTLY=0 00:03:20.121 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:03:20.121 + [[ -n '' ]] 00:03:20.121 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:20.121 + for M in /var/spdk/build-*-manifest.txt 00:03:20.121 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:03:20.121 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:03:20.121 + for M in /var/spdk/build-*-manifest.txt 00:03:20.121 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:03:20.121 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:03:20.121 + for M in /var/spdk/build-*-manifest.txt 00:03:20.121 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:03:20.121 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:03:20.121 ++ uname 00:03:20.121 + [[ Linux == \L\i\n\u\x ]] 00:03:20.121 + sudo dmesg -T 00:03:20.121 + sudo dmesg --clear 00:03:20.121 + dmesg_pid=439638 00:03:20.121 + [[ Fedora Linux == FreeBSD ]] 00:03:20.121 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:03:20.121 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:03:20.121 + sudo dmesg -Tw 00:03:20.121 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:03:20.121 + [[ -x /usr/src/fio-static/fio ]] 00:03:20.121 + export FIO_BIN=/usr/src/fio-static/fio 00:03:20.121 + FIO_BIN=/usr/src/fio-static/fio 00:03:20.121 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:03:20.121 + [[ ! -v VFIO_QEMU_BIN ]] 00:03:20.121 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:03:20.121 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:03:20.121 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:03:20.121 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:03:20.121 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:03:20.121 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:03:20.121 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:03:20.121 Test configuration: 00:03:20.121 SPDK_RUN_FUNCTIONAL_TEST=1 00:03:20.121 SPDK_TEST_NVMF=1 00:03:20.121 SPDK_TEST_NVME_CLI=1 00:03:20.121 SPDK_TEST_NVMF_TRANSPORT=tcp 00:03:20.121 SPDK_TEST_NVMF_NICS=e810 00:03:20.121 SPDK_TEST_VFIOUSER=1 00:03:20.121 SPDK_RUN_UBSAN=1 00:03:20.121 NET_TYPE=phy 00:03:20.121 RUN_NIGHTLY=0 13:14:15 -- common/autotest_common.sh@1680 -- $ [[ n == y ]] 00:03:20.121 13:14:15 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:20.121 13:14:15 -- scripts/common.sh@15 -- $ shopt -s extglob 00:03:20.121 13:14:15 -- scripts/common.sh@544 -- $ [[ -e /bin/wpdk_common.sh ]] 00:03:20.121 13:14:15 -- scripts/common.sh@552 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:20.121 13:14:15 -- scripts/common.sh@553 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:20.121 13:14:15 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:20.121 13:14:15 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:20.121 13:14:15 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:20.121 13:14:15 -- paths/export.sh@5 -- $ export PATH 00:03:20.121 13:14:15 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:20.121 13:14:15 -- common/autobuild_common.sh@485 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:20.121 13:14:15 -- common/autobuild_common.sh@486 -- $ date +%s 00:03:20.121 13:14:15 -- common/autobuild_common.sh@486 -- $ mktemp -dt spdk_1728299655.XXXXXX 00:03:20.121 13:14:15 -- common/autobuild_common.sh@486 -- $ SPDK_WORKSPACE=/tmp/spdk_1728299655.Fw87fl 00:03:20.121 13:14:15 -- common/autobuild_common.sh@488 -- $ [[ -n '' ]] 00:03:20.121 13:14:15 -- common/autobuild_common.sh@492 -- $ '[' -n '' ']' 00:03:20.121 13:14:15 -- common/autobuild_common.sh@495 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:03:20.122 13:14:15 -- common/autobuild_common.sh@499 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:03:20.122 13:14:15 -- common/autobuild_common.sh@501 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:03:20.122 13:14:15 -- common/autobuild_common.sh@502 -- $ get_config_params 00:03:20.122 13:14:15 -- common/autotest_common.sh@407 -- $ xtrace_disable 00:03:20.122 13:14:15 -- common/autotest_common.sh@10 -- $ set +x 00:03:20.122 13:14:15 -- common/autobuild_common.sh@502 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user' 00:03:20.122 13:14:15 -- common/autobuild_common.sh@504 -- $ start_monitor_resources 00:03:20.122 13:14:15 -- pm/common@17 -- $ local monitor 00:03:20.122 13:14:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:20.122 13:14:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:20.122 13:14:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:20.122 13:14:15 -- pm/common@21 -- $ date +%s 00:03:20.122 13:14:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:20.122 13:14:15 -- pm/common@21 -- $ date +%s 00:03:20.122 13:14:15 -- pm/common@25 -- $ sleep 1 00:03:20.122 13:14:15 -- pm/common@21 -- $ date +%s 00:03:20.122 13:14:15 -- pm/common@21 -- $ date +%s 00:03:20.122 13:14:15 -- pm/common@21 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1728299655 00:03:20.122 13:14:15 -- pm/common@21 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1728299655 00:03:20.122 13:14:15 -- pm/common@21 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1728299655 00:03:20.122 13:14:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1728299655 00:03:20.122 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1728299655_collect-cpu-load.pm.log 00:03:20.122 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1728299655_collect-vmstat.pm.log 00:03:20.122 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1728299655_collect-cpu-temp.pm.log 00:03:20.122 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1728299655_collect-bmc-pm.bmc.pm.log 00:03:21.060 13:14:16 -- common/autobuild_common.sh@505 -- $ trap stop_monitor_resources EXIT 00:03:21.060 13:14:16 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:03:21.060 13:14:16 -- spdk/autobuild.sh@12 -- $ umask 022 00:03:21.060 13:14:16 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:21.060 13:14:16 -- spdk/autobuild.sh@16 -- $ date -u 00:03:21.060 Mon Oct 7 11:14:16 AM UTC 2024 00:03:21.060 13:14:16 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:03:21.060 v25.01-pre-39-g2a4f56c54 00:03:21.060 13:14:16 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:03:21.060 13:14:16 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:03:21.060 13:14:16 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:03:21.060 13:14:16 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:03:21.060 13:14:16 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:03:21.060 13:14:16 -- common/autotest_common.sh@10 -- $ set +x 00:03:21.319 ************************************ 00:03:21.319 START TEST ubsan 00:03:21.319 ************************************ 00:03:21.319 13:14:17 ubsan -- common/autotest_common.sh@1125 -- $ echo 'using ubsan' 00:03:21.319 using ubsan 00:03:21.319 00:03:21.319 real 0m0.000s 00:03:21.319 user 0m0.000s 00:03:21.319 sys 0m0.000s 00:03:21.319 13:14:17 ubsan -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:03:21.319 13:14:17 ubsan -- common/autotest_common.sh@10 -- $ set +x 00:03:21.319 ************************************ 00:03:21.319 END TEST ubsan 00:03:21.319 ************************************ 00:03:21.319 13:14:17 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:03:21.319 13:14:17 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:03:21.319 13:14:17 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:03:21.319 13:14:17 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:03:21.319 13:14:17 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:03:21.319 13:14:17 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:03:21.319 13:14:17 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:03:21.319 13:14:17 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:03:21.319 13:14:17 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-shared 00:03:21.319 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:03:21.319 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:03:21.577 Using 'verbs' RDMA provider 00:03:32.141 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.spdk-isal.log)...done. 00:03:42.145 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:03:42.145 Creating mk/config.mk...done. 00:03:42.145 Creating mk/cc.flags.mk...done. 00:03:42.145 Type 'make' to build. 00:03:42.145 13:14:37 -- spdk/autobuild.sh@70 -- $ run_test make make -j48 00:03:42.145 13:14:37 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:03:42.145 13:14:37 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:03:42.145 13:14:37 -- common/autotest_common.sh@10 -- $ set +x 00:03:42.145 ************************************ 00:03:42.145 START TEST make 00:03:42.145 ************************************ 00:03:42.146 13:14:37 make -- common/autotest_common.sh@1125 -- $ make -j48 00:03:42.146 make[1]: Nothing to be done for 'all'. 00:03:44.077 The Meson build system 00:03:44.077 Version: 1.5.0 00:03:44.077 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:44.077 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:44.077 Build type: native build 00:03:44.077 Project name: libvfio-user 00:03:44.077 Project version: 0.0.1 00:03:44.077 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:44.077 C linker for the host machine: cc ld.bfd 2.40-14 00:03:44.077 Host machine cpu family: x86_64 00:03:44.077 Host machine cpu: x86_64 00:03:44.077 Run-time dependency threads found: YES 00:03:44.077 Library dl found: YES 00:03:44.077 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:44.077 Run-time dependency json-c found: YES 0.17 00:03:44.077 Run-time dependency cmocka found: YES 1.1.7 00:03:44.077 Program pytest-3 found: NO 00:03:44.077 Program flake8 found: NO 00:03:44.077 Program misspell-fixer found: NO 00:03:44.077 Program restructuredtext-lint found: NO 00:03:44.077 Program valgrind found: YES (/usr/bin/valgrind) 00:03:44.077 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:44.077 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:44.077 Compiler for C supports arguments -Wwrite-strings: YES 00:03:44.077 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:44.077 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:44.077 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:44.077 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:44.077 Build targets in project: 8 00:03:44.077 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:44.077 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:44.077 00:03:44.077 libvfio-user 0.0.1 00:03:44.077 00:03:44.077 User defined options 00:03:44.077 buildtype : debug 00:03:44.077 default_library: shared 00:03:44.077 libdir : /usr/local/lib 00:03:44.077 00:03:44.077 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:45.033 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:45.033 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:45.033 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:45.033 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:45.033 [4/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:45.033 [5/37] Compiling C object samples/null.p/null.c.o 00:03:45.295 [6/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:45.295 [7/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:45.295 [8/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:45.295 [9/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:45.295 [10/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:45.295 [11/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:45.295 [12/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:45.295 [13/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:45.295 [14/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:45.295 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:45.295 [16/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:45.295 [17/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:45.295 [18/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:45.295 [19/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:45.295 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:45.295 [21/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:45.295 [22/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:45.295 [23/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:45.295 [24/37] Compiling C object samples/server.p/server.c.o 00:03:45.295 [25/37] Compiling C object samples/client.p/client.c.o 00:03:45.295 [26/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:45.295 [27/37] Linking target samples/client 00:03:45.295 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:45.295 [29/37] Linking target lib/libvfio-user.so.0.0.1 00:03:45.561 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:45.561 [31/37] Linking target test/unit_tests 00:03:45.561 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:45.561 [33/37] Linking target samples/server 00:03:45.561 [34/37] Linking target samples/null 00:03:45.825 [35/37] Linking target samples/gpio-pci-idio-16 00:03:45.825 [36/37] Linking target samples/lspci 00:03:45.825 [37/37] Linking target samples/shadow_ioeventfd_server 00:03:45.825 INFO: autodetecting backend as ninja 00:03:45.825 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:45.825 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:46.773 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:46.773 ninja: no work to do. 00:03:52.051 The Meson build system 00:03:52.051 Version: 1.5.0 00:03:52.051 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:03:52.051 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:03:52.051 Build type: native build 00:03:52.051 Program cat found: YES (/usr/bin/cat) 00:03:52.051 Project name: DPDK 00:03:52.051 Project version: 24.03.0 00:03:52.051 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:52.051 C linker for the host machine: cc ld.bfd 2.40-14 00:03:52.051 Host machine cpu family: x86_64 00:03:52.051 Host machine cpu: x86_64 00:03:52.051 Message: ## Building in Developer Mode ## 00:03:52.051 Program pkg-config found: YES (/usr/bin/pkg-config) 00:03:52.051 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:03:52.051 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:03:52.051 Program python3 found: YES (/usr/bin/python3) 00:03:52.051 Program cat found: YES (/usr/bin/cat) 00:03:52.051 Compiler for C supports arguments -march=native: YES 00:03:52.051 Checking for size of "void *" : 8 00:03:52.051 Checking for size of "void *" : 8 (cached) 00:03:52.051 Compiler for C supports link arguments -Wl,--undefined-version: YES 00:03:52.051 Library m found: YES 00:03:52.051 Library numa found: YES 00:03:52.051 Has header "numaif.h" : YES 00:03:52.051 Library fdt found: NO 00:03:52.051 Library execinfo found: NO 00:03:52.051 Has header "execinfo.h" : YES 00:03:52.051 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:52.051 Run-time dependency libarchive found: NO (tried pkgconfig) 00:03:52.051 Run-time dependency libbsd found: NO (tried pkgconfig) 00:03:52.051 Run-time dependency jansson found: NO (tried pkgconfig) 00:03:52.051 Run-time dependency openssl found: YES 3.1.1 00:03:52.051 Run-time dependency libpcap found: YES 1.10.4 00:03:52.051 Has header "pcap.h" with dependency libpcap: YES 00:03:52.051 Compiler for C supports arguments -Wcast-qual: YES 00:03:52.051 Compiler for C supports arguments -Wdeprecated: YES 00:03:52.051 Compiler for C supports arguments -Wformat: YES 00:03:52.051 Compiler for C supports arguments -Wformat-nonliteral: NO 00:03:52.051 Compiler for C supports arguments -Wformat-security: NO 00:03:52.051 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:52.051 Compiler for C supports arguments -Wmissing-prototypes: YES 00:03:52.051 Compiler for C supports arguments -Wnested-externs: YES 00:03:52.051 Compiler for C supports arguments -Wold-style-definition: YES 00:03:52.051 Compiler for C supports arguments -Wpointer-arith: YES 00:03:52.051 Compiler for C supports arguments -Wsign-compare: YES 00:03:52.051 Compiler for C supports arguments -Wstrict-prototypes: YES 00:03:52.051 Compiler for C supports arguments -Wundef: YES 00:03:52.051 Compiler for C supports arguments -Wwrite-strings: YES 00:03:52.051 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:03:52.051 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:03:52.051 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:52.051 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:03:52.051 Program objdump found: YES (/usr/bin/objdump) 00:03:52.051 Compiler for C supports arguments -mavx512f: YES 00:03:52.051 Checking if "AVX512 checking" compiles: YES 00:03:52.051 Fetching value of define "__SSE4_2__" : 1 00:03:52.051 Fetching value of define "__AES__" : 1 00:03:52.051 Fetching value of define "__AVX__" : 1 00:03:52.051 Fetching value of define "__AVX2__" : (undefined) 00:03:52.051 Fetching value of define "__AVX512BW__" : (undefined) 00:03:52.051 Fetching value of define "__AVX512CD__" : (undefined) 00:03:52.051 Fetching value of define "__AVX512DQ__" : (undefined) 00:03:52.051 Fetching value of define "__AVX512F__" : (undefined) 00:03:52.051 Fetching value of define "__AVX512VL__" : (undefined) 00:03:52.051 Fetching value of define "__PCLMUL__" : 1 00:03:52.051 Fetching value of define "__RDRND__" : 1 00:03:52.051 Fetching value of define "__RDSEED__" : (undefined) 00:03:52.051 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:03:52.051 Fetching value of define "__znver1__" : (undefined) 00:03:52.051 Fetching value of define "__znver2__" : (undefined) 00:03:52.051 Fetching value of define "__znver3__" : (undefined) 00:03:52.051 Fetching value of define "__znver4__" : (undefined) 00:03:52.051 Compiler for C supports arguments -Wno-format-truncation: YES 00:03:52.051 Message: lib/log: Defining dependency "log" 00:03:52.051 Message: lib/kvargs: Defining dependency "kvargs" 00:03:52.051 Message: lib/telemetry: Defining dependency "telemetry" 00:03:52.051 Checking for function "getentropy" : NO 00:03:52.051 Message: lib/eal: Defining dependency "eal" 00:03:52.051 Message: lib/ring: Defining dependency "ring" 00:03:52.051 Message: lib/rcu: Defining dependency "rcu" 00:03:52.051 Message: lib/mempool: Defining dependency "mempool" 00:03:52.051 Message: lib/mbuf: Defining dependency "mbuf" 00:03:52.051 Fetching value of define "__PCLMUL__" : 1 (cached) 00:03:52.051 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:03:52.051 Compiler for C supports arguments -mpclmul: YES 00:03:52.051 Compiler for C supports arguments -maes: YES 00:03:52.051 Compiler for C supports arguments -mavx512f: YES (cached) 00:03:52.051 Compiler for C supports arguments -mavx512bw: YES 00:03:52.051 Compiler for C supports arguments -mavx512dq: YES 00:03:52.051 Compiler for C supports arguments -mavx512vl: YES 00:03:52.051 Compiler for C supports arguments -mvpclmulqdq: YES 00:03:52.051 Compiler for C supports arguments -mavx2: YES 00:03:52.051 Compiler for C supports arguments -mavx: YES 00:03:52.051 Message: lib/net: Defining dependency "net" 00:03:52.051 Message: lib/meter: Defining dependency "meter" 00:03:52.051 Message: lib/ethdev: Defining dependency "ethdev" 00:03:52.051 Message: lib/pci: Defining dependency "pci" 00:03:52.051 Message: lib/cmdline: Defining dependency "cmdline" 00:03:52.051 Message: lib/hash: Defining dependency "hash" 00:03:52.051 Message: lib/timer: Defining dependency "timer" 00:03:52.051 Message: lib/compressdev: Defining dependency "compressdev" 00:03:52.051 Message: lib/cryptodev: Defining dependency "cryptodev" 00:03:52.051 Message: lib/dmadev: Defining dependency "dmadev" 00:03:52.051 Compiler for C supports arguments -Wno-cast-qual: YES 00:03:52.051 Message: lib/power: Defining dependency "power" 00:03:52.051 Message: lib/reorder: Defining dependency "reorder" 00:03:52.051 Message: lib/security: Defining dependency "security" 00:03:52.051 Has header "linux/userfaultfd.h" : YES 00:03:52.051 Has header "linux/vduse.h" : YES 00:03:52.051 Message: lib/vhost: Defining dependency "vhost" 00:03:52.051 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:03:52.051 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:03:52.051 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:03:52.051 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:03:52.051 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:03:52.051 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:03:52.051 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:03:52.051 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:03:52.051 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:03:52.051 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:03:52.051 Program doxygen found: YES (/usr/local/bin/doxygen) 00:03:52.051 Configuring doxy-api-html.conf using configuration 00:03:52.051 Configuring doxy-api-man.conf using configuration 00:03:52.051 Program mandb found: YES (/usr/bin/mandb) 00:03:52.052 Program sphinx-build found: NO 00:03:52.052 Configuring rte_build_config.h using configuration 00:03:52.052 Message: 00:03:52.052 ================= 00:03:52.052 Applications Enabled 00:03:52.052 ================= 00:03:52.052 00:03:52.052 apps: 00:03:52.052 00:03:52.052 00:03:52.052 Message: 00:03:52.052 ================= 00:03:52.052 Libraries Enabled 00:03:52.052 ================= 00:03:52.052 00:03:52.052 libs: 00:03:52.052 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:03:52.052 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:03:52.052 cryptodev, dmadev, power, reorder, security, vhost, 00:03:52.052 00:03:52.052 Message: 00:03:52.052 =============== 00:03:52.052 Drivers Enabled 00:03:52.052 =============== 00:03:52.052 00:03:52.052 common: 00:03:52.052 00:03:52.052 bus: 00:03:52.052 pci, vdev, 00:03:52.052 mempool: 00:03:52.052 ring, 00:03:52.052 dma: 00:03:52.052 00:03:52.052 net: 00:03:52.052 00:03:52.052 crypto: 00:03:52.052 00:03:52.052 compress: 00:03:52.052 00:03:52.052 vdpa: 00:03:52.052 00:03:52.052 00:03:52.052 Message: 00:03:52.052 ================= 00:03:52.052 Content Skipped 00:03:52.052 ================= 00:03:52.052 00:03:52.052 apps: 00:03:52.052 dumpcap: explicitly disabled via build config 00:03:52.052 graph: explicitly disabled via build config 00:03:52.052 pdump: explicitly disabled via build config 00:03:52.052 proc-info: explicitly disabled via build config 00:03:52.052 test-acl: explicitly disabled via build config 00:03:52.052 test-bbdev: explicitly disabled via build config 00:03:52.052 test-cmdline: explicitly disabled via build config 00:03:52.052 test-compress-perf: explicitly disabled via build config 00:03:52.052 test-crypto-perf: explicitly disabled via build config 00:03:52.052 test-dma-perf: explicitly disabled via build config 00:03:52.052 test-eventdev: explicitly disabled via build config 00:03:52.052 test-fib: explicitly disabled via build config 00:03:52.052 test-flow-perf: explicitly disabled via build config 00:03:52.052 test-gpudev: explicitly disabled via build config 00:03:52.052 test-mldev: explicitly disabled via build config 00:03:52.052 test-pipeline: explicitly disabled via build config 00:03:52.052 test-pmd: explicitly disabled via build config 00:03:52.052 test-regex: explicitly disabled via build config 00:03:52.052 test-sad: explicitly disabled via build config 00:03:52.052 test-security-perf: explicitly disabled via build config 00:03:52.052 00:03:52.052 libs: 00:03:52.052 argparse: explicitly disabled via build config 00:03:52.052 metrics: explicitly disabled via build config 00:03:52.052 acl: explicitly disabled via build config 00:03:52.052 bbdev: explicitly disabled via build config 00:03:52.052 bitratestats: explicitly disabled via build config 00:03:52.052 bpf: explicitly disabled via build config 00:03:52.052 cfgfile: explicitly disabled via build config 00:03:52.052 distributor: explicitly disabled via build config 00:03:52.052 efd: explicitly disabled via build config 00:03:52.052 eventdev: explicitly disabled via build config 00:03:52.052 dispatcher: explicitly disabled via build config 00:03:52.052 gpudev: explicitly disabled via build config 00:03:52.052 gro: explicitly disabled via build config 00:03:52.052 gso: explicitly disabled via build config 00:03:52.052 ip_frag: explicitly disabled via build config 00:03:52.052 jobstats: explicitly disabled via build config 00:03:52.052 latencystats: explicitly disabled via build config 00:03:52.052 lpm: explicitly disabled via build config 00:03:52.052 member: explicitly disabled via build config 00:03:52.052 pcapng: explicitly disabled via build config 00:03:52.052 rawdev: explicitly disabled via build config 00:03:52.052 regexdev: explicitly disabled via build config 00:03:52.052 mldev: explicitly disabled via build config 00:03:52.052 rib: explicitly disabled via build config 00:03:52.052 sched: explicitly disabled via build config 00:03:52.052 stack: explicitly disabled via build config 00:03:52.052 ipsec: explicitly disabled via build config 00:03:52.052 pdcp: explicitly disabled via build config 00:03:52.052 fib: explicitly disabled via build config 00:03:52.052 port: explicitly disabled via build config 00:03:52.052 pdump: explicitly disabled via build config 00:03:52.052 table: explicitly disabled via build config 00:03:52.052 pipeline: explicitly disabled via build config 00:03:52.052 graph: explicitly disabled via build config 00:03:52.052 node: explicitly disabled via build config 00:03:52.052 00:03:52.052 drivers: 00:03:52.052 common/cpt: not in enabled drivers build config 00:03:52.052 common/dpaax: not in enabled drivers build config 00:03:52.052 common/iavf: not in enabled drivers build config 00:03:52.052 common/idpf: not in enabled drivers build config 00:03:52.052 common/ionic: not in enabled drivers build config 00:03:52.052 common/mvep: not in enabled drivers build config 00:03:52.052 common/octeontx: not in enabled drivers build config 00:03:52.052 bus/auxiliary: not in enabled drivers build config 00:03:52.052 bus/cdx: not in enabled drivers build config 00:03:52.052 bus/dpaa: not in enabled drivers build config 00:03:52.052 bus/fslmc: not in enabled drivers build config 00:03:52.052 bus/ifpga: not in enabled drivers build config 00:03:52.052 bus/platform: not in enabled drivers build config 00:03:52.052 bus/uacce: not in enabled drivers build config 00:03:52.052 bus/vmbus: not in enabled drivers build config 00:03:52.052 common/cnxk: not in enabled drivers build config 00:03:52.052 common/mlx5: not in enabled drivers build config 00:03:52.052 common/nfp: not in enabled drivers build config 00:03:52.052 common/nitrox: not in enabled drivers build config 00:03:52.052 common/qat: not in enabled drivers build config 00:03:52.052 common/sfc_efx: not in enabled drivers build config 00:03:52.052 mempool/bucket: not in enabled drivers build config 00:03:52.052 mempool/cnxk: not in enabled drivers build config 00:03:52.052 mempool/dpaa: not in enabled drivers build config 00:03:52.052 mempool/dpaa2: not in enabled drivers build config 00:03:52.052 mempool/octeontx: not in enabled drivers build config 00:03:52.052 mempool/stack: not in enabled drivers build config 00:03:52.052 dma/cnxk: not in enabled drivers build config 00:03:52.052 dma/dpaa: not in enabled drivers build config 00:03:52.052 dma/dpaa2: not in enabled drivers build config 00:03:52.052 dma/hisilicon: not in enabled drivers build config 00:03:52.052 dma/idxd: not in enabled drivers build config 00:03:52.052 dma/ioat: not in enabled drivers build config 00:03:52.052 dma/skeleton: not in enabled drivers build config 00:03:52.052 net/af_packet: not in enabled drivers build config 00:03:52.052 net/af_xdp: not in enabled drivers build config 00:03:52.052 net/ark: not in enabled drivers build config 00:03:52.052 net/atlantic: not in enabled drivers build config 00:03:52.052 net/avp: not in enabled drivers build config 00:03:52.052 net/axgbe: not in enabled drivers build config 00:03:52.052 net/bnx2x: not in enabled drivers build config 00:03:52.052 net/bnxt: not in enabled drivers build config 00:03:52.052 net/bonding: not in enabled drivers build config 00:03:52.052 net/cnxk: not in enabled drivers build config 00:03:52.052 net/cpfl: not in enabled drivers build config 00:03:52.052 net/cxgbe: not in enabled drivers build config 00:03:52.052 net/dpaa: not in enabled drivers build config 00:03:52.052 net/dpaa2: not in enabled drivers build config 00:03:52.052 net/e1000: not in enabled drivers build config 00:03:52.052 net/ena: not in enabled drivers build config 00:03:52.052 net/enetc: not in enabled drivers build config 00:03:52.052 net/enetfec: not in enabled drivers build config 00:03:52.052 net/enic: not in enabled drivers build config 00:03:52.052 net/failsafe: not in enabled drivers build config 00:03:52.052 net/fm10k: not in enabled drivers build config 00:03:52.052 net/gve: not in enabled drivers build config 00:03:52.052 net/hinic: not in enabled drivers build config 00:03:52.052 net/hns3: not in enabled drivers build config 00:03:52.052 net/i40e: not in enabled drivers build config 00:03:52.052 net/iavf: not in enabled drivers build config 00:03:52.052 net/ice: not in enabled drivers build config 00:03:52.052 net/idpf: not in enabled drivers build config 00:03:52.052 net/igc: not in enabled drivers build config 00:03:52.052 net/ionic: not in enabled drivers build config 00:03:52.052 net/ipn3ke: not in enabled drivers build config 00:03:52.052 net/ixgbe: not in enabled drivers build config 00:03:52.052 net/mana: not in enabled drivers build config 00:03:52.052 net/memif: not in enabled drivers build config 00:03:52.052 net/mlx4: not in enabled drivers build config 00:03:52.052 net/mlx5: not in enabled drivers build config 00:03:52.052 net/mvneta: not in enabled drivers build config 00:03:52.052 net/mvpp2: not in enabled drivers build config 00:03:52.052 net/netvsc: not in enabled drivers build config 00:03:52.052 net/nfb: not in enabled drivers build config 00:03:52.052 net/nfp: not in enabled drivers build config 00:03:52.052 net/ngbe: not in enabled drivers build config 00:03:52.052 net/null: not in enabled drivers build config 00:03:52.052 net/octeontx: not in enabled drivers build config 00:03:52.052 net/octeon_ep: not in enabled drivers build config 00:03:52.052 net/pcap: not in enabled drivers build config 00:03:52.052 net/pfe: not in enabled drivers build config 00:03:52.052 net/qede: not in enabled drivers build config 00:03:52.052 net/ring: not in enabled drivers build config 00:03:52.052 net/sfc: not in enabled drivers build config 00:03:52.052 net/softnic: not in enabled drivers build config 00:03:52.052 net/tap: not in enabled drivers build config 00:03:52.052 net/thunderx: not in enabled drivers build config 00:03:52.052 net/txgbe: not in enabled drivers build config 00:03:52.052 net/vdev_netvsc: not in enabled drivers build config 00:03:52.052 net/vhost: not in enabled drivers build config 00:03:52.052 net/virtio: not in enabled drivers build config 00:03:52.052 net/vmxnet3: not in enabled drivers build config 00:03:52.052 raw/*: missing internal dependency, "rawdev" 00:03:52.052 crypto/armv8: not in enabled drivers build config 00:03:52.052 crypto/bcmfs: not in enabled drivers build config 00:03:52.052 crypto/caam_jr: not in enabled drivers build config 00:03:52.052 crypto/ccp: not in enabled drivers build config 00:03:52.052 crypto/cnxk: not in enabled drivers build config 00:03:52.052 crypto/dpaa_sec: not in enabled drivers build config 00:03:52.052 crypto/dpaa2_sec: not in enabled drivers build config 00:03:52.052 crypto/ipsec_mb: not in enabled drivers build config 00:03:52.052 crypto/mlx5: not in enabled drivers build config 00:03:52.052 crypto/mvsam: not in enabled drivers build config 00:03:52.052 crypto/nitrox: not in enabled drivers build config 00:03:52.053 crypto/null: not in enabled drivers build config 00:03:52.053 crypto/octeontx: not in enabled drivers build config 00:03:52.053 crypto/openssl: not in enabled drivers build config 00:03:52.053 crypto/scheduler: not in enabled drivers build config 00:03:52.053 crypto/uadk: not in enabled drivers build config 00:03:52.053 crypto/virtio: not in enabled drivers build config 00:03:52.053 compress/isal: not in enabled drivers build config 00:03:52.053 compress/mlx5: not in enabled drivers build config 00:03:52.053 compress/nitrox: not in enabled drivers build config 00:03:52.053 compress/octeontx: not in enabled drivers build config 00:03:52.053 compress/zlib: not in enabled drivers build config 00:03:52.053 regex/*: missing internal dependency, "regexdev" 00:03:52.053 ml/*: missing internal dependency, "mldev" 00:03:52.053 vdpa/ifc: not in enabled drivers build config 00:03:52.053 vdpa/mlx5: not in enabled drivers build config 00:03:52.053 vdpa/nfp: not in enabled drivers build config 00:03:52.053 vdpa/sfc: not in enabled drivers build config 00:03:52.053 event/*: missing internal dependency, "eventdev" 00:03:52.053 baseband/*: missing internal dependency, "bbdev" 00:03:52.053 gpu/*: missing internal dependency, "gpudev" 00:03:52.053 00:03:52.053 00:03:52.053 Build targets in project: 85 00:03:52.053 00:03:52.053 DPDK 24.03.0 00:03:52.053 00:03:52.053 User defined options 00:03:52.053 buildtype : debug 00:03:52.053 default_library : shared 00:03:52.053 libdir : lib 00:03:52.053 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:03:52.053 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:03:52.053 c_link_args : 00:03:52.053 cpu_instruction_set: native 00:03:52.053 disable_apps : test-fib,test-sad,test,test-regex,test-security-perf,test-bbdev,dumpcap,test-crypto-perf,test-flow-perf,test-gpudev,test-cmdline,test-dma-perf,test-eventdev,test-pipeline,test-acl,proc-info,test-compress-perf,graph,test-pmd,test-mldev,pdump 00:03:52.053 disable_libs : bbdev,argparse,latencystats,member,gpudev,mldev,pipeline,lpm,efd,regexdev,sched,node,dispatcher,table,bpf,port,gro,fib,cfgfile,ip_frag,gso,rawdev,ipsec,pdcp,rib,acl,metrics,graph,pcapng,jobstats,eventdev,stack,bitratestats,distributor,pdump 00:03:52.053 enable_docs : false 00:03:52.053 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:03:52.053 enable_kmods : false 00:03:52.053 max_lcores : 128 00:03:52.053 tests : false 00:03:52.053 00:03:52.053 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:52.053 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:03:52.053 [1/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:03:52.053 [2/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:03:52.053 [3/268] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:03:52.316 [4/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:03:52.316 [5/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:03:52.316 [6/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:03:52.316 [7/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:03:52.316 [8/268] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:03:52.316 [9/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:03:52.316 [10/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:03:52.316 [11/268] Linking static target lib/librte_kvargs.a 00:03:52.316 [12/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:03:52.316 [13/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:03:52.316 [14/268] Compiling C object lib/librte_log.a.p/log_log.c.o 00:03:52.316 [15/268] Linking static target lib/librte_log.a 00:03:52.316 [16/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:03:53.264 [17/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:03:53.264 [18/268] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:03:53.264 [19/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:03:53.264 [20/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:03:53.264 [21/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:03:53.264 [22/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:03:53.264 [23/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:03:53.264 [24/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:03:53.264 [25/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:03:53.264 [26/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:03:53.264 [27/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:03:53.264 [28/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:03:53.264 [29/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:03:53.264 [30/268] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:03:53.264 [31/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:03:53.264 [32/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:03:53.264 [33/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:03:53.264 [34/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:03:53.264 [35/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:03:53.264 [36/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:03:53.264 [37/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:03:53.264 [38/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:03:53.264 [39/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:03:53.264 [40/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:03:53.264 [41/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:03:53.264 [42/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:03:53.264 [43/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:03:53.264 [44/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:03:53.264 [45/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:03:53.264 [46/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:03:53.264 [47/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:03:53.264 [48/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:03:53.264 [49/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:03:53.264 [50/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:03:53.264 [51/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:03:53.264 [52/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:03:53.264 [53/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:03:53.264 [54/268] Linking static target lib/librte_telemetry.a 00:03:53.264 [55/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:03:53.264 [56/268] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:03:53.264 [57/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:03:53.264 [58/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:03:53.264 [59/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:03:53.264 [60/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:03:53.264 [61/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:03:53.523 [62/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:03:53.523 [63/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:03:53.523 [64/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:03:53.523 [65/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:03:53.523 [66/268] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:03:53.523 [67/268] Linking target lib/librte_log.so.24.1 00:03:53.786 [68/268] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:03:53.786 [69/268] Linking static target lib/librte_pci.a 00:03:53.786 [70/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:03:53.786 [71/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:03:53.786 [72/268] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:03:54.049 [73/268] Linking static target lib/net/libnet_crc_avx512_lib.a 00:03:54.049 [74/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:03:54.049 [75/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:03:54.049 [76/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:03:54.049 [77/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:03:54.049 [78/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:03:54.049 [79/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:03:54.049 [80/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:03:54.049 [81/268] Generating symbol file lib/librte_log.so.24.1.p/librte_log.so.24.1.symbols 00:03:54.049 [82/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:03:54.049 [83/268] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:03:54.049 [84/268] Linking target lib/librte_kvargs.so.24.1 00:03:54.049 [85/268] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:03:54.049 [86/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:03:54.049 [87/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:03:54.049 [88/268] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:03:54.049 [89/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:03:54.049 [90/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:03:54.049 [91/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:03:54.049 [92/268] Linking static target lib/librte_meter.a 00:03:54.049 [93/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:03:54.049 [94/268] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:03:54.049 [95/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:03:54.330 [96/268] Linking static target lib/librte_ring.a 00:03:54.330 [97/268] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:03:54.330 [98/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:03:54.330 [99/268] Compiling C object lib/librte_hash.a.p/hash_rte_hash_crc.c.o 00:03:54.330 [100/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:03:54.330 [101/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:03:54.330 [102/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:03:54.330 [103/268] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:03:54.330 [104/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:03:54.330 [105/268] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:03:54.330 [106/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:03:54.330 [107/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:03:54.330 [108/268] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:03:54.330 [109/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:03:54.330 [110/268] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:03:54.330 [111/268] Linking target lib/librte_telemetry.so.24.1 00:03:54.330 [112/268] Linking static target lib/librte_rcu.a 00:03:54.330 [113/268] Linking static target lib/librte_eal.a 00:03:54.330 [114/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:03:54.330 [115/268] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:03:54.330 [116/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:03:54.330 [117/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:03:54.330 [118/268] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:03:54.330 [119/268] Generating symbol file lib/librte_kvargs.so.24.1.p/librte_kvargs.so.24.1.symbols 00:03:54.330 [120/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:03:54.330 [121/268] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:03:54.330 [122/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:03:54.593 [123/268] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:03:54.593 [124/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:03:54.593 [125/268] Linking static target lib/librte_mempool.a 00:03:54.593 [126/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:03:54.593 [127/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:03:54.593 [128/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:03:54.593 [129/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:03:54.593 [130/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_linux_ethtool.c.o 00:03:54.593 [131/268] Generating symbol file lib/librte_telemetry.so.24.1.p/librte_telemetry.so.24.1.symbols 00:03:54.593 [132/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:03:54.593 [133/268] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:03:54.593 [134/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:03:54.593 [135/268] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:03:54.859 [136/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:03:54.859 [137/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:03:54.859 [138/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:03:54.859 [139/268] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:03:54.859 [140/268] Linking static target lib/librte_net.a 00:03:54.859 [141/268] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:03:54.859 [142/268] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:03:54.859 [143/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:03:55.125 [144/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:03:55.125 [145/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash_gfni.c.o 00:03:55.125 [146/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:03:55.125 [147/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:03:55.125 [148/268] Linking static target lib/librte_cmdline.a 00:03:55.125 [149/268] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:03:55.125 [150/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:03:55.125 [151/268] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:03:55.125 [152/268] Linking static target lib/librte_timer.a 00:03:55.384 [153/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:03:55.384 [154/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:03:55.384 [155/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:03:55.384 [156/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:03:55.384 [157/268] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:03:55.384 [158/268] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:03:55.384 [159/268] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:03:55.384 [160/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:03:55.384 [161/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:03:55.384 [162/268] Linking static target lib/librte_dmadev.a 00:03:55.384 [163/268] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:03:55.384 [164/268] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:03:55.384 [165/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:03:55.643 [166/268] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:03:55.643 [167/268] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:03:55.643 [168/268] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:03:55.643 [169/268] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:03:55.643 [170/268] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:03:55.643 [171/268] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:03:55.643 [172/268] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:03:55.643 [173/268] Linking static target lib/librte_power.a 00:03:55.643 [174/268] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:03:55.643 [175/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:03:55.643 [176/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:03:55.643 [177/268] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:03:55.902 [178/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:03:55.902 [179/268] Linking static target drivers/libtmp_rte_bus_vdev.a 00:03:55.902 [180/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:03:55.902 [181/268] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:03:55.902 [182/268] Linking static target lib/librte_hash.a 00:03:55.902 [183/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:03:55.902 [184/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:03:55.902 [185/268] Linking static target lib/librte_compressdev.a 00:03:55.902 [186/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:03:55.902 [187/268] Linking static target lib/librte_mbuf.a 00:03:55.902 [188/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:03:55.902 [189/268] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:03:55.902 [190/268] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:03:55.902 [191/268] Linking static target lib/librte_reorder.a 00:03:55.902 [192/268] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:55.902 [193/268] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:03:55.902 [194/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:03:55.902 [195/268] Linking static target drivers/libtmp_rte_bus_pci.a 00:03:56.162 [196/268] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:03:56.162 [197/268] Linking static target drivers/libtmp_rte_mempool_ring.a 00:03:56.162 [198/268] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:03:56.162 [199/268] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:03:56.162 [200/268] Compiling C object drivers/librte_bus_vdev.so.24.1.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:03:56.162 [201/268] Linking static target drivers/librte_bus_vdev.a 00:03:56.162 [202/268] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:03:56.162 [203/268] Linking static target lib/librte_security.a 00:03:56.162 [204/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:03:56.162 [205/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:03:56.162 [206/268] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.162 [207/268] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.162 [208/268] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:03:56.162 [209/268] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:03:56.162 [210/268] Compiling C object drivers/librte_bus_pci.so.24.1.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:03:56.162 [211/268] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:03:56.162 [212/268] Linking static target drivers/librte_bus_pci.a 00:03:56.162 [213/268] Compiling C object drivers/librte_mempool_ring.so.24.1.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:03:56.162 [214/268] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:03:56.162 [215/268] Linking static target drivers/librte_mempool_ring.a 00:03:56.162 [216/268] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.420 [217/268] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.420 [218/268] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.420 [219/268] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.420 [220/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:03:56.420 [221/268] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.679 [222/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:03:56.679 [223/268] Linking static target lib/librte_ethdev.a 00:03:56.679 [224/268] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:03:56.679 [225/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:03:56.679 [226/268] Linking static target lib/librte_cryptodev.a 00:03:58.053 [227/268] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:03:58.988 [228/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:04:00.886 [229/268] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:04:00.886 [230/268] Linking target lib/librte_eal.so.24.1 00:04:00.886 [231/268] Generating symbol file lib/librte_eal.so.24.1.p/librte_eal.so.24.1.symbols 00:04:00.886 [232/268] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:04:00.886 [233/268] Linking target lib/librte_ring.so.24.1 00:04:00.886 [234/268] Linking target drivers/librte_bus_vdev.so.24.1 00:04:00.886 [235/268] Linking target lib/librte_timer.so.24.1 00:04:00.886 [236/268] Linking target lib/librte_meter.so.24.1 00:04:00.886 [237/268] Linking target lib/librte_dmadev.so.24.1 00:04:00.886 [238/268] Linking target lib/librte_pci.so.24.1 00:04:01.143 [239/268] Generating symbol file lib/librte_meter.so.24.1.p/librte_meter.so.24.1.symbols 00:04:01.143 [240/268] Generating symbol file lib/librte_dmadev.so.24.1.p/librte_dmadev.so.24.1.symbols 00:04:01.143 [241/268] Generating symbol file lib/librte_ring.so.24.1.p/librte_ring.so.24.1.symbols 00:04:01.143 [242/268] Generating symbol file lib/librte_timer.so.24.1.p/librte_timer.so.24.1.symbols 00:04:01.144 [243/268] Generating symbol file lib/librte_pci.so.24.1.p/librte_pci.so.24.1.symbols 00:04:01.144 [244/268] Linking target lib/librte_rcu.so.24.1 00:04:01.144 [245/268] Linking target lib/librte_mempool.so.24.1 00:04:01.144 [246/268] Linking target drivers/librte_bus_pci.so.24.1 00:04:01.144 [247/268] Generating symbol file lib/librte_rcu.so.24.1.p/librte_rcu.so.24.1.symbols 00:04:01.144 [248/268] Generating symbol file lib/librte_mempool.so.24.1.p/librte_mempool.so.24.1.symbols 00:04:01.144 [249/268] Linking target drivers/librte_mempool_ring.so.24.1 00:04:01.401 [250/268] Linking target lib/librte_mbuf.so.24.1 00:04:01.401 [251/268] Generating symbol file lib/librte_mbuf.so.24.1.p/librte_mbuf.so.24.1.symbols 00:04:01.401 [252/268] Linking target lib/librte_reorder.so.24.1 00:04:01.401 [253/268] Linking target lib/librte_compressdev.so.24.1 00:04:01.401 [254/268] Linking target lib/librte_net.so.24.1 00:04:01.401 [255/268] Linking target lib/librte_cryptodev.so.24.1 00:04:01.659 [256/268] Generating symbol file lib/librte_net.so.24.1.p/librte_net.so.24.1.symbols 00:04:01.659 [257/268] Generating symbol file lib/librte_cryptodev.so.24.1.p/librte_cryptodev.so.24.1.symbols 00:04:01.659 [258/268] Linking target lib/librte_security.so.24.1 00:04:01.659 [259/268] Linking target lib/librte_cmdline.so.24.1 00:04:01.659 [260/268] Linking target lib/librte_hash.so.24.1 00:04:01.659 [261/268] Linking target lib/librte_ethdev.so.24.1 00:04:01.660 [262/268] Generating symbol file lib/librte_hash.so.24.1.p/librte_hash.so.24.1.symbols 00:04:01.660 [263/268] Generating symbol file lib/librte_ethdev.so.24.1.p/librte_ethdev.so.24.1.symbols 00:04:01.918 [264/268] Linking target lib/librte_power.so.24.1 00:04:05.198 [265/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:04:05.198 [266/268] Linking static target lib/librte_vhost.a 00:04:05.764 [267/268] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:04:05.764 [268/268] Linking target lib/librte_vhost.so.24.1 00:04:05.764 INFO: autodetecting backend as ninja 00:04:05.764 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:04:27.722 CC lib/ut/ut.o 00:04:27.722 CC lib/log/log.o 00:04:27.722 CC lib/log/log_flags.o 00:04:27.722 CC lib/log/log_deprecated.o 00:04:27.722 CC lib/ut_mock/mock.o 00:04:27.722 LIB libspdk_ut_mock.a 00:04:27.722 LIB libspdk_log.a 00:04:27.722 LIB libspdk_ut.a 00:04:27.722 SO libspdk_ut_mock.so.6.0 00:04:27.722 SO libspdk_log.so.7.0 00:04:27.722 SO libspdk_ut.so.2.0 00:04:27.722 SYMLINK libspdk_ut_mock.so 00:04:27.722 SYMLINK libspdk_ut.so 00:04:27.722 SYMLINK libspdk_log.so 00:04:27.722 CXX lib/trace_parser/trace.o 00:04:27.722 CC lib/ioat/ioat.o 00:04:27.722 CC lib/dma/dma.o 00:04:27.722 CC lib/util/base64.o 00:04:27.722 CC lib/util/bit_array.o 00:04:27.722 CC lib/util/cpuset.o 00:04:27.722 CC lib/util/crc16.o 00:04:27.722 CC lib/util/crc32.o 00:04:27.722 CC lib/util/crc32c.o 00:04:27.722 CC lib/util/crc32_ieee.o 00:04:27.722 CC lib/util/crc64.o 00:04:27.722 CC lib/util/dif.o 00:04:27.722 CC lib/util/fd.o 00:04:27.722 CC lib/util/fd_group.o 00:04:27.722 CC lib/util/file.o 00:04:27.722 CC lib/util/hexlify.o 00:04:27.722 CC lib/util/iov.o 00:04:27.722 CC lib/util/math.o 00:04:27.722 CC lib/util/net.o 00:04:27.722 CC lib/util/pipe.o 00:04:27.722 CC lib/util/string.o 00:04:27.722 CC lib/util/strerror_tls.o 00:04:27.722 CC lib/util/uuid.o 00:04:27.722 CC lib/util/zipf.o 00:04:27.722 CC lib/util/xor.o 00:04:27.722 CC lib/util/md5.o 00:04:27.722 CC lib/vfio_user/host/vfio_user_pci.o 00:04:27.722 CC lib/vfio_user/host/vfio_user.o 00:04:27.722 LIB libspdk_dma.a 00:04:27.722 SO libspdk_dma.so.5.0 00:04:27.722 SYMLINK libspdk_dma.so 00:04:27.722 LIB libspdk_ioat.a 00:04:27.722 SO libspdk_ioat.so.7.0 00:04:27.722 SYMLINK libspdk_ioat.so 00:04:27.722 LIB libspdk_vfio_user.a 00:04:27.722 SO libspdk_vfio_user.so.5.0 00:04:27.722 SYMLINK libspdk_vfio_user.so 00:04:27.722 LIB libspdk_util.a 00:04:27.722 SO libspdk_util.so.10.0 00:04:27.722 SYMLINK libspdk_util.so 00:04:27.722 CC lib/env_dpdk/env.o 00:04:27.722 CC lib/vmd/vmd.o 00:04:27.722 CC lib/rdma_provider/common.o 00:04:27.722 CC lib/env_dpdk/memory.o 00:04:27.722 CC lib/vmd/led.o 00:04:27.722 CC lib/rdma_provider/rdma_provider_verbs.o 00:04:27.722 CC lib/env_dpdk/pci.o 00:04:27.722 CC lib/json/json_parse.o 00:04:27.722 CC lib/idxd/idxd.o 00:04:27.722 CC lib/env_dpdk/init.o 00:04:27.722 CC lib/json/json_util.o 00:04:27.722 CC lib/rdma_utils/rdma_utils.o 00:04:27.722 CC lib/env_dpdk/threads.o 00:04:27.722 CC lib/idxd/idxd_user.o 00:04:27.722 CC lib/idxd/idxd_kernel.o 00:04:27.722 CC lib/json/json_write.o 00:04:27.722 CC lib/env_dpdk/pci_ioat.o 00:04:27.722 CC lib/conf/conf.o 00:04:27.722 CC lib/env_dpdk/pci_virtio.o 00:04:27.722 CC lib/env_dpdk/pci_vmd.o 00:04:27.722 CC lib/env_dpdk/pci_idxd.o 00:04:27.722 CC lib/env_dpdk/pci_event.o 00:04:27.722 CC lib/env_dpdk/sigbus_handler.o 00:04:27.722 CC lib/env_dpdk/pci_dpdk.o 00:04:27.722 CC lib/env_dpdk/pci_dpdk_2207.o 00:04:27.722 CC lib/env_dpdk/pci_dpdk_2211.o 00:04:27.722 LIB libspdk_trace_parser.a 00:04:27.722 SO libspdk_trace_parser.so.6.0 00:04:27.722 SYMLINK libspdk_trace_parser.so 00:04:27.722 LIB libspdk_conf.a 00:04:27.722 SO libspdk_conf.so.6.0 00:04:27.722 LIB libspdk_rdma_provider.a 00:04:27.722 SO libspdk_rdma_provider.so.6.0 00:04:27.722 SYMLINK libspdk_conf.so 00:04:27.722 SYMLINK libspdk_rdma_provider.so 00:04:27.722 LIB libspdk_json.a 00:04:27.722 SO libspdk_json.so.6.0 00:04:27.722 LIB libspdk_rdma_utils.a 00:04:27.722 SO libspdk_rdma_utils.so.1.0 00:04:27.722 SYMLINK libspdk_json.so 00:04:27.722 SYMLINK libspdk_rdma_utils.so 00:04:27.722 CC lib/jsonrpc/jsonrpc_server.o 00:04:27.722 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:04:27.722 CC lib/jsonrpc/jsonrpc_client.o 00:04:27.722 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:04:27.722 LIB libspdk_idxd.a 00:04:27.722 SO libspdk_idxd.so.12.1 00:04:27.722 LIB libspdk_vmd.a 00:04:27.722 SYMLINK libspdk_idxd.so 00:04:27.722 SO libspdk_vmd.so.6.0 00:04:27.722 SYMLINK libspdk_vmd.so 00:04:28.008 LIB libspdk_jsonrpc.a 00:04:28.008 SO libspdk_jsonrpc.so.6.0 00:04:28.008 SYMLINK libspdk_jsonrpc.so 00:04:28.008 CC lib/rpc/rpc.o 00:04:28.269 LIB libspdk_rpc.a 00:04:28.269 SO libspdk_rpc.so.6.0 00:04:28.527 SYMLINK libspdk_rpc.so 00:04:28.527 CC lib/notify/notify.o 00:04:28.527 CC lib/notify/notify_rpc.o 00:04:28.527 CC lib/trace/trace.o 00:04:28.527 CC lib/keyring/keyring.o 00:04:28.527 CC lib/keyring/keyring_rpc.o 00:04:28.527 CC lib/trace/trace_flags.o 00:04:28.527 CC lib/trace/trace_rpc.o 00:04:28.785 LIB libspdk_notify.a 00:04:28.785 SO libspdk_notify.so.6.0 00:04:28.785 SYMLINK libspdk_notify.so 00:04:28.785 LIB libspdk_keyring.a 00:04:28.785 LIB libspdk_trace.a 00:04:28.785 SO libspdk_keyring.so.2.0 00:04:28.785 SO libspdk_trace.so.11.0 00:04:29.043 SYMLINK libspdk_keyring.so 00:04:29.043 SYMLINK libspdk_trace.so 00:04:29.043 LIB libspdk_env_dpdk.a 00:04:29.043 SO libspdk_env_dpdk.so.15.0 00:04:29.043 CC lib/thread/thread.o 00:04:29.043 CC lib/sock/sock.o 00:04:29.043 CC lib/thread/iobuf.o 00:04:29.043 CC lib/sock/sock_rpc.o 00:04:29.043 SYMLINK libspdk_env_dpdk.so 00:04:29.609 LIB libspdk_sock.a 00:04:29.609 SO libspdk_sock.so.10.0 00:04:29.609 SYMLINK libspdk_sock.so 00:04:29.868 CC lib/nvme/nvme_ctrlr_cmd.o 00:04:29.868 CC lib/nvme/nvme_ctrlr.o 00:04:29.868 CC lib/nvme/nvme_fabric.o 00:04:29.868 CC lib/nvme/nvme_ns_cmd.o 00:04:29.868 CC lib/nvme/nvme_ns.o 00:04:29.868 CC lib/nvme/nvme_pcie_common.o 00:04:29.868 CC lib/nvme/nvme_pcie.o 00:04:29.868 CC lib/nvme/nvme_qpair.o 00:04:29.868 CC lib/nvme/nvme.o 00:04:29.868 CC lib/nvme/nvme_quirks.o 00:04:29.868 CC lib/nvme/nvme_transport.o 00:04:29.868 CC lib/nvme/nvme_discovery.o 00:04:29.868 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:04:29.868 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:04:29.868 CC lib/nvme/nvme_tcp.o 00:04:29.868 CC lib/nvme/nvme_opal.o 00:04:29.868 CC lib/nvme/nvme_io_msg.o 00:04:29.868 CC lib/nvme/nvme_poll_group.o 00:04:29.868 CC lib/nvme/nvme_zns.o 00:04:29.868 CC lib/nvme/nvme_stubs.o 00:04:29.868 CC lib/nvme/nvme_auth.o 00:04:29.868 CC lib/nvme/nvme_cuse.o 00:04:29.868 CC lib/nvme/nvme_rdma.o 00:04:29.868 CC lib/nvme/nvme_vfio_user.o 00:04:30.800 LIB libspdk_thread.a 00:04:30.800 SO libspdk_thread.so.10.2 00:04:30.800 SYMLINK libspdk_thread.so 00:04:31.057 CC lib/fsdev/fsdev.o 00:04:31.057 CC lib/accel/accel.o 00:04:31.057 CC lib/blob/blobstore.o 00:04:31.057 CC lib/fsdev/fsdev_io.o 00:04:31.057 CC lib/accel/accel_rpc.o 00:04:31.057 CC lib/blob/request.o 00:04:31.057 CC lib/fsdev/fsdev_rpc.o 00:04:31.057 CC lib/virtio/virtio.o 00:04:31.057 CC lib/accel/accel_sw.o 00:04:31.057 CC lib/blob/zeroes.o 00:04:31.057 CC lib/virtio/virtio_vhost_user.o 00:04:31.057 CC lib/blob/blob_bs_dev.o 00:04:31.057 CC lib/virtio/virtio_vfio_user.o 00:04:31.057 CC lib/virtio/virtio_pci.o 00:04:31.057 CC lib/vfu_tgt/tgt_endpoint.o 00:04:31.057 CC lib/init/json_config.o 00:04:31.057 CC lib/vfu_tgt/tgt_rpc.o 00:04:31.057 CC lib/init/subsystem.o 00:04:31.057 CC lib/init/subsystem_rpc.o 00:04:31.057 CC lib/init/rpc.o 00:04:31.314 LIB libspdk_init.a 00:04:31.314 SO libspdk_init.so.6.0 00:04:31.314 LIB libspdk_virtio.a 00:04:31.314 LIB libspdk_vfu_tgt.a 00:04:31.314 SYMLINK libspdk_init.so 00:04:31.314 SO libspdk_virtio.so.7.0 00:04:31.314 SO libspdk_vfu_tgt.so.3.0 00:04:31.314 SYMLINK libspdk_vfu_tgt.so 00:04:31.314 SYMLINK libspdk_virtio.so 00:04:31.571 CC lib/event/app.o 00:04:31.571 CC lib/event/reactor.o 00:04:31.571 CC lib/event/log_rpc.o 00:04:31.571 CC lib/event/app_rpc.o 00:04:31.571 CC lib/event/scheduler_static.o 00:04:31.829 LIB libspdk_fsdev.a 00:04:31.829 SO libspdk_fsdev.so.1.0 00:04:31.829 SYMLINK libspdk_fsdev.so 00:04:31.829 LIB libspdk_event.a 00:04:32.086 SO libspdk_event.so.15.0 00:04:32.086 CC lib/fuse_dispatcher/fuse_dispatcher.o 00:04:32.086 SYMLINK libspdk_event.so 00:04:32.086 LIB libspdk_accel.a 00:04:32.086 SO libspdk_accel.so.16.0 00:04:32.086 LIB libspdk_nvme.a 00:04:32.343 SYMLINK libspdk_accel.so 00:04:32.343 SO libspdk_nvme.so.14.0 00:04:32.343 CC lib/bdev/bdev.o 00:04:32.343 CC lib/bdev/bdev_rpc.o 00:04:32.343 CC lib/bdev/bdev_zone.o 00:04:32.343 CC lib/bdev/part.o 00:04:32.343 CC lib/bdev/scsi_nvme.o 00:04:32.600 SYMLINK libspdk_nvme.so 00:04:32.600 LIB libspdk_fuse_dispatcher.a 00:04:32.600 SO libspdk_fuse_dispatcher.so.1.0 00:04:32.857 SYMLINK libspdk_fuse_dispatcher.so 00:04:34.227 LIB libspdk_blob.a 00:04:34.227 SO libspdk_blob.so.11.0 00:04:34.227 SYMLINK libspdk_blob.so 00:04:34.227 CC lib/lvol/lvol.o 00:04:34.227 CC lib/blobfs/blobfs.o 00:04:34.227 CC lib/blobfs/tree.o 00:04:35.160 LIB libspdk_bdev.a 00:04:35.160 SO libspdk_bdev.so.17.0 00:04:35.160 LIB libspdk_blobfs.a 00:04:35.160 SYMLINK libspdk_bdev.so 00:04:35.160 SO libspdk_blobfs.so.10.0 00:04:35.160 SYMLINK libspdk_blobfs.so 00:04:35.160 LIB libspdk_lvol.a 00:04:35.426 SO libspdk_lvol.so.10.0 00:04:35.426 CC lib/ublk/ublk.o 00:04:35.426 CC lib/nbd/nbd.o 00:04:35.426 CC lib/ublk/ublk_rpc.o 00:04:35.426 CC lib/ftl/ftl_core.o 00:04:35.426 CC lib/scsi/dev.o 00:04:35.426 CC lib/nbd/nbd_rpc.o 00:04:35.426 CC lib/nvmf/ctrlr.o 00:04:35.426 CC lib/ftl/ftl_init.o 00:04:35.426 CC lib/scsi/lun.o 00:04:35.426 CC lib/ftl/ftl_layout.o 00:04:35.426 CC lib/scsi/port.o 00:04:35.426 CC lib/ftl/ftl_debug.o 00:04:35.426 CC lib/nvmf/ctrlr_discovery.o 00:04:35.426 CC lib/ftl/ftl_io.o 00:04:35.426 CC lib/scsi/scsi.o 00:04:35.426 CC lib/nvmf/ctrlr_bdev.o 00:04:35.426 CC lib/scsi/scsi_bdev.o 00:04:35.426 CC lib/nvmf/subsystem.o 00:04:35.426 CC lib/ftl/ftl_sb.o 00:04:35.426 CC lib/ftl/ftl_l2p_flat.o 00:04:35.426 CC lib/scsi/scsi_pr.o 00:04:35.426 CC lib/nvmf/nvmf.o 00:04:35.426 CC lib/ftl/ftl_l2p.o 00:04:35.426 CC lib/scsi/scsi_rpc.o 00:04:35.426 CC lib/nvmf/nvmf_rpc.o 00:04:35.426 CC lib/ftl/ftl_nv_cache.o 00:04:35.426 CC lib/nvmf/transport.o 00:04:35.426 CC lib/scsi/task.o 00:04:35.426 CC lib/nvmf/tcp.o 00:04:35.426 CC lib/nvmf/stubs.o 00:04:35.426 CC lib/ftl/ftl_band.o 00:04:35.426 CC lib/nvmf/mdns_server.o 00:04:35.426 CC lib/nvmf/vfio_user.o 00:04:35.426 CC lib/ftl/ftl_band_ops.o 00:04:35.426 CC lib/nvmf/rdma.o 00:04:35.426 CC lib/ftl/ftl_writer.o 00:04:35.426 CC lib/nvmf/auth.o 00:04:35.426 CC lib/ftl/ftl_rq.o 00:04:35.426 CC lib/ftl/ftl_reloc.o 00:04:35.426 CC lib/ftl/ftl_l2p_cache.o 00:04:35.426 CC lib/ftl/ftl_p2l.o 00:04:35.426 CC lib/ftl/ftl_p2l_log.o 00:04:35.426 CC lib/ftl/mngt/ftl_mngt.o 00:04:35.426 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:04:35.426 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:04:35.426 CC lib/ftl/mngt/ftl_mngt_startup.o 00:04:35.426 CC lib/ftl/mngt/ftl_mngt_md.o 00:04:35.426 SYMLINK libspdk_lvol.so 00:04:35.426 CC lib/ftl/mngt/ftl_mngt_misc.o 00:04:35.687 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:04:35.687 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:04:35.687 CC lib/ftl/mngt/ftl_mngt_band.o 00:04:35.687 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:04:35.687 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:04:35.687 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:04:35.687 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:04:35.687 CC lib/ftl/utils/ftl_conf.o 00:04:35.947 CC lib/ftl/utils/ftl_md.o 00:04:35.947 CC lib/ftl/utils/ftl_mempool.o 00:04:35.947 CC lib/ftl/utils/ftl_bitmap.o 00:04:35.947 CC lib/ftl/utils/ftl_property.o 00:04:35.947 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:04:35.947 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:04:35.947 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:04:35.947 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:04:35.947 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:04:35.947 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:04:35.947 CC lib/ftl/upgrade/ftl_trim_upgrade.o 00:04:35.947 CC lib/ftl/upgrade/ftl_sb_v3.o 00:04:35.947 CC lib/ftl/upgrade/ftl_sb_v5.o 00:04:35.947 CC lib/ftl/nvc/ftl_nvc_dev.o 00:04:35.947 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:04:35.947 CC lib/ftl/nvc/ftl_nvc_bdev_non_vss.o 00:04:36.205 CC lib/ftl/nvc/ftl_nvc_bdev_common.o 00:04:36.205 CC lib/ftl/base/ftl_base_dev.o 00:04:36.205 CC lib/ftl/base/ftl_base_bdev.o 00:04:36.205 CC lib/ftl/ftl_trace.o 00:04:36.205 LIB libspdk_nbd.a 00:04:36.205 SO libspdk_nbd.so.7.0 00:04:36.205 SYMLINK libspdk_nbd.so 00:04:36.463 LIB libspdk_scsi.a 00:04:36.463 SO libspdk_scsi.so.9.0 00:04:36.463 LIB libspdk_ublk.a 00:04:36.463 SO libspdk_ublk.so.3.0 00:04:36.463 SYMLINK libspdk_scsi.so 00:04:36.463 SYMLINK libspdk_ublk.so 00:04:36.721 CC lib/vhost/vhost.o 00:04:36.721 CC lib/iscsi/conn.o 00:04:36.721 CC lib/vhost/vhost_rpc.o 00:04:36.721 CC lib/iscsi/init_grp.o 00:04:36.721 CC lib/iscsi/iscsi.o 00:04:36.721 CC lib/vhost/vhost_scsi.o 00:04:36.721 CC lib/vhost/vhost_blk.o 00:04:36.721 CC lib/iscsi/param.o 00:04:36.721 CC lib/iscsi/portal_grp.o 00:04:36.721 CC lib/vhost/rte_vhost_user.o 00:04:36.721 CC lib/iscsi/tgt_node.o 00:04:36.721 CC lib/iscsi/iscsi_subsystem.o 00:04:36.721 CC lib/iscsi/iscsi_rpc.o 00:04:36.721 CC lib/iscsi/task.o 00:04:36.977 LIB libspdk_ftl.a 00:04:36.978 SO libspdk_ftl.so.9.0 00:04:37.235 SYMLINK libspdk_ftl.so 00:04:37.800 LIB libspdk_vhost.a 00:04:38.056 SO libspdk_vhost.so.8.0 00:04:38.056 SYMLINK libspdk_vhost.so 00:04:38.056 LIB libspdk_nvmf.a 00:04:38.056 LIB libspdk_iscsi.a 00:04:38.056 SO libspdk_iscsi.so.8.0 00:04:38.056 SO libspdk_nvmf.so.19.0 00:04:38.313 SYMLINK libspdk_iscsi.so 00:04:38.313 SYMLINK libspdk_nvmf.so 00:04:38.570 CC module/env_dpdk/env_dpdk_rpc.o 00:04:38.570 CC module/vfu_device/vfu_virtio.o 00:04:38.570 CC module/vfu_device/vfu_virtio_blk.o 00:04:38.570 CC module/vfu_device/vfu_virtio_scsi.o 00:04:38.570 CC module/vfu_device/vfu_virtio_rpc.o 00:04:38.570 CC module/vfu_device/vfu_virtio_fs.o 00:04:38.570 CC module/accel/dsa/accel_dsa.o 00:04:38.570 CC module/sock/posix/posix.o 00:04:38.570 CC module/fsdev/aio/fsdev_aio.o 00:04:38.570 CC module/keyring/linux/keyring.o 00:04:38.570 CC module/accel/error/accel_error.o 00:04:38.570 CC module/accel/dsa/accel_dsa_rpc.o 00:04:38.571 CC module/keyring/linux/keyring_rpc.o 00:04:38.571 CC module/scheduler/dynamic/scheduler_dynamic.o 00:04:38.571 CC module/accel/iaa/accel_iaa_rpc.o 00:04:38.571 CC module/scheduler/gscheduler/gscheduler.o 00:04:38.571 CC module/accel/iaa/accel_iaa.o 00:04:38.571 CC module/fsdev/aio/fsdev_aio_rpc.o 00:04:38.571 CC module/accel/error/accel_error_rpc.o 00:04:38.571 CC module/blob/bdev/blob_bdev.o 00:04:38.571 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:04:38.571 CC module/fsdev/aio/linux_aio_mgr.o 00:04:38.571 CC module/accel/ioat/accel_ioat.o 00:04:38.571 CC module/accel/ioat/accel_ioat_rpc.o 00:04:38.571 CC module/keyring/file/keyring.o 00:04:38.571 CC module/keyring/file/keyring_rpc.o 00:04:38.829 LIB libspdk_env_dpdk_rpc.a 00:04:38.829 SO libspdk_env_dpdk_rpc.so.6.0 00:04:38.829 SYMLINK libspdk_env_dpdk_rpc.so 00:04:38.829 LIB libspdk_keyring_linux.a 00:04:38.829 LIB libspdk_scheduler_gscheduler.a 00:04:38.829 SO libspdk_keyring_linux.so.1.0 00:04:38.829 SO libspdk_scheduler_gscheduler.so.4.0 00:04:38.829 LIB libspdk_accel_ioat.a 00:04:38.829 LIB libspdk_scheduler_dynamic.a 00:04:38.829 SO libspdk_accel_ioat.so.6.0 00:04:38.829 LIB libspdk_accel_iaa.a 00:04:38.829 SYMLINK libspdk_keyring_linux.so 00:04:39.087 SO libspdk_scheduler_dynamic.so.4.0 00:04:39.087 SYMLINK libspdk_scheduler_gscheduler.so 00:04:39.087 LIB libspdk_keyring_file.a 00:04:39.087 SO libspdk_accel_iaa.so.3.0 00:04:39.087 LIB libspdk_scheduler_dpdk_governor.a 00:04:39.087 SO libspdk_keyring_file.so.2.0 00:04:39.087 LIB libspdk_accel_error.a 00:04:39.087 SYMLINK libspdk_accel_ioat.so 00:04:39.087 SO libspdk_scheduler_dpdk_governor.so.4.0 00:04:39.087 SYMLINK libspdk_scheduler_dynamic.so 00:04:39.087 SO libspdk_accel_error.so.2.0 00:04:39.087 LIB libspdk_blob_bdev.a 00:04:39.087 LIB libspdk_accel_dsa.a 00:04:39.087 SYMLINK libspdk_accel_iaa.so 00:04:39.087 SO libspdk_blob_bdev.so.11.0 00:04:39.087 SYMLINK libspdk_keyring_file.so 00:04:39.087 SYMLINK libspdk_scheduler_dpdk_governor.so 00:04:39.087 SO libspdk_accel_dsa.so.5.0 00:04:39.087 SYMLINK libspdk_accel_error.so 00:04:39.087 SYMLINK libspdk_blob_bdev.so 00:04:39.087 SYMLINK libspdk_accel_dsa.so 00:04:39.347 LIB libspdk_vfu_device.a 00:04:39.347 SO libspdk_vfu_device.so.3.0 00:04:39.347 CC module/bdev/malloc/bdev_malloc.o 00:04:39.347 CC module/bdev/delay/vbdev_delay.o 00:04:39.347 CC module/bdev/malloc/bdev_malloc_rpc.o 00:04:39.348 CC module/bdev/error/vbdev_error.o 00:04:39.348 CC module/blobfs/bdev/blobfs_bdev.o 00:04:39.348 CC module/bdev/error/vbdev_error_rpc.o 00:04:39.348 CC module/bdev/delay/vbdev_delay_rpc.o 00:04:39.348 CC module/bdev/gpt/gpt.o 00:04:39.348 CC module/bdev/null/bdev_null.o 00:04:39.348 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:04:39.348 CC module/bdev/gpt/vbdev_gpt.o 00:04:39.348 CC module/bdev/null/bdev_null_rpc.o 00:04:39.348 CC module/bdev/split/vbdev_split.o 00:04:39.348 CC module/bdev/nvme/bdev_nvme.o 00:04:39.348 CC module/bdev/nvme/bdev_nvme_rpc.o 00:04:39.348 CC module/bdev/nvme/nvme_rpc.o 00:04:39.348 CC module/bdev/split/vbdev_split_rpc.o 00:04:39.348 CC module/bdev/lvol/vbdev_lvol.o 00:04:39.348 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:04:39.348 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:04:39.348 CC module/bdev/iscsi/bdev_iscsi.o 00:04:39.348 CC module/bdev/nvme/bdev_mdns_client.o 00:04:39.348 CC module/bdev/nvme/vbdev_opal.o 00:04:39.348 CC module/bdev/nvme/vbdev_opal_rpc.o 00:04:39.348 CC module/bdev/ftl/bdev_ftl.o 00:04:39.348 CC module/bdev/aio/bdev_aio.o 00:04:39.348 CC module/bdev/passthru/vbdev_passthru.o 00:04:39.348 CC module/bdev/aio/bdev_aio_rpc.o 00:04:39.348 CC module/bdev/ftl/bdev_ftl_rpc.o 00:04:39.348 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:04:39.348 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:04:39.348 CC module/bdev/raid/bdev_raid.o 00:04:39.348 CC module/bdev/raid/bdev_raid_rpc.o 00:04:39.348 CC module/bdev/raid/bdev_raid_sb.o 00:04:39.348 CC module/bdev/virtio/bdev_virtio_scsi.o 00:04:39.348 CC module/bdev/raid/raid0.o 00:04:39.348 CC module/bdev/virtio/bdev_virtio_blk.o 00:04:39.348 CC module/bdev/raid/raid1.o 00:04:39.348 CC module/bdev/raid/concat.o 00:04:39.348 CC module/bdev/virtio/bdev_virtio_rpc.o 00:04:39.348 CC module/bdev/zone_block/vbdev_zone_block.o 00:04:39.348 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:04:39.348 LIB libspdk_fsdev_aio.a 00:04:39.348 SYMLINK libspdk_vfu_device.so 00:04:39.605 SO libspdk_fsdev_aio.so.1.0 00:04:39.605 SYMLINK libspdk_fsdev_aio.so 00:04:39.605 LIB libspdk_sock_posix.a 00:04:39.605 SO libspdk_sock_posix.so.6.0 00:04:39.863 LIB libspdk_blobfs_bdev.a 00:04:39.863 LIB libspdk_bdev_null.a 00:04:39.863 SYMLINK libspdk_sock_posix.so 00:04:39.863 LIB libspdk_bdev_split.a 00:04:39.863 SO libspdk_blobfs_bdev.so.6.0 00:04:39.863 SO libspdk_bdev_null.so.6.0 00:04:39.863 LIB libspdk_bdev_error.a 00:04:39.863 SO libspdk_bdev_split.so.6.0 00:04:39.863 LIB libspdk_bdev_zone_block.a 00:04:39.863 SO libspdk_bdev_error.so.6.0 00:04:39.863 LIB libspdk_bdev_gpt.a 00:04:39.863 SO libspdk_bdev_zone_block.so.6.0 00:04:39.863 SYMLINK libspdk_blobfs_bdev.so 00:04:39.863 SYMLINK libspdk_bdev_null.so 00:04:39.863 SO libspdk_bdev_gpt.so.6.0 00:04:39.863 SYMLINK libspdk_bdev_split.so 00:04:39.863 SYMLINK libspdk_bdev_error.so 00:04:39.863 LIB libspdk_bdev_ftl.a 00:04:39.863 LIB libspdk_bdev_passthru.a 00:04:39.863 SYMLINK libspdk_bdev_zone_block.so 00:04:39.863 SO libspdk_bdev_ftl.so.6.0 00:04:39.863 SO libspdk_bdev_passthru.so.6.0 00:04:39.863 SYMLINK libspdk_bdev_gpt.so 00:04:39.863 LIB libspdk_bdev_malloc.a 00:04:39.863 LIB libspdk_bdev_aio.a 00:04:39.863 LIB libspdk_bdev_delay.a 00:04:39.863 SO libspdk_bdev_malloc.so.6.0 00:04:39.863 SO libspdk_bdev_aio.so.6.0 00:04:39.863 LIB libspdk_bdev_iscsi.a 00:04:39.863 SYMLINK libspdk_bdev_ftl.so 00:04:40.120 SYMLINK libspdk_bdev_passthru.so 00:04:40.120 SO libspdk_bdev_delay.so.6.0 00:04:40.120 SO libspdk_bdev_iscsi.so.6.0 00:04:40.120 SYMLINK libspdk_bdev_malloc.so 00:04:40.120 SYMLINK libspdk_bdev_aio.so 00:04:40.120 SYMLINK libspdk_bdev_delay.so 00:04:40.121 SYMLINK libspdk_bdev_iscsi.so 00:04:40.121 LIB libspdk_bdev_lvol.a 00:04:40.121 SO libspdk_bdev_lvol.so.6.0 00:04:40.121 LIB libspdk_bdev_virtio.a 00:04:40.121 SYMLINK libspdk_bdev_lvol.so 00:04:40.121 SO libspdk_bdev_virtio.so.6.0 00:04:40.121 SYMLINK libspdk_bdev_virtio.so 00:04:40.688 LIB libspdk_bdev_raid.a 00:04:40.688 SO libspdk_bdev_raid.so.6.0 00:04:40.688 SYMLINK libspdk_bdev_raid.so 00:04:42.067 LIB libspdk_bdev_nvme.a 00:04:42.067 SO libspdk_bdev_nvme.so.7.0 00:04:42.067 SYMLINK libspdk_bdev_nvme.so 00:04:42.324 CC module/event/subsystems/iobuf/iobuf.o 00:04:42.324 CC module/event/subsystems/vmd/vmd.o 00:04:42.324 CC module/event/subsystems/vmd/vmd_rpc.o 00:04:42.324 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:04:42.324 CC module/event/subsystems/fsdev/fsdev.o 00:04:42.324 CC module/event/subsystems/scheduler/scheduler.o 00:04:42.324 CC module/event/subsystems/keyring/keyring.o 00:04:42.324 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:04:42.324 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:04:42.324 CC module/event/subsystems/sock/sock.o 00:04:42.324 LIB libspdk_event_keyring.a 00:04:42.324 LIB libspdk_event_vhost_blk.a 00:04:42.324 LIB libspdk_event_fsdev.a 00:04:42.324 LIB libspdk_event_scheduler.a 00:04:42.324 LIB libspdk_event_vfu_tgt.a 00:04:42.324 LIB libspdk_event_vmd.a 00:04:42.324 LIB libspdk_event_sock.a 00:04:42.582 SO libspdk_event_keyring.so.1.0 00:04:42.582 SO libspdk_event_vhost_blk.so.3.0 00:04:42.582 LIB libspdk_event_iobuf.a 00:04:42.582 SO libspdk_event_fsdev.so.1.0 00:04:42.582 SO libspdk_event_scheduler.so.4.0 00:04:42.582 SO libspdk_event_sock.so.5.0 00:04:42.582 SO libspdk_event_vfu_tgt.so.3.0 00:04:42.582 SO libspdk_event_vmd.so.6.0 00:04:42.582 SO libspdk_event_iobuf.so.3.0 00:04:42.582 SYMLINK libspdk_event_keyring.so 00:04:42.582 SYMLINK libspdk_event_vhost_blk.so 00:04:42.582 SYMLINK libspdk_event_fsdev.so 00:04:42.582 SYMLINK libspdk_event_sock.so 00:04:42.582 SYMLINK libspdk_event_scheduler.so 00:04:42.582 SYMLINK libspdk_event_vfu_tgt.so 00:04:42.582 SYMLINK libspdk_event_vmd.so 00:04:42.582 SYMLINK libspdk_event_iobuf.so 00:04:42.841 CC module/event/subsystems/accel/accel.o 00:04:42.841 LIB libspdk_event_accel.a 00:04:42.841 SO libspdk_event_accel.so.6.0 00:04:42.841 SYMLINK libspdk_event_accel.so 00:04:43.098 CC module/event/subsystems/bdev/bdev.o 00:04:43.356 LIB libspdk_event_bdev.a 00:04:43.356 SO libspdk_event_bdev.so.6.0 00:04:43.356 SYMLINK libspdk_event_bdev.so 00:04:43.614 CC module/event/subsystems/ublk/ublk.o 00:04:43.614 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:04:43.614 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:04:43.614 CC module/event/subsystems/nbd/nbd.o 00:04:43.614 CC module/event/subsystems/scsi/scsi.o 00:04:43.614 LIB libspdk_event_ublk.a 00:04:43.614 LIB libspdk_event_nbd.a 00:04:43.614 LIB libspdk_event_scsi.a 00:04:43.614 SO libspdk_event_ublk.so.3.0 00:04:43.614 SO libspdk_event_nbd.so.6.0 00:04:43.872 SO libspdk_event_scsi.so.6.0 00:04:43.872 SYMLINK libspdk_event_nbd.so 00:04:43.872 SYMLINK libspdk_event_ublk.so 00:04:43.872 SYMLINK libspdk_event_scsi.so 00:04:43.872 LIB libspdk_event_nvmf.a 00:04:43.872 SO libspdk_event_nvmf.so.6.0 00:04:43.872 SYMLINK libspdk_event_nvmf.so 00:04:43.872 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:04:43.872 CC module/event/subsystems/iscsi/iscsi.o 00:04:44.130 LIB libspdk_event_vhost_scsi.a 00:04:44.130 SO libspdk_event_vhost_scsi.so.3.0 00:04:44.130 LIB libspdk_event_iscsi.a 00:04:44.130 SO libspdk_event_iscsi.so.6.0 00:04:44.130 SYMLINK libspdk_event_vhost_scsi.so 00:04:44.130 SYMLINK libspdk_event_iscsi.so 00:04:44.388 SO libspdk.so.6.0 00:04:44.388 SYMLINK libspdk.so 00:04:44.388 CXX app/trace/trace.o 00:04:44.388 CC app/trace_record/trace_record.o 00:04:44.388 CC app/spdk_nvme_discover/discovery_aer.o 00:04:44.388 TEST_HEADER include/spdk/accel_module.h 00:04:44.388 TEST_HEADER include/spdk/accel.h 00:04:44.388 TEST_HEADER include/spdk/assert.h 00:04:44.388 TEST_HEADER include/spdk/barrier.h 00:04:44.388 TEST_HEADER include/spdk/base64.h 00:04:44.388 CC app/spdk_lspci/spdk_lspci.o 00:04:44.388 TEST_HEADER include/spdk/bdev.h 00:04:44.388 CC app/spdk_top/spdk_top.o 00:04:44.388 TEST_HEADER include/spdk/bdev_module.h 00:04:44.388 CC app/spdk_nvme_perf/perf.o 00:04:44.388 CC app/spdk_nvme_identify/identify.o 00:04:44.388 TEST_HEADER include/spdk/bdev_zone.h 00:04:44.388 TEST_HEADER include/spdk/bit_array.h 00:04:44.388 CC test/rpc_client/rpc_client_test.o 00:04:44.388 TEST_HEADER include/spdk/bit_pool.h 00:04:44.388 TEST_HEADER include/spdk/blob_bdev.h 00:04:44.388 TEST_HEADER include/spdk/blobfs_bdev.h 00:04:44.388 TEST_HEADER include/spdk/blobfs.h 00:04:44.388 TEST_HEADER include/spdk/blob.h 00:04:44.388 TEST_HEADER include/spdk/conf.h 00:04:44.388 TEST_HEADER include/spdk/config.h 00:04:44.388 TEST_HEADER include/spdk/cpuset.h 00:04:44.388 TEST_HEADER include/spdk/crc16.h 00:04:44.388 TEST_HEADER include/spdk/crc32.h 00:04:44.388 TEST_HEADER include/spdk/crc64.h 00:04:44.388 TEST_HEADER include/spdk/dif.h 00:04:44.388 TEST_HEADER include/spdk/dma.h 00:04:44.388 TEST_HEADER include/spdk/endian.h 00:04:44.388 TEST_HEADER include/spdk/env_dpdk.h 00:04:44.388 TEST_HEADER include/spdk/env.h 00:04:44.388 TEST_HEADER include/spdk/event.h 00:04:44.388 TEST_HEADER include/spdk/fd_group.h 00:04:44.652 TEST_HEADER include/spdk/fd.h 00:04:44.652 TEST_HEADER include/spdk/file.h 00:04:44.652 TEST_HEADER include/spdk/fsdev.h 00:04:44.652 TEST_HEADER include/spdk/fsdev_module.h 00:04:44.652 TEST_HEADER include/spdk/ftl.h 00:04:44.652 TEST_HEADER include/spdk/fuse_dispatcher.h 00:04:44.652 TEST_HEADER include/spdk/gpt_spec.h 00:04:44.652 TEST_HEADER include/spdk/hexlify.h 00:04:44.652 TEST_HEADER include/spdk/histogram_data.h 00:04:44.652 TEST_HEADER include/spdk/idxd.h 00:04:44.652 TEST_HEADER include/spdk/idxd_spec.h 00:04:44.652 TEST_HEADER include/spdk/init.h 00:04:44.652 TEST_HEADER include/spdk/ioat.h 00:04:44.652 TEST_HEADER include/spdk/ioat_spec.h 00:04:44.652 TEST_HEADER include/spdk/iscsi_spec.h 00:04:44.652 TEST_HEADER include/spdk/json.h 00:04:44.652 TEST_HEADER include/spdk/keyring.h 00:04:44.652 TEST_HEADER include/spdk/jsonrpc.h 00:04:44.652 TEST_HEADER include/spdk/keyring_module.h 00:04:44.652 TEST_HEADER include/spdk/likely.h 00:04:44.652 TEST_HEADER include/spdk/log.h 00:04:44.652 TEST_HEADER include/spdk/lvol.h 00:04:44.652 TEST_HEADER include/spdk/md5.h 00:04:44.652 TEST_HEADER include/spdk/memory.h 00:04:44.652 TEST_HEADER include/spdk/mmio.h 00:04:44.652 TEST_HEADER include/spdk/nbd.h 00:04:44.652 TEST_HEADER include/spdk/net.h 00:04:44.652 TEST_HEADER include/spdk/notify.h 00:04:44.652 TEST_HEADER include/spdk/nvme.h 00:04:44.652 TEST_HEADER include/spdk/nvme_ocssd.h 00:04:44.652 TEST_HEADER include/spdk/nvme_intel.h 00:04:44.652 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:04:44.652 TEST_HEADER include/spdk/nvme_spec.h 00:04:44.652 TEST_HEADER include/spdk/nvme_zns.h 00:04:44.652 TEST_HEADER include/spdk/nvmf_cmd.h 00:04:44.652 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:04:44.652 TEST_HEADER include/spdk/nvmf.h 00:04:44.652 TEST_HEADER include/spdk/nvmf_spec.h 00:04:44.652 TEST_HEADER include/spdk/nvmf_transport.h 00:04:44.652 TEST_HEADER include/spdk/opal.h 00:04:44.652 TEST_HEADER include/spdk/opal_spec.h 00:04:44.652 TEST_HEADER include/spdk/pci_ids.h 00:04:44.652 TEST_HEADER include/spdk/pipe.h 00:04:44.652 TEST_HEADER include/spdk/queue.h 00:04:44.652 TEST_HEADER include/spdk/reduce.h 00:04:44.652 TEST_HEADER include/spdk/rpc.h 00:04:44.652 TEST_HEADER include/spdk/scheduler.h 00:04:44.652 TEST_HEADER include/spdk/scsi.h 00:04:44.652 TEST_HEADER include/spdk/scsi_spec.h 00:04:44.652 TEST_HEADER include/spdk/stdinc.h 00:04:44.652 TEST_HEADER include/spdk/sock.h 00:04:44.652 TEST_HEADER include/spdk/string.h 00:04:44.652 TEST_HEADER include/spdk/thread.h 00:04:44.652 TEST_HEADER include/spdk/trace.h 00:04:44.652 TEST_HEADER include/spdk/tree.h 00:04:44.652 TEST_HEADER include/spdk/trace_parser.h 00:04:44.652 TEST_HEADER include/spdk/ublk.h 00:04:44.652 TEST_HEADER include/spdk/util.h 00:04:44.652 TEST_HEADER include/spdk/uuid.h 00:04:44.652 TEST_HEADER include/spdk/version.h 00:04:44.652 TEST_HEADER include/spdk/vfio_user_pci.h 00:04:44.652 TEST_HEADER include/spdk/vhost.h 00:04:44.652 TEST_HEADER include/spdk/vfio_user_spec.h 00:04:44.652 TEST_HEADER include/spdk/vmd.h 00:04:44.652 TEST_HEADER include/spdk/xor.h 00:04:44.652 TEST_HEADER include/spdk/zipf.h 00:04:44.652 CXX test/cpp_headers/accel.o 00:04:44.652 CXX test/cpp_headers/accel_module.o 00:04:44.652 CXX test/cpp_headers/assert.o 00:04:44.652 CXX test/cpp_headers/barrier.o 00:04:44.652 CXX test/cpp_headers/base64.o 00:04:44.652 CXX test/cpp_headers/bdev_module.o 00:04:44.652 CXX test/cpp_headers/bdev.o 00:04:44.652 CXX test/cpp_headers/bdev_zone.o 00:04:44.652 CXX test/cpp_headers/bit_array.o 00:04:44.652 CC app/iscsi_tgt/iscsi_tgt.o 00:04:44.652 CXX test/cpp_headers/bit_pool.o 00:04:44.652 CXX test/cpp_headers/blob_bdev.o 00:04:44.652 CXX test/cpp_headers/blobfs_bdev.o 00:04:44.652 CXX test/cpp_headers/blobfs.o 00:04:44.652 CXX test/cpp_headers/blob.o 00:04:44.652 CC examples/interrupt_tgt/interrupt_tgt.o 00:04:44.652 CC app/spdk_dd/spdk_dd.o 00:04:44.652 CXX test/cpp_headers/conf.o 00:04:44.652 CXX test/cpp_headers/config.o 00:04:44.652 CXX test/cpp_headers/cpuset.o 00:04:44.652 CXX test/cpp_headers/crc16.o 00:04:44.652 CC app/nvmf_tgt/nvmf_main.o 00:04:44.652 CXX test/cpp_headers/crc32.o 00:04:44.652 CC app/spdk_tgt/spdk_tgt.o 00:04:44.652 CC examples/ioat/verify/verify.o 00:04:44.652 CC test/thread/poller_perf/poller_perf.o 00:04:44.652 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:04:44.652 CC test/app/histogram_perf/histogram_perf.o 00:04:44.652 CC test/env/pci/pci_ut.o 00:04:44.652 CC test/app/stub/stub.o 00:04:44.652 CC test/env/memory/memory_ut.o 00:04:44.652 CC app/fio/nvme/fio_plugin.o 00:04:44.652 CC test/env/vtophys/vtophys.o 00:04:44.652 CC examples/ioat/perf/perf.o 00:04:44.652 CC test/app/jsoncat/jsoncat.o 00:04:44.652 CC examples/util/zipf/zipf.o 00:04:44.652 CC test/dma/test_dma/test_dma.o 00:04:44.652 CC test/app/bdev_svc/bdev_svc.o 00:04:44.652 CC app/fio/bdev/fio_plugin.o 00:04:44.914 LINK spdk_lspci 00:04:44.914 CC test/env/mem_callbacks/mem_callbacks.o 00:04:44.914 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:04:44.914 LINK rpc_client_test 00:04:44.914 LINK jsoncat 00:04:44.914 LINK spdk_nvme_discover 00:04:44.914 CXX test/cpp_headers/crc64.o 00:04:44.914 LINK interrupt_tgt 00:04:44.914 LINK poller_perf 00:04:44.914 CXX test/cpp_headers/dif.o 00:04:44.914 LINK histogram_perf 00:04:44.914 LINK zipf 00:04:44.914 CXX test/cpp_headers/dma.o 00:04:44.914 LINK vtophys 00:04:44.914 CXX test/cpp_headers/endian.o 00:04:45.175 CXX test/cpp_headers/env_dpdk.o 00:04:45.175 LINK env_dpdk_post_init 00:04:45.175 LINK spdk_trace_record 00:04:45.175 CXX test/cpp_headers/event.o 00:04:45.175 CXX test/cpp_headers/fd_group.o 00:04:45.175 LINK nvmf_tgt 00:04:45.175 CXX test/cpp_headers/env.o 00:04:45.175 CXX test/cpp_headers/fd.o 00:04:45.175 LINK stub 00:04:45.175 CXX test/cpp_headers/file.o 00:04:45.175 CXX test/cpp_headers/fsdev.o 00:04:45.175 CXX test/cpp_headers/fsdev_module.o 00:04:45.175 CXX test/cpp_headers/ftl.o 00:04:45.175 CXX test/cpp_headers/fuse_dispatcher.o 00:04:45.175 LINK iscsi_tgt 00:04:45.175 CXX test/cpp_headers/gpt_spec.o 00:04:45.175 LINK verify 00:04:45.175 LINK bdev_svc 00:04:45.175 LINK spdk_tgt 00:04:45.175 CXX test/cpp_headers/hexlify.o 00:04:45.175 CXX test/cpp_headers/histogram_data.o 00:04:45.175 LINK ioat_perf 00:04:45.175 CXX test/cpp_headers/idxd.o 00:04:45.175 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:04:45.175 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:04:45.437 CXX test/cpp_headers/idxd_spec.o 00:04:45.437 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:04:45.437 CXX test/cpp_headers/init.o 00:04:45.437 LINK spdk_dd 00:04:45.437 CXX test/cpp_headers/ioat.o 00:04:45.437 CXX test/cpp_headers/ioat_spec.o 00:04:45.437 CXX test/cpp_headers/iscsi_spec.o 00:04:45.437 CXX test/cpp_headers/json.o 00:04:45.437 CXX test/cpp_headers/jsonrpc.o 00:04:45.437 CXX test/cpp_headers/keyring.o 00:04:45.437 LINK pci_ut 00:04:45.437 CXX test/cpp_headers/keyring_module.o 00:04:45.437 CXX test/cpp_headers/likely.o 00:04:45.437 CXX test/cpp_headers/log.o 00:04:45.437 CXX test/cpp_headers/lvol.o 00:04:45.437 CXX test/cpp_headers/md5.o 00:04:45.437 CXX test/cpp_headers/memory.o 00:04:45.437 CXX test/cpp_headers/mmio.o 00:04:45.437 CXX test/cpp_headers/nbd.o 00:04:45.437 CXX test/cpp_headers/net.o 00:04:45.437 LINK spdk_trace 00:04:45.437 CXX test/cpp_headers/notify.o 00:04:45.437 CXX test/cpp_headers/nvme.o 00:04:45.437 CXX test/cpp_headers/nvme_intel.o 00:04:45.437 CXX test/cpp_headers/nvme_ocssd.o 00:04:45.437 CXX test/cpp_headers/nvme_ocssd_spec.o 00:04:45.437 CXX test/cpp_headers/nvme_spec.o 00:04:45.702 CXX test/cpp_headers/nvme_zns.o 00:04:45.702 CXX test/cpp_headers/nvmf_cmd.o 00:04:45.702 CXX test/cpp_headers/nvmf_fc_spec.o 00:04:45.702 CXX test/cpp_headers/nvmf.o 00:04:45.702 CXX test/cpp_headers/nvmf_spec.o 00:04:45.702 CXX test/cpp_headers/nvmf_transport.o 00:04:45.702 CC test/event/event_perf/event_perf.o 00:04:45.702 CC test/event/reactor/reactor.o 00:04:45.702 LINK nvme_fuzz 00:04:45.702 CC examples/sock/hello_world/hello_sock.o 00:04:45.702 LINK test_dma 00:04:45.702 LINK spdk_nvme 00:04:45.702 CC examples/vmd/lsvmd/lsvmd.o 00:04:45.702 CXX test/cpp_headers/opal.o 00:04:45.702 LINK spdk_bdev 00:04:45.702 CC examples/idxd/perf/perf.o 00:04:45.702 CXX test/cpp_headers/opal_spec.o 00:04:45.702 CC examples/thread/thread/thread_ex.o 00:04:45.963 CXX test/cpp_headers/pci_ids.o 00:04:45.963 CC test/event/reactor_perf/reactor_perf.o 00:04:45.963 CXX test/cpp_headers/pipe.o 00:04:45.963 CXX test/cpp_headers/queue.o 00:04:45.963 CXX test/cpp_headers/reduce.o 00:04:45.963 CXX test/cpp_headers/rpc.o 00:04:45.963 CXX test/cpp_headers/scheduler.o 00:04:45.963 CXX test/cpp_headers/scsi.o 00:04:45.963 CXX test/cpp_headers/scsi_spec.o 00:04:45.963 CXX test/cpp_headers/sock.o 00:04:45.963 CC test/event/app_repeat/app_repeat.o 00:04:45.963 CXX test/cpp_headers/stdinc.o 00:04:45.963 CXX test/cpp_headers/string.o 00:04:45.963 CXX test/cpp_headers/thread.o 00:04:45.963 CC examples/vmd/led/led.o 00:04:45.963 CXX test/cpp_headers/trace.o 00:04:45.963 CXX test/cpp_headers/trace_parser.o 00:04:45.963 CXX test/cpp_headers/tree.o 00:04:45.963 CXX test/cpp_headers/ublk.o 00:04:45.963 CXX test/cpp_headers/util.o 00:04:45.963 CC test/event/scheduler/scheduler.o 00:04:45.963 CXX test/cpp_headers/uuid.o 00:04:45.963 CXX test/cpp_headers/version.o 00:04:45.963 CXX test/cpp_headers/vfio_user_pci.o 00:04:45.963 CXX test/cpp_headers/vfio_user_spec.o 00:04:45.963 LINK event_perf 00:04:45.963 LINK mem_callbacks 00:04:45.963 CXX test/cpp_headers/vhost.o 00:04:45.963 LINK reactor 00:04:45.963 CXX test/cpp_headers/vmd.o 00:04:45.963 CXX test/cpp_headers/xor.o 00:04:45.963 CXX test/cpp_headers/zipf.o 00:04:45.963 LINK lsvmd 00:04:46.229 CC app/vhost/vhost.o 00:04:46.229 LINK spdk_nvme_perf 00:04:46.229 LINK reactor_perf 00:04:46.229 LINK vhost_fuzz 00:04:46.229 LINK spdk_top 00:04:46.229 LINK spdk_nvme_identify 00:04:46.229 LINK app_repeat 00:04:46.229 LINK hello_sock 00:04:46.229 LINK led 00:04:46.229 LINK thread 00:04:46.489 CC test/nvme/overhead/overhead.o 00:04:46.489 CC test/nvme/reset/reset.o 00:04:46.489 CC test/nvme/sgl/sgl.o 00:04:46.489 CC test/nvme/e2edp/nvme_dp.o 00:04:46.489 CC test/nvme/connect_stress/connect_stress.o 00:04:46.489 CC test/nvme/err_injection/err_injection.o 00:04:46.489 CC test/nvme/aer/aer.o 00:04:46.489 CC test/nvme/startup/startup.o 00:04:46.489 CC test/nvme/boot_partition/boot_partition.o 00:04:46.489 CC test/nvme/reserve/reserve.o 00:04:46.489 CC test/nvme/simple_copy/simple_copy.o 00:04:46.489 CC test/nvme/compliance/nvme_compliance.o 00:04:46.489 CC test/nvme/fused_ordering/fused_ordering.o 00:04:46.489 CC test/nvme/doorbell_aers/doorbell_aers.o 00:04:46.489 LINK scheduler 00:04:46.489 CC test/nvme/fdp/fdp.o 00:04:46.489 LINK vhost 00:04:46.489 CC test/nvme/cuse/cuse.o 00:04:46.489 LINK idxd_perf 00:04:46.489 CC test/blobfs/mkfs/mkfs.o 00:04:46.489 CC test/accel/dif/dif.o 00:04:46.489 CC test/lvol/esnap/esnap.o 00:04:46.748 LINK connect_stress 00:04:46.748 LINK boot_partition 00:04:46.748 LINK err_injection 00:04:46.748 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:04:46.748 CC examples/nvme/cmb_copy/cmb_copy.o 00:04:46.748 CC examples/nvme/reconnect/reconnect.o 00:04:46.748 CC examples/nvme/abort/abort.o 00:04:46.748 CC examples/nvme/hotplug/hotplug.o 00:04:46.748 CC examples/nvme/hello_world/hello_world.o 00:04:46.748 CC examples/nvme/nvme_manage/nvme_manage.o 00:04:46.748 CC examples/nvme/arbitration/arbitration.o 00:04:46.748 LINK fused_ordering 00:04:46.748 LINK startup 00:04:46.748 LINK simple_copy 00:04:46.748 LINK aer 00:04:46.748 LINK mkfs 00:04:46.748 LINK reset 00:04:46.748 LINK doorbell_aers 00:04:46.748 CC examples/accel/perf/accel_perf.o 00:04:46.748 LINK nvme_dp 00:04:47.007 LINK nvme_compliance 00:04:47.007 LINK reserve 00:04:47.007 LINK memory_ut 00:04:47.007 CC examples/blob/cli/blobcli.o 00:04:47.007 LINK fdp 00:04:47.007 CC examples/blob/hello_world/hello_blob.o 00:04:47.007 CC examples/fsdev/hello_world/hello_fsdev.o 00:04:47.007 LINK sgl 00:04:47.007 LINK pmr_persistence 00:04:47.007 LINK overhead 00:04:47.007 LINK cmb_copy 00:04:47.007 LINK hello_world 00:04:47.265 LINK hotplug 00:04:47.265 LINK abort 00:04:47.265 LINK hello_blob 00:04:47.265 LINK reconnect 00:04:47.265 LINK arbitration 00:04:47.266 LINK dif 00:04:47.523 LINK hello_fsdev 00:04:47.523 LINK nvme_manage 00:04:47.523 LINK blobcli 00:04:47.523 LINK accel_perf 00:04:47.780 LINK iscsi_fuzz 00:04:47.780 CC test/bdev/bdevio/bdevio.o 00:04:47.780 CC examples/bdev/hello_world/hello_bdev.o 00:04:47.780 CC examples/bdev/bdevperf/bdevperf.o 00:04:48.039 LINK cuse 00:04:48.039 LINK hello_bdev 00:04:48.298 LINK bdevio 00:04:48.865 LINK bdevperf 00:04:49.124 CC examples/nvmf/nvmf/nvmf.o 00:04:49.382 LINK nvmf 00:04:52.032 LINK esnap 00:04:52.032 00:04:52.032 real 1m9.952s 00:04:52.032 user 11m56.387s 00:04:52.032 sys 2m38.897s 00:04:52.032 13:15:47 make -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:04:52.032 13:15:47 make -- common/autotest_common.sh@10 -- $ set +x 00:04:52.032 ************************************ 00:04:52.032 END TEST make 00:04:52.032 ************************************ 00:04:52.032 13:15:47 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:04:52.032 13:15:47 -- pm/common@29 -- $ signal_monitor_resources TERM 00:04:52.032 13:15:47 -- pm/common@40 -- $ local monitor pid pids signal=TERM 00:04:52.032 13:15:47 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.032 13:15:47 -- pm/common@43 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:04:52.032 13:15:47 -- pm/common@44 -- $ pid=439669 00:04:52.032 13:15:47 -- pm/common@50 -- $ kill -TERM 439669 00:04:52.032 13:15:47 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.032 13:15:47 -- pm/common@43 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:04:52.032 13:15:47 -- pm/common@44 -- $ pid=439671 00:04:52.032 13:15:47 -- pm/common@50 -- $ kill -TERM 439671 00:04:52.032 13:15:47 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.032 13:15:47 -- pm/common@43 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:04:52.032 13:15:47 -- pm/common@44 -- $ pid=439673 00:04:52.032 13:15:47 -- pm/common@50 -- $ kill -TERM 439673 00:04:52.032 13:15:47 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.032 13:15:47 -- pm/common@43 -- $ [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:04:52.032 13:15:47 -- pm/common@44 -- $ pid=439702 00:04:52.032 13:15:47 -- pm/common@50 -- $ sudo -E kill -TERM 439702 00:04:52.032 13:15:47 -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:52.032 13:15:47 -- common/autotest_common.sh@1681 -- # lcov --version 00:04:52.032 13:15:47 -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:52.032 13:15:47 -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:52.032 13:15:47 -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:52.032 13:15:47 -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:52.032 13:15:47 -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:52.032 13:15:47 -- scripts/common.sh@336 -- # IFS=.-: 00:04:52.032 13:15:47 -- scripts/common.sh@336 -- # read -ra ver1 00:04:52.032 13:15:47 -- scripts/common.sh@337 -- # IFS=.-: 00:04:52.032 13:15:47 -- scripts/common.sh@337 -- # read -ra ver2 00:04:52.032 13:15:47 -- scripts/common.sh@338 -- # local 'op=<' 00:04:52.032 13:15:47 -- scripts/common.sh@340 -- # ver1_l=2 00:04:52.032 13:15:47 -- scripts/common.sh@341 -- # ver2_l=1 00:04:52.032 13:15:47 -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:52.032 13:15:47 -- scripts/common.sh@344 -- # case "$op" in 00:04:52.032 13:15:47 -- scripts/common.sh@345 -- # : 1 00:04:52.032 13:15:47 -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:52.032 13:15:47 -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:52.032 13:15:47 -- scripts/common.sh@365 -- # decimal 1 00:04:52.032 13:15:47 -- scripts/common.sh@353 -- # local d=1 00:04:52.032 13:15:47 -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:52.032 13:15:47 -- scripts/common.sh@355 -- # echo 1 00:04:52.032 13:15:47 -- scripts/common.sh@365 -- # ver1[v]=1 00:04:52.032 13:15:47 -- scripts/common.sh@366 -- # decimal 2 00:04:52.032 13:15:47 -- scripts/common.sh@353 -- # local d=2 00:04:52.032 13:15:47 -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:52.032 13:15:47 -- scripts/common.sh@355 -- # echo 2 00:04:52.032 13:15:47 -- scripts/common.sh@366 -- # ver2[v]=2 00:04:52.032 13:15:47 -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:52.032 13:15:47 -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:52.033 13:15:47 -- scripts/common.sh@368 -- # return 0 00:04:52.033 13:15:47 -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:52.033 13:15:47 -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:52.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.033 --rc genhtml_branch_coverage=1 00:04:52.033 --rc genhtml_function_coverage=1 00:04:52.033 --rc genhtml_legend=1 00:04:52.033 --rc geninfo_all_blocks=1 00:04:52.033 --rc geninfo_unexecuted_blocks=1 00:04:52.033 00:04:52.033 ' 00:04:52.033 13:15:47 -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:52.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.033 --rc genhtml_branch_coverage=1 00:04:52.033 --rc genhtml_function_coverage=1 00:04:52.033 --rc genhtml_legend=1 00:04:52.033 --rc geninfo_all_blocks=1 00:04:52.033 --rc geninfo_unexecuted_blocks=1 00:04:52.033 00:04:52.033 ' 00:04:52.033 13:15:47 -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:52.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.033 --rc genhtml_branch_coverage=1 00:04:52.033 --rc genhtml_function_coverage=1 00:04:52.033 --rc genhtml_legend=1 00:04:52.033 --rc geninfo_all_blocks=1 00:04:52.033 --rc geninfo_unexecuted_blocks=1 00:04:52.033 00:04:52.033 ' 00:04:52.033 13:15:47 -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:52.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.033 --rc genhtml_branch_coverage=1 00:04:52.033 --rc genhtml_function_coverage=1 00:04:52.033 --rc genhtml_legend=1 00:04:52.033 --rc geninfo_all_blocks=1 00:04:52.033 --rc geninfo_unexecuted_blocks=1 00:04:52.033 00:04:52.033 ' 00:04:52.033 13:15:47 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:52.033 13:15:47 -- nvmf/common.sh@7 -- # uname -s 00:04:52.033 13:15:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:52.033 13:15:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:52.033 13:15:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:52.033 13:15:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:52.033 13:15:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:52.033 13:15:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:52.033 13:15:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:52.033 13:15:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:52.033 13:15:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:52.033 13:15:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:52.033 13:15:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:04:52.033 13:15:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:04:52.033 13:15:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:52.033 13:15:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:52.033 13:15:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:04:52.033 13:15:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:52.033 13:15:47 -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:52.033 13:15:47 -- scripts/common.sh@15 -- # shopt -s extglob 00:04:52.033 13:15:47 -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:52.033 13:15:47 -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:52.033 13:15:47 -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:52.033 13:15:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.033 13:15:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.033 13:15:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.033 13:15:47 -- paths/export.sh@5 -- # export PATH 00:04:52.033 13:15:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.033 13:15:47 -- nvmf/common.sh@51 -- # : 0 00:04:52.033 13:15:47 -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:04:52.033 13:15:47 -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:04:52.033 13:15:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:52.033 13:15:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:52.033 13:15:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:52.033 13:15:47 -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:04:52.033 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:04:52.033 13:15:47 -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:04:52.033 13:15:47 -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:04:52.033 13:15:47 -- nvmf/common.sh@55 -- # have_pci_nics=0 00:04:52.033 13:15:47 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:04:52.033 13:15:47 -- spdk/autotest.sh@32 -- # uname -s 00:04:52.033 13:15:47 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:04:52.033 13:15:47 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:04:52.033 13:15:47 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:52.033 13:15:47 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:04:52.033 13:15:47 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:04:52.033 13:15:47 -- spdk/autotest.sh@44 -- # modprobe nbd 00:04:52.033 13:15:47 -- spdk/autotest.sh@46 -- # type -P udevadm 00:04:52.033 13:15:47 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:04:52.033 13:15:47 -- spdk/autotest.sh@48 -- # udevadm_pid=499726 00:04:52.033 13:15:47 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:04:52.033 13:15:47 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:04:52.033 13:15:47 -- pm/common@17 -- # local monitor 00:04:52.033 13:15:47 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.033 13:15:47 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.033 13:15:47 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.033 13:15:47 -- pm/common@21 -- # date +%s 00:04:52.033 13:15:47 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:04:52.033 13:15:47 -- pm/common@21 -- # date +%s 00:04:52.033 13:15:47 -- pm/common@25 -- # sleep 1 00:04:52.033 13:15:47 -- pm/common@21 -- # date +%s 00:04:52.033 13:15:47 -- pm/common@21 -- # date +%s 00:04:52.033 13:15:47 -- pm/common@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1728299747 00:04:52.033 13:15:47 -- pm/common@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1728299747 00:04:52.033 13:15:47 -- pm/common@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1728299747 00:04:52.033 13:15:47 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1728299747 00:04:52.293 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1728299747_collect-vmstat.pm.log 00:04:52.293 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1728299747_collect-cpu-load.pm.log 00:04:52.293 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1728299747_collect-cpu-temp.pm.log 00:04:52.293 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/monitor.autotest.sh.1728299747_collect-bmc-pm.bmc.pm.log 00:04:53.237 13:15:48 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:04:53.237 13:15:48 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:04:53.237 13:15:48 -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:53.237 13:15:48 -- common/autotest_common.sh@10 -- # set +x 00:04:53.238 13:15:48 -- spdk/autotest.sh@59 -- # create_test_list 00:04:53.238 13:15:48 -- common/autotest_common.sh@748 -- # xtrace_disable 00:04:53.238 13:15:48 -- common/autotest_common.sh@10 -- # set +x 00:04:53.238 13:15:48 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:04:53.238 13:15:48 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:53.238 13:15:48 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:53.238 13:15:48 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:04:53.238 13:15:48 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:53.238 13:15:48 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:04:53.238 13:15:48 -- common/autotest_common.sh@1455 -- # uname 00:04:53.238 13:15:48 -- common/autotest_common.sh@1455 -- # '[' Linux = FreeBSD ']' 00:04:53.238 13:15:48 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:04:53.238 13:15:48 -- common/autotest_common.sh@1475 -- # uname 00:04:53.238 13:15:48 -- common/autotest_common.sh@1475 -- # [[ Linux = FreeBSD ]] 00:04:53.238 13:15:48 -- spdk/autotest.sh@68 -- # [[ y == y ]] 00:04:53.238 13:15:48 -- spdk/autotest.sh@70 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:04:53.238 lcov: LCOV version 1.15 00:04:53.238 13:15:49 -- spdk/autotest.sh@72 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:05:11.373 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:05:11.373 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:05:33.294 13:16:26 -- spdk/autotest.sh@76 -- # timing_enter pre_cleanup 00:05:33.294 13:16:26 -- common/autotest_common.sh@724 -- # xtrace_disable 00:05:33.294 13:16:26 -- common/autotest_common.sh@10 -- # set +x 00:05:33.294 13:16:26 -- spdk/autotest.sh@78 -- # rm -f 00:05:33.294 13:16:26 -- spdk/autotest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:33.294 0000:82:00.0 (8086 0a54): Already using the nvme driver 00:05:33.294 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:05:33.294 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:05:33.294 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:05:33.294 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:05:33.294 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:05:33.294 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:05:33.294 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:05:33.294 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:05:33.294 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:05:33.294 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:05:33.294 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:05:33.294 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:05:33.294 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:05:33.294 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:05:33.294 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:05:33.294 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:05:33.294 13:16:27 -- spdk/autotest.sh@83 -- # get_zoned_devs 00:05:33.294 13:16:27 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:05:33.294 13:16:27 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:05:33.294 13:16:27 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:05:33.294 13:16:27 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:05:33.294 13:16:27 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:05:33.294 13:16:27 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:05:33.294 13:16:27 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:33.294 13:16:27 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:05:33.294 13:16:27 -- spdk/autotest.sh@85 -- # (( 0 > 0 )) 00:05:33.294 13:16:27 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:05:33.294 13:16:27 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:05:33.294 13:16:27 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme0n1 00:05:33.294 13:16:27 -- scripts/common.sh@381 -- # local block=/dev/nvme0n1 pt 00:05:33.294 13:16:27 -- scripts/common.sh@390 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:05:33.294 No valid GPT data, bailing 00:05:33.294 13:16:27 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:33.294 13:16:27 -- scripts/common.sh@394 -- # pt= 00:05:33.294 13:16:27 -- scripts/common.sh@395 -- # return 1 00:05:33.294 13:16:27 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:05:33.294 1+0 records in 00:05:33.294 1+0 records out 00:05:33.294 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00227051 s, 462 MB/s 00:05:33.294 13:16:27 -- spdk/autotest.sh@105 -- # sync 00:05:33.294 13:16:27 -- spdk/autotest.sh@107 -- # xtrace_disable_per_cmd reap_spdk_processes 00:05:33.294 13:16:27 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:05:33.294 13:16:27 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:05:34.231 13:16:30 -- spdk/autotest.sh@111 -- # uname -s 00:05:34.231 13:16:30 -- spdk/autotest.sh@111 -- # [[ Linux == Linux ]] 00:05:34.231 13:16:30 -- spdk/autotest.sh@111 -- # [[ 0 -eq 1 ]] 00:05:34.231 13:16:30 -- spdk/autotest.sh@115 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:35.612 Hugepages 00:05:35.612 node hugesize free / total 00:05:35.612 node0 1048576kB 0 / 0 00:05:35.612 node0 2048kB 0 / 0 00:05:35.612 node1 1048576kB 0 / 0 00:05:35.612 node1 2048kB 0 / 0 00:05:35.612 00:05:35.612 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:35.612 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:35.612 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:35.612 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:35.612 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:35.612 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:35.612 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:35.612 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:35.612 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:35.612 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:35.612 NVMe 0000:82:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:35.612 13:16:31 -- spdk/autotest.sh@117 -- # uname -s 00:05:35.612 13:16:31 -- spdk/autotest.sh@117 -- # [[ Linux == Linux ]] 00:05:35.612 13:16:31 -- spdk/autotest.sh@119 -- # nvme_namespace_revert 00:05:35.612 13:16:31 -- common/autotest_common.sh@1514 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:36.990 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:36.990 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:36.990 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:36.990 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:36.990 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:36.990 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:36.990 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:36.990 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:36.990 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:37.930 0000:82:00.0 (8086 0a54): nvme -> vfio-pci 00:05:37.930 13:16:33 -- common/autotest_common.sh@1515 -- # sleep 1 00:05:39.310 13:16:34 -- common/autotest_common.sh@1516 -- # bdfs=() 00:05:39.310 13:16:34 -- common/autotest_common.sh@1516 -- # local bdfs 00:05:39.310 13:16:34 -- common/autotest_common.sh@1518 -- # bdfs=($(get_nvme_bdfs)) 00:05:39.310 13:16:34 -- common/autotest_common.sh@1518 -- # get_nvme_bdfs 00:05:39.310 13:16:34 -- common/autotest_common.sh@1496 -- # bdfs=() 00:05:39.310 13:16:34 -- common/autotest_common.sh@1496 -- # local bdfs 00:05:39.310 13:16:34 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:39.310 13:16:34 -- common/autotest_common.sh@1497 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:39.310 13:16:34 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:05:39.310 13:16:34 -- common/autotest_common.sh@1498 -- # (( 1 == 0 )) 00:05:39.310 13:16:34 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:82:00.0 00:05:39.310 13:16:34 -- common/autotest_common.sh@1520 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:40.244 Waiting for block devices as requested 00:05:40.244 0000:82:00.0 (8086 0a54): vfio-pci -> nvme 00:05:40.503 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:40.503 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:40.762 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:40.762 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:40.762 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:40.763 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:40.763 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:41.022 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:41.022 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:41.022 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:41.282 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:41.282 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:41.282 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:41.282 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:41.541 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:41.541 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:41.541 13:16:37 -- common/autotest_common.sh@1522 -- # for bdf in "${bdfs[@]}" 00:05:41.541 13:16:37 -- common/autotest_common.sh@1523 -- # get_nvme_ctrlr_from_bdf 0000:82:00.0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1485 -- # readlink -f /sys/class/nvme/nvme0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1485 -- # grep 0000:82:00.0/nvme/nvme 00:05:41.541 13:16:37 -- common/autotest_common.sh@1485 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:02.0/0000:82:00.0/nvme/nvme0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1486 -- # [[ -z /sys/devices/pci0000:80/0000:80:02.0/0000:82:00.0/nvme/nvme0 ]] 00:05:41.541 13:16:37 -- common/autotest_common.sh@1490 -- # basename /sys/devices/pci0000:80/0000:80:02.0/0000:82:00.0/nvme/nvme0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1490 -- # printf '%s\n' nvme0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1523 -- # nvme_ctrlr=/dev/nvme0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1524 -- # [[ -z /dev/nvme0 ]] 00:05:41.541 13:16:37 -- common/autotest_common.sh@1529 -- # nvme id-ctrl /dev/nvme0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1529 -- # grep oacs 00:05:41.541 13:16:37 -- common/autotest_common.sh@1529 -- # cut -d: -f2 00:05:41.541 13:16:37 -- common/autotest_common.sh@1529 -- # oacs=' 0xf' 00:05:41.541 13:16:37 -- common/autotest_common.sh@1530 -- # oacs_ns_manage=8 00:05:41.541 13:16:37 -- common/autotest_common.sh@1532 -- # [[ 8 -ne 0 ]] 00:05:41.541 13:16:37 -- common/autotest_common.sh@1538 -- # nvme id-ctrl /dev/nvme0 00:05:41.541 13:16:37 -- common/autotest_common.sh@1538 -- # grep unvmcap 00:05:41.541 13:16:37 -- common/autotest_common.sh@1538 -- # cut -d: -f2 00:05:41.801 13:16:37 -- common/autotest_common.sh@1538 -- # unvmcap=' 0' 00:05:41.801 13:16:37 -- common/autotest_common.sh@1539 -- # [[ 0 -eq 0 ]] 00:05:41.801 13:16:37 -- common/autotest_common.sh@1541 -- # continue 00:05:41.801 13:16:37 -- spdk/autotest.sh@122 -- # timing_exit pre_cleanup 00:05:41.801 13:16:37 -- common/autotest_common.sh@730 -- # xtrace_disable 00:05:41.801 13:16:37 -- common/autotest_common.sh@10 -- # set +x 00:05:41.801 13:16:37 -- spdk/autotest.sh@125 -- # timing_enter afterboot 00:05:41.801 13:16:37 -- common/autotest_common.sh@724 -- # xtrace_disable 00:05:41.801 13:16:37 -- common/autotest_common.sh@10 -- # set +x 00:05:41.801 13:16:37 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:43.177 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:43.177 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:43.177 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:43.177 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:43.177 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:43.177 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:43.177 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:43.177 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:43.177 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:44.117 0000:82:00.0 (8086 0a54): nvme -> vfio-pci 00:05:44.117 13:16:39 -- spdk/autotest.sh@127 -- # timing_exit afterboot 00:05:44.117 13:16:39 -- common/autotest_common.sh@730 -- # xtrace_disable 00:05:44.117 13:16:39 -- common/autotest_common.sh@10 -- # set +x 00:05:44.117 13:16:39 -- spdk/autotest.sh@131 -- # opal_revert_cleanup 00:05:44.117 13:16:39 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:05:44.117 13:16:39 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:05:44.117 13:16:39 -- common/autotest_common.sh@1561 -- # bdfs=() 00:05:44.117 13:16:39 -- common/autotest_common.sh@1561 -- # _bdfs=() 00:05:44.117 13:16:39 -- common/autotest_common.sh@1561 -- # local bdfs _bdfs 00:05:44.117 13:16:39 -- common/autotest_common.sh@1562 -- # _bdfs=($(get_nvme_bdfs)) 00:05:44.117 13:16:39 -- common/autotest_common.sh@1562 -- # get_nvme_bdfs 00:05:44.117 13:16:39 -- common/autotest_common.sh@1496 -- # bdfs=() 00:05:44.117 13:16:39 -- common/autotest_common.sh@1496 -- # local bdfs 00:05:44.117 13:16:39 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:44.117 13:16:39 -- common/autotest_common.sh@1497 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:44.117 13:16:39 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:05:44.117 13:16:39 -- common/autotest_common.sh@1498 -- # (( 1 == 0 )) 00:05:44.117 13:16:39 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:82:00.0 00:05:44.117 13:16:39 -- common/autotest_common.sh@1563 -- # for bdf in "${_bdfs[@]}" 00:05:44.117 13:16:39 -- common/autotest_common.sh@1564 -- # cat /sys/bus/pci/devices/0000:82:00.0/device 00:05:44.117 13:16:39 -- common/autotest_common.sh@1564 -- # device=0x0a54 00:05:44.117 13:16:39 -- common/autotest_common.sh@1565 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:44.117 13:16:39 -- common/autotest_common.sh@1566 -- # bdfs+=($bdf) 00:05:44.117 13:16:39 -- common/autotest_common.sh@1570 -- # (( 1 > 0 )) 00:05:44.117 13:16:39 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:82:00.0 00:05:44.117 13:16:39 -- common/autotest_common.sh@1577 -- # [[ -z 0000:82:00.0 ]] 00:05:44.117 13:16:39 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=510252 00:05:44.117 13:16:39 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:44.117 13:16:39 -- common/autotest_common.sh@1583 -- # waitforlisten 510252 00:05:44.117 13:16:39 -- common/autotest_common.sh@831 -- # '[' -z 510252 ']' 00:05:44.117 13:16:39 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:44.117 13:16:39 -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:44.117 13:16:39 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:44.117 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:44.117 13:16:39 -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:44.117 13:16:39 -- common/autotest_common.sh@10 -- # set +x 00:05:44.117 [2024-10-07 13:16:40.034819] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:05:44.117 [2024-10-07 13:16:40.034904] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid510252 ] 00:05:44.376 [2024-10-07 13:16:40.093834] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.376 [2024-10-07 13:16:40.198455] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.634 13:16:40 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:44.634 13:16:40 -- common/autotest_common.sh@864 -- # return 0 00:05:44.634 13:16:40 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:05:44.634 13:16:40 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:05:44.634 13:16:40 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:82:00.0 00:05:47.918 nvme0n1 00:05:47.918 13:16:43 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:47.918 [2024-10-07 13:16:43.824587] nvme_opal.c:2063:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:47.918 [2024-10-07 13:16:43.824636] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:47.918 request: 00:05:47.918 { 00:05:47.918 "nvme_ctrlr_name": "nvme0", 00:05:47.918 "password": "test", 00:05:47.918 "method": "bdev_nvme_opal_revert", 00:05:47.918 "req_id": 1 00:05:47.918 } 00:05:47.918 Got JSON-RPC error response 00:05:47.918 response: 00:05:47.918 { 00:05:47.918 "code": -32603, 00:05:47.918 "message": "Internal error" 00:05:47.918 } 00:05:47.918 13:16:43 -- common/autotest_common.sh@1589 -- # true 00:05:47.918 13:16:43 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:05:47.918 13:16:43 -- common/autotest_common.sh@1593 -- # killprocess 510252 00:05:47.918 13:16:43 -- common/autotest_common.sh@950 -- # '[' -z 510252 ']' 00:05:47.918 13:16:43 -- common/autotest_common.sh@954 -- # kill -0 510252 00:05:47.918 13:16:43 -- common/autotest_common.sh@955 -- # uname 00:05:47.918 13:16:43 -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:47.918 13:16:43 -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 510252 00:05:48.177 13:16:43 -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:48.177 13:16:43 -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:48.177 13:16:43 -- common/autotest_common.sh@968 -- # echo 'killing process with pid 510252' 00:05:48.177 killing process with pid 510252 00:05:48.177 13:16:43 -- common/autotest_common.sh@969 -- # kill 510252 00:05:48.177 13:16:43 -- common/autotest_common.sh@974 -- # wait 510252 00:05:50.076 13:16:45 -- spdk/autotest.sh@137 -- # '[' 0 -eq 1 ']' 00:05:50.076 13:16:45 -- spdk/autotest.sh@141 -- # '[' 1 -eq 1 ']' 00:05:50.076 13:16:45 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:05:50.076 13:16:45 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:05:50.076 13:16:45 -- spdk/autotest.sh@149 -- # timing_enter lib 00:05:50.076 13:16:45 -- common/autotest_common.sh@724 -- # xtrace_disable 00:05:50.076 13:16:45 -- common/autotest_common.sh@10 -- # set +x 00:05:50.076 13:16:45 -- spdk/autotest.sh@151 -- # [[ 0 -eq 1 ]] 00:05:50.076 13:16:45 -- spdk/autotest.sh@155 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:50.076 13:16:45 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:50.076 13:16:45 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:50.076 13:16:45 -- common/autotest_common.sh@10 -- # set +x 00:05:50.076 ************************************ 00:05:50.076 START TEST env 00:05:50.076 ************************************ 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:50.076 * Looking for test storage... 00:05:50.076 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1681 -- # lcov --version 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:50.076 13:16:45 env -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:50.076 13:16:45 env -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:50.076 13:16:45 env -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:50.076 13:16:45 env -- scripts/common.sh@336 -- # IFS=.-: 00:05:50.076 13:16:45 env -- scripts/common.sh@336 -- # read -ra ver1 00:05:50.076 13:16:45 env -- scripts/common.sh@337 -- # IFS=.-: 00:05:50.076 13:16:45 env -- scripts/common.sh@337 -- # read -ra ver2 00:05:50.076 13:16:45 env -- scripts/common.sh@338 -- # local 'op=<' 00:05:50.076 13:16:45 env -- scripts/common.sh@340 -- # ver1_l=2 00:05:50.076 13:16:45 env -- scripts/common.sh@341 -- # ver2_l=1 00:05:50.076 13:16:45 env -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:50.076 13:16:45 env -- scripts/common.sh@344 -- # case "$op" in 00:05:50.076 13:16:45 env -- scripts/common.sh@345 -- # : 1 00:05:50.076 13:16:45 env -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:50.076 13:16:45 env -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:50.076 13:16:45 env -- scripts/common.sh@365 -- # decimal 1 00:05:50.076 13:16:45 env -- scripts/common.sh@353 -- # local d=1 00:05:50.076 13:16:45 env -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:50.076 13:16:45 env -- scripts/common.sh@355 -- # echo 1 00:05:50.076 13:16:45 env -- scripts/common.sh@365 -- # ver1[v]=1 00:05:50.076 13:16:45 env -- scripts/common.sh@366 -- # decimal 2 00:05:50.076 13:16:45 env -- scripts/common.sh@353 -- # local d=2 00:05:50.076 13:16:45 env -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:50.076 13:16:45 env -- scripts/common.sh@355 -- # echo 2 00:05:50.076 13:16:45 env -- scripts/common.sh@366 -- # ver2[v]=2 00:05:50.076 13:16:45 env -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:50.076 13:16:45 env -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:50.076 13:16:45 env -- scripts/common.sh@368 -- # return 0 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:50.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.076 --rc genhtml_branch_coverage=1 00:05:50.076 --rc genhtml_function_coverage=1 00:05:50.076 --rc genhtml_legend=1 00:05:50.076 --rc geninfo_all_blocks=1 00:05:50.076 --rc geninfo_unexecuted_blocks=1 00:05:50.076 00:05:50.076 ' 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:50.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.076 --rc genhtml_branch_coverage=1 00:05:50.076 --rc genhtml_function_coverage=1 00:05:50.076 --rc genhtml_legend=1 00:05:50.076 --rc geninfo_all_blocks=1 00:05:50.076 --rc geninfo_unexecuted_blocks=1 00:05:50.076 00:05:50.076 ' 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:50.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.076 --rc genhtml_branch_coverage=1 00:05:50.076 --rc genhtml_function_coverage=1 00:05:50.076 --rc genhtml_legend=1 00:05:50.076 --rc geninfo_all_blocks=1 00:05:50.076 --rc geninfo_unexecuted_blocks=1 00:05:50.076 00:05:50.076 ' 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:50.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.076 --rc genhtml_branch_coverage=1 00:05:50.076 --rc genhtml_function_coverage=1 00:05:50.076 --rc genhtml_legend=1 00:05:50.076 --rc geninfo_all_blocks=1 00:05:50.076 --rc geninfo_unexecuted_blocks=1 00:05:50.076 00:05:50.076 ' 00:05:50.076 13:16:45 env -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:50.076 13:16:45 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:50.076 13:16:45 env -- common/autotest_common.sh@10 -- # set +x 00:05:50.076 ************************************ 00:05:50.076 START TEST env_memory 00:05:50.076 ************************************ 00:05:50.076 13:16:45 env.env_memory -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:50.076 00:05:50.076 00:05:50.076 CUnit - A unit testing framework for C - Version 2.1-3 00:05:50.076 http://cunit.sourceforge.net/ 00:05:50.076 00:05:50.076 00:05:50.076 Suite: memory 00:05:50.076 Test: alloc and free memory map ...[2024-10-07 13:16:45.965074] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:50.076 passed 00:05:50.076 Test: mem map translation ...[2024-10-07 13:16:45.985454] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:50.076 [2024-10-07 13:16:45.985475] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:50.076 [2024-10-07 13:16:45.985537] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 589:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:50.076 [2024-10-07 13:16:45.985550] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 605:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:50.335 passed 00:05:50.335 Test: mem map registration ...[2024-10-07 13:16:46.027928] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=200000 len=1234 00:05:50.336 [2024-10-07 13:16:46.027947] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=4d2 len=2097152 00:05:50.336 passed 00:05:50.336 Test: mem map adjacent registrations ...passed 00:05:50.336 00:05:50.336 Run Summary: Type Total Ran Passed Failed Inactive 00:05:50.336 suites 1 1 n/a 0 0 00:05:50.336 tests 4 4 4 0 0 00:05:50.336 asserts 152 152 152 0 n/a 00:05:50.336 00:05:50.336 Elapsed time = 0.143 seconds 00:05:50.336 00:05:50.336 real 0m0.151s 00:05:50.336 user 0m0.141s 00:05:50.336 sys 0m0.010s 00:05:50.336 13:16:46 env.env_memory -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:50.336 13:16:46 env.env_memory -- common/autotest_common.sh@10 -- # set +x 00:05:50.336 ************************************ 00:05:50.336 END TEST env_memory 00:05:50.336 ************************************ 00:05:50.336 13:16:46 env -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:50.336 13:16:46 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:50.336 13:16:46 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:50.336 13:16:46 env -- common/autotest_common.sh@10 -- # set +x 00:05:50.336 ************************************ 00:05:50.336 START TEST env_vtophys 00:05:50.336 ************************************ 00:05:50.336 13:16:46 env.env_vtophys -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:50.336 EAL: lib.eal log level changed from notice to debug 00:05:50.336 EAL: Detected lcore 0 as core 0 on socket 0 00:05:50.336 EAL: Detected lcore 1 as core 1 on socket 0 00:05:50.336 EAL: Detected lcore 2 as core 2 on socket 0 00:05:50.336 EAL: Detected lcore 3 as core 3 on socket 0 00:05:50.336 EAL: Detected lcore 4 as core 4 on socket 0 00:05:50.336 EAL: Detected lcore 5 as core 5 on socket 0 00:05:50.336 EAL: Detected lcore 6 as core 8 on socket 0 00:05:50.336 EAL: Detected lcore 7 as core 9 on socket 0 00:05:50.336 EAL: Detected lcore 8 as core 10 on socket 0 00:05:50.336 EAL: Detected lcore 9 as core 11 on socket 0 00:05:50.336 EAL: Detected lcore 10 as core 12 on socket 0 00:05:50.336 EAL: Detected lcore 11 as core 13 on socket 0 00:05:50.336 EAL: Detected lcore 12 as core 0 on socket 1 00:05:50.336 EAL: Detected lcore 13 as core 1 on socket 1 00:05:50.336 EAL: Detected lcore 14 as core 2 on socket 1 00:05:50.336 EAL: Detected lcore 15 as core 3 on socket 1 00:05:50.336 EAL: Detected lcore 16 as core 4 on socket 1 00:05:50.336 EAL: Detected lcore 17 as core 5 on socket 1 00:05:50.336 EAL: Detected lcore 18 as core 8 on socket 1 00:05:50.336 EAL: Detected lcore 19 as core 9 on socket 1 00:05:50.336 EAL: Detected lcore 20 as core 10 on socket 1 00:05:50.336 EAL: Detected lcore 21 as core 11 on socket 1 00:05:50.336 EAL: Detected lcore 22 as core 12 on socket 1 00:05:50.336 EAL: Detected lcore 23 as core 13 on socket 1 00:05:50.336 EAL: Detected lcore 24 as core 0 on socket 0 00:05:50.336 EAL: Detected lcore 25 as core 1 on socket 0 00:05:50.336 EAL: Detected lcore 26 as core 2 on socket 0 00:05:50.336 EAL: Detected lcore 27 as core 3 on socket 0 00:05:50.336 EAL: Detected lcore 28 as core 4 on socket 0 00:05:50.336 EAL: Detected lcore 29 as core 5 on socket 0 00:05:50.336 EAL: Detected lcore 30 as core 8 on socket 0 00:05:50.336 EAL: Detected lcore 31 as core 9 on socket 0 00:05:50.336 EAL: Detected lcore 32 as core 10 on socket 0 00:05:50.336 EAL: Detected lcore 33 as core 11 on socket 0 00:05:50.336 EAL: Detected lcore 34 as core 12 on socket 0 00:05:50.336 EAL: Detected lcore 35 as core 13 on socket 0 00:05:50.336 EAL: Detected lcore 36 as core 0 on socket 1 00:05:50.336 EAL: Detected lcore 37 as core 1 on socket 1 00:05:50.336 EAL: Detected lcore 38 as core 2 on socket 1 00:05:50.336 EAL: Detected lcore 39 as core 3 on socket 1 00:05:50.336 EAL: Detected lcore 40 as core 4 on socket 1 00:05:50.336 EAL: Detected lcore 41 as core 5 on socket 1 00:05:50.336 EAL: Detected lcore 42 as core 8 on socket 1 00:05:50.336 EAL: Detected lcore 43 as core 9 on socket 1 00:05:50.336 EAL: Detected lcore 44 as core 10 on socket 1 00:05:50.336 EAL: Detected lcore 45 as core 11 on socket 1 00:05:50.336 EAL: Detected lcore 46 as core 12 on socket 1 00:05:50.336 EAL: Detected lcore 47 as core 13 on socket 1 00:05:50.336 EAL: Maximum logical cores by configuration: 128 00:05:50.336 EAL: Detected CPU lcores: 48 00:05:50.336 EAL: Detected NUMA nodes: 2 00:05:50.336 EAL: Checking presence of .so 'librte_eal.so.24.1' 00:05:50.336 EAL: Detected shared linkage of DPDK 00:05:50.336 EAL: No shared files mode enabled, IPC will be disabled 00:05:50.336 EAL: Bus pci wants IOVA as 'DC' 00:05:50.336 EAL: Buses did not request a specific IOVA mode. 00:05:50.336 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:50.336 EAL: Selected IOVA mode 'VA' 00:05:50.336 EAL: Probing VFIO support... 00:05:50.336 EAL: IOMMU type 1 (Type 1) is supported 00:05:50.336 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:50.336 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:50.336 EAL: VFIO support initialized 00:05:50.336 EAL: Ask a virtual area of 0x2e000 bytes 00:05:50.336 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:50.336 EAL: Setting up physically contiguous memory... 00:05:50.336 EAL: Setting maximum number of open files to 524288 00:05:50.336 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:50.336 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:50.336 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:50.336 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.336 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:50.336 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.336 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.336 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:50.336 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:50.336 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.336 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:50.336 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.336 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.336 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:50.336 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:50.336 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.336 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:50.336 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.336 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.336 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:50.336 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:50.336 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.337 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:50.337 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:50.337 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.337 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:50.337 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:50.337 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:50.337 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.337 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:50.337 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.337 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.337 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:50.337 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:50.337 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.337 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:50.337 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.337 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.337 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:50.337 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:50.337 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.337 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:50.337 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.337 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.337 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:50.337 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:50.337 EAL: Ask a virtual area of 0x61000 bytes 00:05:50.337 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:50.337 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:50.337 EAL: Ask a virtual area of 0x400000000 bytes 00:05:50.337 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:50.337 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:50.337 EAL: Hugepages will be freed exactly as allocated. 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: TSC frequency is ~2700000 KHz 00:05:50.337 EAL: Main lcore 0 is ready (tid=7f812e72fa00;cpuset=[0]) 00:05:50.337 EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.337 EAL: Restoring previous memory policy: 0 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was expanded by 2MB 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:50.337 EAL: Mem event callback 'spdk:(nil)' registered 00:05:50.337 00:05:50.337 00:05:50.337 CUnit - A unit testing framework for C - Version 2.1-3 00:05:50.337 http://cunit.sourceforge.net/ 00:05:50.337 00:05:50.337 00:05:50.337 Suite: components_suite 00:05:50.337 Test: vtophys_malloc_test ...passed 00:05:50.337 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.337 EAL: Restoring previous memory policy: 4 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was expanded by 4MB 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was shrunk by 4MB 00:05:50.337 EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.337 EAL: Restoring previous memory policy: 4 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was expanded by 6MB 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was shrunk by 6MB 00:05:50.337 EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.337 EAL: Restoring previous memory policy: 4 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was expanded by 10MB 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was shrunk by 10MB 00:05:50.337 EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.337 EAL: Restoring previous memory policy: 4 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was expanded by 18MB 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was shrunk by 18MB 00:05:50.337 EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.337 EAL: Restoring previous memory policy: 4 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was expanded by 34MB 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was shrunk by 34MB 00:05:50.337 EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.337 EAL: Restoring previous memory policy: 4 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was expanded by 66MB 00:05:50.337 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.337 EAL: request: mp_malloc_sync 00:05:50.337 EAL: No shared files mode enabled, IPC is disabled 00:05:50.337 EAL: Heap on socket 0 was shrunk by 66MB 00:05:50.337 EAL: Trying to obtain current memory policy. 00:05:50.337 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.596 EAL: Restoring previous memory policy: 4 00:05:50.596 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.596 EAL: request: mp_malloc_sync 00:05:50.596 EAL: No shared files mode enabled, IPC is disabled 00:05:50.596 EAL: Heap on socket 0 was expanded by 130MB 00:05:50.596 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.596 EAL: request: mp_malloc_sync 00:05:50.596 EAL: No shared files mode enabled, IPC is disabled 00:05:50.596 EAL: Heap on socket 0 was shrunk by 130MB 00:05:50.596 EAL: Trying to obtain current memory policy. 00:05:50.596 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.596 EAL: Restoring previous memory policy: 4 00:05:50.596 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.596 EAL: request: mp_malloc_sync 00:05:50.596 EAL: No shared files mode enabled, IPC is disabled 00:05:50.596 EAL: Heap on socket 0 was expanded by 258MB 00:05:50.596 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.596 EAL: request: mp_malloc_sync 00:05:50.596 EAL: No shared files mode enabled, IPC is disabled 00:05:50.596 EAL: Heap on socket 0 was shrunk by 258MB 00:05:50.596 EAL: Trying to obtain current memory policy. 00:05:50.596 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:50.853 EAL: Restoring previous memory policy: 4 00:05:50.853 EAL: Calling mem event callback 'spdk:(nil)' 00:05:50.853 EAL: request: mp_malloc_sync 00:05:50.853 EAL: No shared files mode enabled, IPC is disabled 00:05:50.853 EAL: Heap on socket 0 was expanded by 514MB 00:05:50.853 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.111 EAL: request: mp_malloc_sync 00:05:51.111 EAL: No shared files mode enabled, IPC is disabled 00:05:51.111 EAL: Heap on socket 0 was shrunk by 514MB 00:05:51.111 EAL: Trying to obtain current memory policy. 00:05:51.111 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:51.369 EAL: Restoring previous memory policy: 4 00:05:51.369 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.369 EAL: request: mp_malloc_sync 00:05:51.369 EAL: No shared files mode enabled, IPC is disabled 00:05:51.369 EAL: Heap on socket 0 was expanded by 1026MB 00:05:51.627 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.627 EAL: request: mp_malloc_sync 00:05:51.627 EAL: No shared files mode enabled, IPC is disabled 00:05:51.627 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:51.627 passed 00:05:51.627 00:05:51.627 Run Summary: Type Total Ran Passed Failed Inactive 00:05:51.627 suites 1 1 n/a 0 0 00:05:51.627 tests 2 2 2 0 0 00:05:51.627 asserts 497 497 497 0 n/a 00:05:51.627 00:05:51.627 Elapsed time = 1.307 seconds 00:05:51.627 EAL: Calling mem event callback 'spdk:(nil)' 00:05:51.628 EAL: request: mp_malloc_sync 00:05:51.628 EAL: No shared files mode enabled, IPC is disabled 00:05:51.628 EAL: Heap on socket 0 was shrunk by 2MB 00:05:51.628 EAL: No shared files mode enabled, IPC is disabled 00:05:51.628 EAL: No shared files mode enabled, IPC is disabled 00:05:51.628 EAL: No shared files mode enabled, IPC is disabled 00:05:51.628 00:05:51.628 real 0m1.412s 00:05:51.628 user 0m0.821s 00:05:51.628 sys 0m0.559s 00:05:51.628 13:16:47 env.env_vtophys -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:51.628 13:16:47 env.env_vtophys -- common/autotest_common.sh@10 -- # set +x 00:05:51.628 ************************************ 00:05:51.628 END TEST env_vtophys 00:05:51.628 ************************************ 00:05:51.887 13:16:47 env -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:51.887 13:16:47 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:51.887 13:16:47 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:51.887 13:16:47 env -- common/autotest_common.sh@10 -- # set +x 00:05:51.887 ************************************ 00:05:51.887 START TEST env_pci 00:05:51.887 ************************************ 00:05:51.887 13:16:47 env.env_pci -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:51.887 00:05:51.887 00:05:51.887 CUnit - A unit testing framework for C - Version 2.1-3 00:05:51.887 http://cunit.sourceforge.net/ 00:05:51.887 00:05:51.887 00:05:51.887 Suite: pci 00:05:51.887 Test: pci_hook ...[2024-10-07 13:16:47.602548] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1049:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 511152 has claimed it 00:05:51.887 EAL: Cannot find device (10000:00:01.0) 00:05:51.887 EAL: Failed to attach device on primary process 00:05:51.887 passed 00:05:51.887 00:05:51.887 Run Summary: Type Total Ran Passed Failed Inactive 00:05:51.887 suites 1 1 n/a 0 0 00:05:51.887 tests 1 1 1 0 0 00:05:51.887 asserts 25 25 25 0 n/a 00:05:51.887 00:05:51.887 Elapsed time = 0.022 seconds 00:05:51.887 00:05:51.887 real 0m0.035s 00:05:51.887 user 0m0.010s 00:05:51.887 sys 0m0.025s 00:05:51.887 13:16:47 env.env_pci -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:51.887 13:16:47 env.env_pci -- common/autotest_common.sh@10 -- # set +x 00:05:51.887 ************************************ 00:05:51.887 END TEST env_pci 00:05:51.887 ************************************ 00:05:51.887 13:16:47 env -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:51.887 13:16:47 env -- env/env.sh@15 -- # uname 00:05:51.887 13:16:47 env -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:51.887 13:16:47 env -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:51.887 13:16:47 env -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:51.887 13:16:47 env -- common/autotest_common.sh@1101 -- # '[' 5 -le 1 ']' 00:05:51.888 13:16:47 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:51.888 13:16:47 env -- common/autotest_common.sh@10 -- # set +x 00:05:51.888 ************************************ 00:05:51.888 START TEST env_dpdk_post_init 00:05:51.888 ************************************ 00:05:51.888 13:16:47 env.env_dpdk_post_init -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:51.888 EAL: Detected CPU lcores: 48 00:05:51.888 EAL: Detected NUMA nodes: 2 00:05:51.888 EAL: Detected shared linkage of DPDK 00:05:51.888 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:51.888 EAL: Selected IOVA mode 'VA' 00:05:51.888 EAL: VFIO support initialized 00:05:51.888 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:51.888 EAL: Using IOMMU type 1 (Type 1) 00:05:51.888 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:51.888 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:51.888 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:52.147 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:53.085 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:82:00.0 (socket 1) 00:05:56.365 EAL: Releasing PCI mapped resource for 0000:82:00.0 00:05:56.365 EAL: Calling pci_unmap_resource for 0000:82:00.0 at 0x202001040000 00:05:56.365 Starting DPDK initialization... 00:05:56.365 Starting SPDK post initialization... 00:05:56.365 SPDK NVMe probe 00:05:56.365 Attaching to 0000:82:00.0 00:05:56.365 Attached to 0000:82:00.0 00:05:56.365 Cleaning up... 00:05:56.365 00:05:56.365 real 0m4.407s 00:05:56.365 user 0m3.035s 00:05:56.365 sys 0m0.428s 00:05:56.365 13:16:52 env.env_dpdk_post_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:56.365 13:16:52 env.env_dpdk_post_init -- common/autotest_common.sh@10 -- # set +x 00:05:56.365 ************************************ 00:05:56.365 END TEST env_dpdk_post_init 00:05:56.365 ************************************ 00:05:56.365 13:16:52 env -- env/env.sh@26 -- # uname 00:05:56.365 13:16:52 env -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:56.365 13:16:52 env -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:56.365 13:16:52 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:56.365 13:16:52 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:56.365 13:16:52 env -- common/autotest_common.sh@10 -- # set +x 00:05:56.365 ************************************ 00:05:56.365 START TEST env_mem_callbacks 00:05:56.365 ************************************ 00:05:56.365 13:16:52 env.env_mem_callbacks -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:56.365 EAL: Detected CPU lcores: 48 00:05:56.365 EAL: Detected NUMA nodes: 2 00:05:56.365 EAL: Detected shared linkage of DPDK 00:05:56.365 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:56.365 EAL: Selected IOVA mode 'VA' 00:05:56.366 EAL: VFIO support initialized 00:05:56.366 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:56.366 00:05:56.366 00:05:56.366 CUnit - A unit testing framework for C - Version 2.1-3 00:05:56.366 http://cunit.sourceforge.net/ 00:05:56.366 00:05:56.366 00:05:56.366 Suite: memory 00:05:56.366 Test: test ... 00:05:56.366 register 0x200000200000 2097152 00:05:56.366 malloc 3145728 00:05:56.366 register 0x200000400000 4194304 00:05:56.366 buf 0x200000500000 len 3145728 PASSED 00:05:56.366 malloc 64 00:05:56.366 buf 0x2000004fff40 len 64 PASSED 00:05:56.366 malloc 4194304 00:05:56.366 register 0x200000800000 6291456 00:05:56.366 buf 0x200000a00000 len 4194304 PASSED 00:05:56.366 free 0x200000500000 3145728 00:05:56.366 free 0x2000004fff40 64 00:05:56.366 unregister 0x200000400000 4194304 PASSED 00:05:56.366 free 0x200000a00000 4194304 00:05:56.366 unregister 0x200000800000 6291456 PASSED 00:05:56.366 malloc 8388608 00:05:56.366 register 0x200000400000 10485760 00:05:56.366 buf 0x200000600000 len 8388608 PASSED 00:05:56.366 free 0x200000600000 8388608 00:05:56.366 unregister 0x200000400000 10485760 PASSED 00:05:56.366 passed 00:05:56.366 00:05:56.366 Run Summary: Type Total Ran Passed Failed Inactive 00:05:56.366 suites 1 1 n/a 0 0 00:05:56.366 tests 1 1 1 0 0 00:05:56.366 asserts 15 15 15 0 n/a 00:05:56.366 00:05:56.366 Elapsed time = 0.005 seconds 00:05:56.366 00:05:56.366 real 0m0.047s 00:05:56.366 user 0m0.010s 00:05:56.366 sys 0m0.037s 00:05:56.366 13:16:52 env.env_mem_callbacks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:56.366 13:16:52 env.env_mem_callbacks -- common/autotest_common.sh@10 -- # set +x 00:05:56.366 ************************************ 00:05:56.366 END TEST env_mem_callbacks 00:05:56.366 ************************************ 00:05:56.366 00:05:56.366 real 0m6.435s 00:05:56.366 user 0m4.201s 00:05:56.366 sys 0m1.282s 00:05:56.366 13:16:52 env -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:56.366 13:16:52 env -- common/autotest_common.sh@10 -- # set +x 00:05:56.366 ************************************ 00:05:56.366 END TEST env 00:05:56.366 ************************************ 00:05:56.366 13:16:52 -- spdk/autotest.sh@156 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:56.366 13:16:52 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:56.366 13:16:52 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:56.366 13:16:52 -- common/autotest_common.sh@10 -- # set +x 00:05:56.366 ************************************ 00:05:56.366 START TEST rpc 00:05:56.366 ************************************ 00:05:56.366 13:16:52 rpc -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:56.366 * Looking for test storage... 00:05:56.624 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:56.624 13:16:52 rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:56.624 13:16:52 rpc -- scripts/common.sh@336 -- # IFS=.-: 00:05:56.624 13:16:52 rpc -- scripts/common.sh@336 -- # read -ra ver1 00:05:56.624 13:16:52 rpc -- scripts/common.sh@337 -- # IFS=.-: 00:05:56.624 13:16:52 rpc -- scripts/common.sh@337 -- # read -ra ver2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@338 -- # local 'op=<' 00:05:56.624 13:16:52 rpc -- scripts/common.sh@340 -- # ver1_l=2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@341 -- # ver2_l=1 00:05:56.624 13:16:52 rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:56.624 13:16:52 rpc -- scripts/common.sh@344 -- # case "$op" in 00:05:56.624 13:16:52 rpc -- scripts/common.sh@345 -- # : 1 00:05:56.624 13:16:52 rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:56.624 13:16:52 rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:56.624 13:16:52 rpc -- scripts/common.sh@365 -- # decimal 1 00:05:56.624 13:16:52 rpc -- scripts/common.sh@353 -- # local d=1 00:05:56.624 13:16:52 rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:56.624 13:16:52 rpc -- scripts/common.sh@355 -- # echo 1 00:05:56.624 13:16:52 rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:05:56.624 13:16:52 rpc -- scripts/common.sh@366 -- # decimal 2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@353 -- # local d=2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:56.624 13:16:52 rpc -- scripts/common.sh@355 -- # echo 2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:05:56.624 13:16:52 rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:56.624 13:16:52 rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:56.624 13:16:52 rpc -- scripts/common.sh@368 -- # return 0 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:56.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.624 --rc genhtml_branch_coverage=1 00:05:56.624 --rc genhtml_function_coverage=1 00:05:56.624 --rc genhtml_legend=1 00:05:56.624 --rc geninfo_all_blocks=1 00:05:56.624 --rc geninfo_unexecuted_blocks=1 00:05:56.624 00:05:56.624 ' 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:56.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.624 --rc genhtml_branch_coverage=1 00:05:56.624 --rc genhtml_function_coverage=1 00:05:56.624 --rc genhtml_legend=1 00:05:56.624 --rc geninfo_all_blocks=1 00:05:56.624 --rc geninfo_unexecuted_blocks=1 00:05:56.624 00:05:56.624 ' 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:56.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.624 --rc genhtml_branch_coverage=1 00:05:56.624 --rc genhtml_function_coverage=1 00:05:56.624 --rc genhtml_legend=1 00:05:56.624 --rc geninfo_all_blocks=1 00:05:56.624 --rc geninfo_unexecuted_blocks=1 00:05:56.624 00:05:56.624 ' 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:56.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.624 --rc genhtml_branch_coverage=1 00:05:56.624 --rc genhtml_function_coverage=1 00:05:56.624 --rc genhtml_legend=1 00:05:56.624 --rc geninfo_all_blocks=1 00:05:56.624 --rc geninfo_unexecuted_blocks=1 00:05:56.624 00:05:56.624 ' 00:05:56.624 13:16:52 rpc -- rpc/rpc.sh@65 -- # spdk_pid=511937 00:05:56.624 13:16:52 rpc -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:56.624 13:16:52 rpc -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:56.624 13:16:52 rpc -- rpc/rpc.sh@67 -- # waitforlisten 511937 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@831 -- # '[' -z 511937 ']' 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.624 13:16:52 rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:56.625 13:16:52 rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.625 13:16:52 rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:56.625 13:16:52 rpc -- common/autotest_common.sh@10 -- # set +x 00:05:56.625 [2024-10-07 13:16:52.445348] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:05:56.625 [2024-10-07 13:16:52.445441] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid511937 ] 00:05:56.625 [2024-10-07 13:16:52.501973] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.883 [2024-10-07 13:16:52.604659] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:56.883 [2024-10-07 13:16:52.604726] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 511937' to capture a snapshot of events at runtime. 00:05:56.883 [2024-10-07 13:16:52.604749] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:05:56.883 [2024-10-07 13:16:52.604759] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:05:56.883 [2024-10-07 13:16:52.604768] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid511937 for offline analysis/debug. 00:05:56.883 [2024-10-07 13:16:52.605368] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.142 13:16:52 rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:57.142 13:16:52 rpc -- common/autotest_common.sh@864 -- # return 0 00:05:57.142 13:16:52 rpc -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:57.142 13:16:52 rpc -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:57.142 13:16:52 rpc -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:57.142 13:16:52 rpc -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:57.142 13:16:52 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:57.142 13:16:52 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:57.142 13:16:52 rpc -- common/autotest_common.sh@10 -- # set +x 00:05:57.142 ************************************ 00:05:57.142 START TEST rpc_integrity 00:05:57.142 ************************************ 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # jq length 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:57.142 { 00:05:57.142 "name": "Malloc0", 00:05:57.142 "aliases": [ 00:05:57.142 "a3d1fbbb-18bb-400a-9a94-07fb42c91b46" 00:05:57.142 ], 00:05:57.142 "product_name": "Malloc disk", 00:05:57.142 "block_size": 512, 00:05:57.142 "num_blocks": 16384, 00:05:57.142 "uuid": "a3d1fbbb-18bb-400a-9a94-07fb42c91b46", 00:05:57.142 "assigned_rate_limits": { 00:05:57.142 "rw_ios_per_sec": 0, 00:05:57.142 "rw_mbytes_per_sec": 0, 00:05:57.142 "r_mbytes_per_sec": 0, 00:05:57.142 "w_mbytes_per_sec": 0 00:05:57.142 }, 00:05:57.142 "claimed": false, 00:05:57.142 "zoned": false, 00:05:57.142 "supported_io_types": { 00:05:57.142 "read": true, 00:05:57.142 "write": true, 00:05:57.142 "unmap": true, 00:05:57.142 "flush": true, 00:05:57.142 "reset": true, 00:05:57.142 "nvme_admin": false, 00:05:57.142 "nvme_io": false, 00:05:57.142 "nvme_io_md": false, 00:05:57.142 "write_zeroes": true, 00:05:57.142 "zcopy": true, 00:05:57.142 "get_zone_info": false, 00:05:57.142 "zone_management": false, 00:05:57.142 "zone_append": false, 00:05:57.142 "compare": false, 00:05:57.142 "compare_and_write": false, 00:05:57.142 "abort": true, 00:05:57.142 "seek_hole": false, 00:05:57.142 "seek_data": false, 00:05:57.142 "copy": true, 00:05:57.142 "nvme_iov_md": false 00:05:57.142 }, 00:05:57.142 "memory_domains": [ 00:05:57.142 { 00:05:57.142 "dma_device_id": "system", 00:05:57.142 "dma_device_type": 1 00:05:57.142 }, 00:05:57.142 { 00:05:57.142 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.142 "dma_device_type": 2 00:05:57.142 } 00:05:57.142 ], 00:05:57.142 "driver_specific": {} 00:05:57.142 } 00:05:57.142 ]' 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # jq length 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:57.142 13:16:52 rpc.rpc_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.142 13:16:52 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.142 [2024-10-07 13:16:53.001825] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:57.142 [2024-10-07 13:16:53.001895] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:57.142 [2024-10-07 13:16:53.001917] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xc64b00 00:05:57.142 [2024-10-07 13:16:53.001930] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:57.142 [2024-10-07 13:16:53.003266] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:57.142 [2024-10-07 13:16:53.003289] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:57.142 Passthru0 00:05:57.142 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.142 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:57.142 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.142 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.142 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.142 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:57.142 { 00:05:57.142 "name": "Malloc0", 00:05:57.142 "aliases": [ 00:05:57.142 "a3d1fbbb-18bb-400a-9a94-07fb42c91b46" 00:05:57.142 ], 00:05:57.142 "product_name": "Malloc disk", 00:05:57.142 "block_size": 512, 00:05:57.142 "num_blocks": 16384, 00:05:57.142 "uuid": "a3d1fbbb-18bb-400a-9a94-07fb42c91b46", 00:05:57.142 "assigned_rate_limits": { 00:05:57.142 "rw_ios_per_sec": 0, 00:05:57.142 "rw_mbytes_per_sec": 0, 00:05:57.142 "r_mbytes_per_sec": 0, 00:05:57.142 "w_mbytes_per_sec": 0 00:05:57.142 }, 00:05:57.142 "claimed": true, 00:05:57.142 "claim_type": "exclusive_write", 00:05:57.142 "zoned": false, 00:05:57.142 "supported_io_types": { 00:05:57.142 "read": true, 00:05:57.142 "write": true, 00:05:57.142 "unmap": true, 00:05:57.142 "flush": true, 00:05:57.142 "reset": true, 00:05:57.142 "nvme_admin": false, 00:05:57.142 "nvme_io": false, 00:05:57.142 "nvme_io_md": false, 00:05:57.142 "write_zeroes": true, 00:05:57.142 "zcopy": true, 00:05:57.142 "get_zone_info": false, 00:05:57.142 "zone_management": false, 00:05:57.142 "zone_append": false, 00:05:57.142 "compare": false, 00:05:57.142 "compare_and_write": false, 00:05:57.142 "abort": true, 00:05:57.142 "seek_hole": false, 00:05:57.142 "seek_data": false, 00:05:57.142 "copy": true, 00:05:57.142 "nvme_iov_md": false 00:05:57.142 }, 00:05:57.142 "memory_domains": [ 00:05:57.142 { 00:05:57.142 "dma_device_id": "system", 00:05:57.142 "dma_device_type": 1 00:05:57.142 }, 00:05:57.142 { 00:05:57.142 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.142 "dma_device_type": 2 00:05:57.142 } 00:05:57.142 ], 00:05:57.142 "driver_specific": {} 00:05:57.142 }, 00:05:57.142 { 00:05:57.142 "name": "Passthru0", 00:05:57.142 "aliases": [ 00:05:57.142 "8b4bf646-7da7-5470-b362-19cf0e0fc3d7" 00:05:57.142 ], 00:05:57.142 "product_name": "passthru", 00:05:57.142 "block_size": 512, 00:05:57.142 "num_blocks": 16384, 00:05:57.142 "uuid": "8b4bf646-7da7-5470-b362-19cf0e0fc3d7", 00:05:57.142 "assigned_rate_limits": { 00:05:57.142 "rw_ios_per_sec": 0, 00:05:57.142 "rw_mbytes_per_sec": 0, 00:05:57.142 "r_mbytes_per_sec": 0, 00:05:57.142 "w_mbytes_per_sec": 0 00:05:57.142 }, 00:05:57.142 "claimed": false, 00:05:57.142 "zoned": false, 00:05:57.142 "supported_io_types": { 00:05:57.142 "read": true, 00:05:57.142 "write": true, 00:05:57.142 "unmap": true, 00:05:57.142 "flush": true, 00:05:57.142 "reset": true, 00:05:57.142 "nvme_admin": false, 00:05:57.142 "nvme_io": false, 00:05:57.142 "nvme_io_md": false, 00:05:57.142 "write_zeroes": true, 00:05:57.142 "zcopy": true, 00:05:57.142 "get_zone_info": false, 00:05:57.142 "zone_management": false, 00:05:57.142 "zone_append": false, 00:05:57.142 "compare": false, 00:05:57.142 "compare_and_write": false, 00:05:57.142 "abort": true, 00:05:57.142 "seek_hole": false, 00:05:57.142 "seek_data": false, 00:05:57.142 "copy": true, 00:05:57.142 "nvme_iov_md": false 00:05:57.142 }, 00:05:57.142 "memory_domains": [ 00:05:57.142 { 00:05:57.142 "dma_device_id": "system", 00:05:57.143 "dma_device_type": 1 00:05:57.143 }, 00:05:57.143 { 00:05:57.143 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.143 "dma_device_type": 2 00:05:57.143 } 00:05:57.143 ], 00:05:57.143 "driver_specific": { 00:05:57.143 "passthru": { 00:05:57.143 "name": "Passthru0", 00:05:57.143 "base_bdev_name": "Malloc0" 00:05:57.143 } 00:05:57.143 } 00:05:57.143 } 00:05:57.143 ]' 00:05:57.143 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # jq length 00:05:57.143 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:57.143 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.143 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.143 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.143 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.401 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:57.401 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # jq length 00:05:57.401 13:16:53 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:57.401 00:05:57.401 real 0m0.220s 00:05:57.401 user 0m0.139s 00:05:57.401 sys 0m0.024s 00:05:57.401 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:57.401 13:16:53 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 ************************************ 00:05:57.401 END TEST rpc_integrity 00:05:57.401 ************************************ 00:05:57.401 13:16:53 rpc -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:57.401 13:16:53 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:57.401 13:16:53 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:57.401 13:16:53 rpc -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 ************************************ 00:05:57.401 START TEST rpc_plugins 00:05:57.401 ************************************ 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@1125 -- # rpc_plugins 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:57.401 { 00:05:57.401 "name": "Malloc1", 00:05:57.401 "aliases": [ 00:05:57.401 "aec2e95f-46d2-407e-9db1-3164244dbaf3" 00:05:57.401 ], 00:05:57.401 "product_name": "Malloc disk", 00:05:57.401 "block_size": 4096, 00:05:57.401 "num_blocks": 256, 00:05:57.401 "uuid": "aec2e95f-46d2-407e-9db1-3164244dbaf3", 00:05:57.401 "assigned_rate_limits": { 00:05:57.401 "rw_ios_per_sec": 0, 00:05:57.401 "rw_mbytes_per_sec": 0, 00:05:57.401 "r_mbytes_per_sec": 0, 00:05:57.401 "w_mbytes_per_sec": 0 00:05:57.401 }, 00:05:57.401 "claimed": false, 00:05:57.401 "zoned": false, 00:05:57.401 "supported_io_types": { 00:05:57.401 "read": true, 00:05:57.401 "write": true, 00:05:57.401 "unmap": true, 00:05:57.401 "flush": true, 00:05:57.401 "reset": true, 00:05:57.401 "nvme_admin": false, 00:05:57.401 "nvme_io": false, 00:05:57.401 "nvme_io_md": false, 00:05:57.401 "write_zeroes": true, 00:05:57.401 "zcopy": true, 00:05:57.401 "get_zone_info": false, 00:05:57.401 "zone_management": false, 00:05:57.401 "zone_append": false, 00:05:57.401 "compare": false, 00:05:57.401 "compare_and_write": false, 00:05:57.401 "abort": true, 00:05:57.401 "seek_hole": false, 00:05:57.401 "seek_data": false, 00:05:57.401 "copy": true, 00:05:57.401 "nvme_iov_md": false 00:05:57.401 }, 00:05:57.401 "memory_domains": [ 00:05:57.401 { 00:05:57.401 "dma_device_id": "system", 00:05:57.401 "dma_device_type": 1 00:05:57.401 }, 00:05:57.401 { 00:05:57.401 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.401 "dma_device_type": 2 00:05:57.401 } 00:05:57.401 ], 00:05:57.401 "driver_specific": {} 00:05:57.401 } 00:05:57.401 ]' 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # jq length 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # jq length 00:05:57.401 13:16:53 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:57.401 00:05:57.401 real 0m0.108s 00:05:57.401 user 0m0.066s 00:05:57.401 sys 0m0.012s 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:57.401 13:16:53 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 ************************************ 00:05:57.401 END TEST rpc_plugins 00:05:57.401 ************************************ 00:05:57.401 13:16:53 rpc -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:57.401 13:16:53 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:57.401 13:16:53 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:57.401 13:16:53 rpc -- common/autotest_common.sh@10 -- # set +x 00:05:57.401 ************************************ 00:05:57.401 START TEST rpc_trace_cmd_test 00:05:57.401 ************************************ 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1125 -- # rpc_trace_cmd_test 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@40 -- # local info 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # info='{ 00:05:57.402 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid511937", 00:05:57.402 "tpoint_group_mask": "0x8", 00:05:57.402 "iscsi_conn": { 00:05:57.402 "mask": "0x2", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "scsi": { 00:05:57.402 "mask": "0x4", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "bdev": { 00:05:57.402 "mask": "0x8", 00:05:57.402 "tpoint_mask": "0xffffffffffffffff" 00:05:57.402 }, 00:05:57.402 "nvmf_rdma": { 00:05:57.402 "mask": "0x10", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "nvmf_tcp": { 00:05:57.402 "mask": "0x20", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "ftl": { 00:05:57.402 "mask": "0x40", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "blobfs": { 00:05:57.402 "mask": "0x80", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "dsa": { 00:05:57.402 "mask": "0x200", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "thread": { 00:05:57.402 "mask": "0x400", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "nvme_pcie": { 00:05:57.402 "mask": "0x800", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "iaa": { 00:05:57.402 "mask": "0x1000", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "nvme_tcp": { 00:05:57.402 "mask": "0x2000", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "bdev_nvme": { 00:05:57.402 "mask": "0x4000", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "sock": { 00:05:57.402 "mask": "0x8000", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "blob": { 00:05:57.402 "mask": "0x10000", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "bdev_raid": { 00:05:57.402 "mask": "0x20000", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 }, 00:05:57.402 "scheduler": { 00:05:57.402 "mask": "0x40000", 00:05:57.402 "tpoint_mask": "0x0" 00:05:57.402 } 00:05:57.402 }' 00:05:57.402 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # jq length 00:05:57.661 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # '[' 19 -gt 2 ']' 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:57.662 00:05:57.662 real 0m0.181s 00:05:57.662 user 0m0.159s 00:05:57.662 sys 0m0.014s 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:57.662 13:16:53 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:05:57.662 ************************************ 00:05:57.662 END TEST rpc_trace_cmd_test 00:05:57.662 ************************************ 00:05:57.662 13:16:53 rpc -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:57.662 13:16:53 rpc -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:57.662 13:16:53 rpc -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:57.662 13:16:53 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:57.662 13:16:53 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:57.662 13:16:53 rpc -- common/autotest_common.sh@10 -- # set +x 00:05:57.662 ************************************ 00:05:57.662 START TEST rpc_daemon_integrity 00:05:57.662 ************************************ 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # jq length 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.662 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:57.920 { 00:05:57.920 "name": "Malloc2", 00:05:57.920 "aliases": [ 00:05:57.920 "8aa6d429-d4f1-48f5-ad44-ed88994a1cbf" 00:05:57.920 ], 00:05:57.920 "product_name": "Malloc disk", 00:05:57.920 "block_size": 512, 00:05:57.920 "num_blocks": 16384, 00:05:57.920 "uuid": "8aa6d429-d4f1-48f5-ad44-ed88994a1cbf", 00:05:57.920 "assigned_rate_limits": { 00:05:57.920 "rw_ios_per_sec": 0, 00:05:57.920 "rw_mbytes_per_sec": 0, 00:05:57.920 "r_mbytes_per_sec": 0, 00:05:57.920 "w_mbytes_per_sec": 0 00:05:57.920 }, 00:05:57.920 "claimed": false, 00:05:57.920 "zoned": false, 00:05:57.920 "supported_io_types": { 00:05:57.920 "read": true, 00:05:57.920 "write": true, 00:05:57.920 "unmap": true, 00:05:57.920 "flush": true, 00:05:57.920 "reset": true, 00:05:57.920 "nvme_admin": false, 00:05:57.920 "nvme_io": false, 00:05:57.920 "nvme_io_md": false, 00:05:57.920 "write_zeroes": true, 00:05:57.920 "zcopy": true, 00:05:57.920 "get_zone_info": false, 00:05:57.920 "zone_management": false, 00:05:57.920 "zone_append": false, 00:05:57.920 "compare": false, 00:05:57.920 "compare_and_write": false, 00:05:57.920 "abort": true, 00:05:57.920 "seek_hole": false, 00:05:57.920 "seek_data": false, 00:05:57.920 "copy": true, 00:05:57.920 "nvme_iov_md": false 00:05:57.920 }, 00:05:57.920 "memory_domains": [ 00:05:57.920 { 00:05:57.920 "dma_device_id": "system", 00:05:57.920 "dma_device_type": 1 00:05:57.920 }, 00:05:57.920 { 00:05:57.920 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.920 "dma_device_type": 2 00:05:57.920 } 00:05:57.920 ], 00:05:57.920 "driver_specific": {} 00:05:57.920 } 00:05:57.920 ]' 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # jq length 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.920 [2024-10-07 13:16:53.648536] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:57.920 [2024-10-07 13:16:53.648579] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:57.920 [2024-10-07 13:16:53.648602] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xc64d30 00:05:57.920 [2024-10-07 13:16:53.648616] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:57.920 [2024-10-07 13:16:53.649756] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:57.920 [2024-10-07 13:16:53.649797] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:57.920 Passthru0 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.920 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:57.921 { 00:05:57.921 "name": "Malloc2", 00:05:57.921 "aliases": [ 00:05:57.921 "8aa6d429-d4f1-48f5-ad44-ed88994a1cbf" 00:05:57.921 ], 00:05:57.921 "product_name": "Malloc disk", 00:05:57.921 "block_size": 512, 00:05:57.921 "num_blocks": 16384, 00:05:57.921 "uuid": "8aa6d429-d4f1-48f5-ad44-ed88994a1cbf", 00:05:57.921 "assigned_rate_limits": { 00:05:57.921 "rw_ios_per_sec": 0, 00:05:57.921 "rw_mbytes_per_sec": 0, 00:05:57.921 "r_mbytes_per_sec": 0, 00:05:57.921 "w_mbytes_per_sec": 0 00:05:57.921 }, 00:05:57.921 "claimed": true, 00:05:57.921 "claim_type": "exclusive_write", 00:05:57.921 "zoned": false, 00:05:57.921 "supported_io_types": { 00:05:57.921 "read": true, 00:05:57.921 "write": true, 00:05:57.921 "unmap": true, 00:05:57.921 "flush": true, 00:05:57.921 "reset": true, 00:05:57.921 "nvme_admin": false, 00:05:57.921 "nvme_io": false, 00:05:57.921 "nvme_io_md": false, 00:05:57.921 "write_zeroes": true, 00:05:57.921 "zcopy": true, 00:05:57.921 "get_zone_info": false, 00:05:57.921 "zone_management": false, 00:05:57.921 "zone_append": false, 00:05:57.921 "compare": false, 00:05:57.921 "compare_and_write": false, 00:05:57.921 "abort": true, 00:05:57.921 "seek_hole": false, 00:05:57.921 "seek_data": false, 00:05:57.921 "copy": true, 00:05:57.921 "nvme_iov_md": false 00:05:57.921 }, 00:05:57.921 "memory_domains": [ 00:05:57.921 { 00:05:57.921 "dma_device_id": "system", 00:05:57.921 "dma_device_type": 1 00:05:57.921 }, 00:05:57.921 { 00:05:57.921 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.921 "dma_device_type": 2 00:05:57.921 } 00:05:57.921 ], 00:05:57.921 "driver_specific": {} 00:05:57.921 }, 00:05:57.921 { 00:05:57.921 "name": "Passthru0", 00:05:57.921 "aliases": [ 00:05:57.921 "34b11ab4-e99e-5976-99a0-0b1c81c3c743" 00:05:57.921 ], 00:05:57.921 "product_name": "passthru", 00:05:57.921 "block_size": 512, 00:05:57.921 "num_blocks": 16384, 00:05:57.921 "uuid": "34b11ab4-e99e-5976-99a0-0b1c81c3c743", 00:05:57.921 "assigned_rate_limits": { 00:05:57.921 "rw_ios_per_sec": 0, 00:05:57.921 "rw_mbytes_per_sec": 0, 00:05:57.921 "r_mbytes_per_sec": 0, 00:05:57.921 "w_mbytes_per_sec": 0 00:05:57.921 }, 00:05:57.921 "claimed": false, 00:05:57.921 "zoned": false, 00:05:57.921 "supported_io_types": { 00:05:57.921 "read": true, 00:05:57.921 "write": true, 00:05:57.921 "unmap": true, 00:05:57.921 "flush": true, 00:05:57.921 "reset": true, 00:05:57.921 "nvme_admin": false, 00:05:57.921 "nvme_io": false, 00:05:57.921 "nvme_io_md": false, 00:05:57.921 "write_zeroes": true, 00:05:57.921 "zcopy": true, 00:05:57.921 "get_zone_info": false, 00:05:57.921 "zone_management": false, 00:05:57.921 "zone_append": false, 00:05:57.921 "compare": false, 00:05:57.921 "compare_and_write": false, 00:05:57.921 "abort": true, 00:05:57.921 "seek_hole": false, 00:05:57.921 "seek_data": false, 00:05:57.921 "copy": true, 00:05:57.921 "nvme_iov_md": false 00:05:57.921 }, 00:05:57.921 "memory_domains": [ 00:05:57.921 { 00:05:57.921 "dma_device_id": "system", 00:05:57.921 "dma_device_type": 1 00:05:57.921 }, 00:05:57.921 { 00:05:57.921 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:57.921 "dma_device_type": 2 00:05:57.921 } 00:05:57.921 ], 00:05:57.921 "driver_specific": { 00:05:57.921 "passthru": { 00:05:57.921 "name": "Passthru0", 00:05:57.921 "base_bdev_name": "Malloc2" 00:05:57.921 } 00:05:57.921 } 00:05:57.921 } 00:05:57.921 ]' 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # jq length 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # jq length 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:57.921 00:05:57.921 real 0m0.219s 00:05:57.921 user 0m0.132s 00:05:57.921 sys 0m0.024s 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:57.921 13:16:53 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:05:57.921 ************************************ 00:05:57.921 END TEST rpc_daemon_integrity 00:05:57.921 ************************************ 00:05:57.921 13:16:53 rpc -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:57.921 13:16:53 rpc -- rpc/rpc.sh@84 -- # killprocess 511937 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@950 -- # '[' -z 511937 ']' 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@954 -- # kill -0 511937 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@955 -- # uname 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 511937 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 511937' 00:05:57.921 killing process with pid 511937 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@969 -- # kill 511937 00:05:57.921 13:16:53 rpc -- common/autotest_common.sh@974 -- # wait 511937 00:05:58.484 00:05:58.484 real 0m2.036s 00:05:58.484 user 0m2.485s 00:05:58.484 sys 0m0.606s 00:05:58.484 13:16:54 rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:58.484 13:16:54 rpc -- common/autotest_common.sh@10 -- # set +x 00:05:58.484 ************************************ 00:05:58.484 END TEST rpc 00:05:58.484 ************************************ 00:05:58.484 13:16:54 -- spdk/autotest.sh@157 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:58.484 13:16:54 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:58.484 13:16:54 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:58.484 13:16:54 -- common/autotest_common.sh@10 -- # set +x 00:05:58.484 ************************************ 00:05:58.484 START TEST skip_rpc 00:05:58.484 ************************************ 00:05:58.484 13:16:54 skip_rpc -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:58.484 * Looking for test storage... 00:05:58.484 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:58.484 13:16:54 skip_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:58.484 13:16:54 skip_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:05:58.484 13:16:54 skip_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@344 -- # case "$op" in 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@345 -- # : 1 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@365 -- # decimal 1 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@353 -- # local d=1 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@355 -- # echo 1 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@366 -- # decimal 2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@353 -- # local d=2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@355 -- # echo 2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:58.742 13:16:54 skip_rpc -- scripts/common.sh@368 -- # return 0 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:58.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.742 --rc genhtml_branch_coverage=1 00:05:58.742 --rc genhtml_function_coverage=1 00:05:58.742 --rc genhtml_legend=1 00:05:58.742 --rc geninfo_all_blocks=1 00:05:58.742 --rc geninfo_unexecuted_blocks=1 00:05:58.742 00:05:58.742 ' 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:58.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.742 --rc genhtml_branch_coverage=1 00:05:58.742 --rc genhtml_function_coverage=1 00:05:58.742 --rc genhtml_legend=1 00:05:58.742 --rc geninfo_all_blocks=1 00:05:58.742 --rc geninfo_unexecuted_blocks=1 00:05:58.742 00:05:58.742 ' 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:58.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.742 --rc genhtml_branch_coverage=1 00:05:58.742 --rc genhtml_function_coverage=1 00:05:58.742 --rc genhtml_legend=1 00:05:58.742 --rc geninfo_all_blocks=1 00:05:58.742 --rc geninfo_unexecuted_blocks=1 00:05:58.742 00:05:58.742 ' 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:58.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.742 --rc genhtml_branch_coverage=1 00:05:58.742 --rc genhtml_function_coverage=1 00:05:58.742 --rc genhtml_legend=1 00:05:58.742 --rc geninfo_all_blocks=1 00:05:58.742 --rc geninfo_unexecuted_blocks=1 00:05:58.742 00:05:58.742 ' 00:05:58.742 13:16:54 skip_rpc -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:05:58.742 13:16:54 skip_rpc -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:05:58.742 13:16:54 skip_rpc -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:58.742 13:16:54 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:58.742 ************************************ 00:05:58.742 START TEST skip_rpc 00:05:58.742 ************************************ 00:05:58.742 13:16:54 skip_rpc.skip_rpc -- common/autotest_common.sh@1125 -- # test_skip_rpc 00:05:58.742 13:16:54 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@16 -- # local spdk_pid=512384 00:05:58.742 13:16:54 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:05:58.742 13:16:54 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:58.742 13:16:54 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@19 -- # sleep 5 00:05:58.742 [2024-10-07 13:16:54.559956] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:05:58.742 [2024-10-07 13:16:54.560026] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid512384 ] 00:05:58.742 [2024-10-07 13:16:54.613558] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.000 [2024-10-07 13:16:54.719087] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@650 -- # local es=0 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd spdk_get_version 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # rpc_cmd spdk_get_version 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # es=1 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@23 -- # killprocess 512384 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@950 -- # '[' -z 512384 ']' 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@954 -- # kill -0 512384 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # uname 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 512384 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 512384' 00:06:04.260 killing process with pid 512384 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@969 -- # kill 512384 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@974 -- # wait 512384 00:06:04.260 00:06:04.260 real 0m5.491s 00:06:04.260 user 0m5.183s 00:06:04.260 sys 0m0.319s 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:04.260 13:16:59 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:04.260 ************************************ 00:06:04.260 END TEST skip_rpc 00:06:04.260 ************************************ 00:06:04.260 13:17:00 skip_rpc -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:06:04.260 13:17:00 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:04.260 13:17:00 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:04.260 13:17:00 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:04.260 ************************************ 00:06:04.260 START TEST skip_rpc_with_json 00:06:04.260 ************************************ 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_json 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@28 -- # local spdk_pid=513013 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@31 -- # waitforlisten 513013 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@831 -- # '[' -z 513013 ']' 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:04.260 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:04.260 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:06:04.260 [2024-10-07 13:17:00.103213] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:04.260 [2024-10-07 13:17:00.103306] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid513013 ] 00:06:04.260 [2024-10-07 13:17:00.163124] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.521 [2024-10-07 13:17:00.272329] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@864 -- # return 0 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:06:04.812 [2024-10-07 13:17:00.561568] nvmf_rpc.c:2703:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:06:04.812 request: 00:06:04.812 { 00:06:04.812 "trtype": "tcp", 00:06:04.812 "method": "nvmf_get_transports", 00:06:04.812 "req_id": 1 00:06:04.812 } 00:06:04.812 Got JSON-RPC error response 00:06:04.812 response: 00:06:04.812 { 00:06:04.812 "code": -19, 00:06:04.812 "message": "No such device" 00:06:04.812 } 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:06:04.812 [2024-10-07 13:17:00.569695] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.812 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:06:05.094 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:05.094 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:06:05.094 { 00:06:05.094 "subsystems": [ 00:06:05.094 { 00:06:05.094 "subsystem": "fsdev", 00:06:05.094 "config": [ 00:06:05.094 { 00:06:05.094 "method": "fsdev_set_opts", 00:06:05.094 "params": { 00:06:05.094 "fsdev_io_pool_size": 65535, 00:06:05.094 "fsdev_io_cache_size": 256 00:06:05.094 } 00:06:05.094 } 00:06:05.094 ] 00:06:05.094 }, 00:06:05.094 { 00:06:05.094 "subsystem": "vfio_user_target", 00:06:05.094 "config": null 00:06:05.094 }, 00:06:05.094 { 00:06:05.094 "subsystem": "keyring", 00:06:05.094 "config": [] 00:06:05.094 }, 00:06:05.094 { 00:06:05.094 "subsystem": "iobuf", 00:06:05.094 "config": [ 00:06:05.094 { 00:06:05.094 "method": "iobuf_set_options", 00:06:05.094 "params": { 00:06:05.094 "small_pool_count": 8192, 00:06:05.094 "large_pool_count": 1024, 00:06:05.094 "small_bufsize": 8192, 00:06:05.094 "large_bufsize": 135168 00:06:05.094 } 00:06:05.094 } 00:06:05.094 ] 00:06:05.094 }, 00:06:05.094 { 00:06:05.094 "subsystem": "sock", 00:06:05.094 "config": [ 00:06:05.094 { 00:06:05.094 "method": "sock_set_default_impl", 00:06:05.094 "params": { 00:06:05.094 "impl_name": "posix" 00:06:05.094 } 00:06:05.094 }, 00:06:05.094 { 00:06:05.094 "method": "sock_impl_set_options", 00:06:05.094 "params": { 00:06:05.094 "impl_name": "ssl", 00:06:05.094 "recv_buf_size": 4096, 00:06:05.094 "send_buf_size": 4096, 00:06:05.094 "enable_recv_pipe": true, 00:06:05.094 "enable_quickack": false, 00:06:05.094 "enable_placement_id": 0, 00:06:05.094 "enable_zerocopy_send_server": true, 00:06:05.094 "enable_zerocopy_send_client": false, 00:06:05.094 "zerocopy_threshold": 0, 00:06:05.094 "tls_version": 0, 00:06:05.094 "enable_ktls": false 00:06:05.094 } 00:06:05.094 }, 00:06:05.094 { 00:06:05.094 "method": "sock_impl_set_options", 00:06:05.094 "params": { 00:06:05.094 "impl_name": "posix", 00:06:05.094 "recv_buf_size": 2097152, 00:06:05.094 "send_buf_size": 2097152, 00:06:05.094 "enable_recv_pipe": true, 00:06:05.094 "enable_quickack": false, 00:06:05.094 "enable_placement_id": 0, 00:06:05.094 "enable_zerocopy_send_server": true, 00:06:05.094 "enable_zerocopy_send_client": false, 00:06:05.094 "zerocopy_threshold": 0, 00:06:05.094 "tls_version": 0, 00:06:05.094 "enable_ktls": false 00:06:05.094 } 00:06:05.095 } 00:06:05.095 ] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "vmd", 00:06:05.095 "config": [] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "accel", 00:06:05.095 "config": [ 00:06:05.095 { 00:06:05.095 "method": "accel_set_options", 00:06:05.095 "params": { 00:06:05.095 "small_cache_size": 128, 00:06:05.095 "large_cache_size": 16, 00:06:05.095 "task_count": 2048, 00:06:05.095 "sequence_count": 2048, 00:06:05.095 "buf_count": 2048 00:06:05.095 } 00:06:05.095 } 00:06:05.095 ] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "bdev", 00:06:05.095 "config": [ 00:06:05.095 { 00:06:05.095 "method": "bdev_set_options", 00:06:05.095 "params": { 00:06:05.095 "bdev_io_pool_size": 65535, 00:06:05.095 "bdev_io_cache_size": 256, 00:06:05.095 "bdev_auto_examine": true, 00:06:05.095 "iobuf_small_cache_size": 128, 00:06:05.095 "iobuf_large_cache_size": 16 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "bdev_raid_set_options", 00:06:05.095 "params": { 00:06:05.095 "process_window_size_kb": 1024, 00:06:05.095 "process_max_bandwidth_mb_sec": 0 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "bdev_iscsi_set_options", 00:06:05.095 "params": { 00:06:05.095 "timeout_sec": 30 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "bdev_nvme_set_options", 00:06:05.095 "params": { 00:06:05.095 "action_on_timeout": "none", 00:06:05.095 "timeout_us": 0, 00:06:05.095 "timeout_admin_us": 0, 00:06:05.095 "keep_alive_timeout_ms": 10000, 00:06:05.095 "arbitration_burst": 0, 00:06:05.095 "low_priority_weight": 0, 00:06:05.095 "medium_priority_weight": 0, 00:06:05.095 "high_priority_weight": 0, 00:06:05.095 "nvme_adminq_poll_period_us": 10000, 00:06:05.095 "nvme_ioq_poll_period_us": 0, 00:06:05.095 "io_queue_requests": 0, 00:06:05.095 "delay_cmd_submit": true, 00:06:05.095 "transport_retry_count": 4, 00:06:05.095 "bdev_retry_count": 3, 00:06:05.095 "transport_ack_timeout": 0, 00:06:05.095 "ctrlr_loss_timeout_sec": 0, 00:06:05.095 "reconnect_delay_sec": 0, 00:06:05.095 "fast_io_fail_timeout_sec": 0, 00:06:05.095 "disable_auto_failback": false, 00:06:05.095 "generate_uuids": false, 00:06:05.095 "transport_tos": 0, 00:06:05.095 "nvme_error_stat": false, 00:06:05.095 "rdma_srq_size": 0, 00:06:05.095 "io_path_stat": false, 00:06:05.095 "allow_accel_sequence": false, 00:06:05.095 "rdma_max_cq_size": 0, 00:06:05.095 "rdma_cm_event_timeout_ms": 0, 00:06:05.095 "dhchap_digests": [ 00:06:05.095 "sha256", 00:06:05.095 "sha384", 00:06:05.095 "sha512" 00:06:05.095 ], 00:06:05.095 "dhchap_dhgroups": [ 00:06:05.095 "null", 00:06:05.095 "ffdhe2048", 00:06:05.095 "ffdhe3072", 00:06:05.095 "ffdhe4096", 00:06:05.095 "ffdhe6144", 00:06:05.095 "ffdhe8192" 00:06:05.095 ] 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "bdev_nvme_set_hotplug", 00:06:05.095 "params": { 00:06:05.095 "period_us": 100000, 00:06:05.095 "enable": false 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "bdev_wait_for_examine" 00:06:05.095 } 00:06:05.095 ] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "scsi", 00:06:05.095 "config": null 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "scheduler", 00:06:05.095 "config": [ 00:06:05.095 { 00:06:05.095 "method": "framework_set_scheduler", 00:06:05.095 "params": { 00:06:05.095 "name": "static" 00:06:05.095 } 00:06:05.095 } 00:06:05.095 ] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "vhost_scsi", 00:06:05.095 "config": [] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "vhost_blk", 00:06:05.095 "config": [] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "ublk", 00:06:05.095 "config": [] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "nbd", 00:06:05.095 "config": [] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "nvmf", 00:06:05.095 "config": [ 00:06:05.095 { 00:06:05.095 "method": "nvmf_set_config", 00:06:05.095 "params": { 00:06:05.095 "discovery_filter": "match_any", 00:06:05.095 "admin_cmd_passthru": { 00:06:05.095 "identify_ctrlr": false 00:06:05.095 }, 00:06:05.095 "dhchap_digests": [ 00:06:05.095 "sha256", 00:06:05.095 "sha384", 00:06:05.095 "sha512" 00:06:05.095 ], 00:06:05.095 "dhchap_dhgroups": [ 00:06:05.095 "null", 00:06:05.095 "ffdhe2048", 00:06:05.095 "ffdhe3072", 00:06:05.095 "ffdhe4096", 00:06:05.095 "ffdhe6144", 00:06:05.095 "ffdhe8192" 00:06:05.095 ] 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "nvmf_set_max_subsystems", 00:06:05.095 "params": { 00:06:05.095 "max_subsystems": 1024 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "nvmf_set_crdt", 00:06:05.095 "params": { 00:06:05.095 "crdt1": 0, 00:06:05.095 "crdt2": 0, 00:06:05.095 "crdt3": 0 00:06:05.095 } 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "method": "nvmf_create_transport", 00:06:05.095 "params": { 00:06:05.095 "trtype": "TCP", 00:06:05.095 "max_queue_depth": 128, 00:06:05.095 "max_io_qpairs_per_ctrlr": 127, 00:06:05.095 "in_capsule_data_size": 4096, 00:06:05.095 "max_io_size": 131072, 00:06:05.095 "io_unit_size": 131072, 00:06:05.095 "max_aq_depth": 128, 00:06:05.095 "num_shared_buffers": 511, 00:06:05.095 "buf_cache_size": 4294967295, 00:06:05.095 "dif_insert_or_strip": false, 00:06:05.095 "zcopy": false, 00:06:05.095 "c2h_success": true, 00:06:05.095 "sock_priority": 0, 00:06:05.095 "abort_timeout_sec": 1, 00:06:05.095 "ack_timeout": 0, 00:06:05.095 "data_wr_pool_size": 0 00:06:05.095 } 00:06:05.095 } 00:06:05.095 ] 00:06:05.095 }, 00:06:05.095 { 00:06:05.095 "subsystem": "iscsi", 00:06:05.095 "config": [ 00:06:05.095 { 00:06:05.095 "method": "iscsi_set_options", 00:06:05.095 "params": { 00:06:05.095 "node_base": "iqn.2016-06.io.spdk", 00:06:05.095 "max_sessions": 128, 00:06:05.095 "max_connections_per_session": 2, 00:06:05.095 "max_queue_depth": 64, 00:06:05.095 "default_time2wait": 2, 00:06:05.095 "default_time2retain": 20, 00:06:05.095 "first_burst_length": 8192, 00:06:05.095 "immediate_data": true, 00:06:05.095 "allow_duplicated_isid": false, 00:06:05.095 "error_recovery_level": 0, 00:06:05.095 "nop_timeout": 60, 00:06:05.095 "nop_in_interval": 30, 00:06:05.095 "disable_chap": false, 00:06:05.095 "require_chap": false, 00:06:05.095 "mutual_chap": false, 00:06:05.095 "chap_group": 0, 00:06:05.095 "max_large_datain_per_connection": 64, 00:06:05.095 "max_r2t_per_connection": 4, 00:06:05.095 "pdu_pool_size": 36864, 00:06:05.095 "immediate_data_pool_size": 16384, 00:06:05.095 "data_out_pool_size": 2048 00:06:05.095 } 00:06:05.095 } 00:06:05.095 ] 00:06:05.095 } 00:06:05.095 ] 00:06:05.095 } 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@40 -- # killprocess 513013 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 513013 ']' 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 513013 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 513013 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 513013' 00:06:05.095 killing process with pid 513013 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 513013 00:06:05.095 13:17:00 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 513013 00:06:05.354 13:17:01 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@47 -- # local spdk_pid=513221 00:06:05.354 13:17:01 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:06:05.354 13:17:01 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@48 -- # sleep 5 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@50 -- # killprocess 513221 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 513221 ']' 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 513221 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 513221 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 513221' 00:06:10.615 killing process with pid 513221 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 513221 00:06:10.615 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 513221 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/log.txt 00:06:10.874 00:06:10.874 real 0m6.686s 00:06:10.874 user 0m6.294s 00:06:10.874 sys 0m0.700s 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:06:10.874 ************************************ 00:06:10.874 END TEST skip_rpc_with_json 00:06:10.874 ************************************ 00:06:10.874 13:17:06 skip_rpc -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:06:10.874 13:17:06 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:10.874 13:17:06 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:10.874 13:17:06 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:10.874 ************************************ 00:06:10.874 START TEST skip_rpc_with_delay 00:06:10.874 ************************************ 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_delay 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@650 -- # local es=0 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:06:10.874 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:11.133 [2024-10-07 13:17:06.843093] app.c: 840:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:06:11.133 [2024-10-07 13:17:06.843222] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:06:11.133 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # es=1 00:06:11.133 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:11.133 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:11.133 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:11.133 00:06:11.133 real 0m0.072s 00:06:11.133 user 0m0.047s 00:06:11.133 sys 0m0.025s 00:06:11.133 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:11.133 13:17:06 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@10 -- # set +x 00:06:11.133 ************************************ 00:06:11.133 END TEST skip_rpc_with_delay 00:06:11.133 ************************************ 00:06:11.133 13:17:06 skip_rpc -- rpc/skip_rpc.sh@77 -- # uname 00:06:11.133 13:17:06 skip_rpc -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:06:11.133 13:17:06 skip_rpc -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:06:11.133 13:17:06 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:11.133 13:17:06 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:11.133 13:17:06 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:11.133 ************************************ 00:06:11.133 START TEST exit_on_failed_rpc_init 00:06:11.133 ************************************ 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1125 -- # test_exit_on_failed_rpc_init 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@62 -- # local spdk_pid=513933 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@63 -- # waitforlisten 513933 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@831 -- # '[' -z 513933 ']' 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:11.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:11.133 13:17:06 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:06:11.133 [2024-10-07 13:17:06.968456] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:11.133 [2024-10-07 13:17:06.968568] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid513933 ] 00:06:11.133 [2024-10-07 13:17:07.026178] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.391 [2024-10-07 13:17:07.140136] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@864 -- # return 0 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@650 -- # local es=0 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:06:11.650 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:11.650 [2024-10-07 13:17:07.455055] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:11.650 [2024-10-07 13:17:07.455139] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid513949 ] 00:06:11.650 [2024-10-07 13:17:07.511702] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.908 [2024-10-07 13:17:07.622416] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.908 [2024-10-07 13:17:07.622556] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:06:11.908 [2024-10-07 13:17:07.622577] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:06:11.908 [2024-10-07 13:17:07.622590] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # es=234 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@662 -- # es=106 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@663 -- # case "$es" in 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@670 -- # es=1 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@70 -- # killprocess 513933 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@950 -- # '[' -z 513933 ']' 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@954 -- # kill -0 513933 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # uname 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 513933 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@968 -- # echo 'killing process with pid 513933' 00:06:11.908 killing process with pid 513933 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@969 -- # kill 513933 00:06:11.908 13:17:07 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@974 -- # wait 513933 00:06:12.478 00:06:12.478 real 0m1.327s 00:06:12.478 user 0m1.503s 00:06:12.478 sys 0m0.461s 00:06:12.478 13:17:08 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:12.478 13:17:08 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:06:12.478 ************************************ 00:06:12.478 END TEST exit_on_failed_rpc_init 00:06:12.478 ************************************ 00:06:12.478 13:17:08 skip_rpc -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/config.json 00:06:12.478 00:06:12.478 real 0m13.930s 00:06:12.478 user 0m13.215s 00:06:12.478 sys 0m1.691s 00:06:12.478 13:17:08 skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:12.478 13:17:08 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:12.478 ************************************ 00:06:12.478 END TEST skip_rpc 00:06:12.478 ************************************ 00:06:12.478 13:17:08 -- spdk/autotest.sh@158 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:12.478 13:17:08 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:12.478 13:17:08 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:12.478 13:17:08 -- common/autotest_common.sh@10 -- # set +x 00:06:12.478 ************************************ 00:06:12.478 START TEST rpc_client 00:06:12.478 ************************************ 00:06:12.478 13:17:08 rpc_client -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:12.478 * Looking for test storage... 00:06:12.478 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:06:12.478 13:17:08 rpc_client -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:12.478 13:17:08 rpc_client -- common/autotest_common.sh@1681 -- # lcov --version 00:06:12.478 13:17:08 rpc_client -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@336 -- # IFS=.-: 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@336 -- # read -ra ver1 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@337 -- # IFS=.-: 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@337 -- # read -ra ver2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@338 -- # local 'op=<' 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@340 -- # ver1_l=2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@341 -- # ver2_l=1 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@344 -- # case "$op" in 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@345 -- # : 1 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@365 -- # decimal 1 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@353 -- # local d=1 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@355 -- # echo 1 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@365 -- # ver1[v]=1 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@366 -- # decimal 2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@353 -- # local d=2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@355 -- # echo 2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@366 -- # ver2[v]=2 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:12.741 13:17:08 rpc_client -- scripts/common.sh@368 -- # return 0 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:12.741 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.741 --rc genhtml_branch_coverage=1 00:06:12.741 --rc genhtml_function_coverage=1 00:06:12.741 --rc genhtml_legend=1 00:06:12.741 --rc geninfo_all_blocks=1 00:06:12.741 --rc geninfo_unexecuted_blocks=1 00:06:12.741 00:06:12.741 ' 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:12.741 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.741 --rc genhtml_branch_coverage=1 00:06:12.741 --rc genhtml_function_coverage=1 00:06:12.741 --rc genhtml_legend=1 00:06:12.741 --rc geninfo_all_blocks=1 00:06:12.741 --rc geninfo_unexecuted_blocks=1 00:06:12.741 00:06:12.741 ' 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:12.741 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.741 --rc genhtml_branch_coverage=1 00:06:12.741 --rc genhtml_function_coverage=1 00:06:12.741 --rc genhtml_legend=1 00:06:12.741 --rc geninfo_all_blocks=1 00:06:12.741 --rc geninfo_unexecuted_blocks=1 00:06:12.741 00:06:12.741 ' 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:12.741 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.741 --rc genhtml_branch_coverage=1 00:06:12.741 --rc genhtml_function_coverage=1 00:06:12.741 --rc genhtml_legend=1 00:06:12.741 --rc geninfo_all_blocks=1 00:06:12.741 --rc geninfo_unexecuted_blocks=1 00:06:12.741 00:06:12.741 ' 00:06:12.741 13:17:08 rpc_client -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:06:12.741 OK 00:06:12.741 13:17:08 rpc_client -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:06:12.741 00:06:12.741 real 0m0.168s 00:06:12.741 user 0m0.110s 00:06:12.741 sys 0m0.067s 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:12.741 13:17:08 rpc_client -- common/autotest_common.sh@10 -- # set +x 00:06:12.741 ************************************ 00:06:12.741 END TEST rpc_client 00:06:12.741 ************************************ 00:06:12.741 13:17:08 -- spdk/autotest.sh@159 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:06:12.741 13:17:08 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:12.741 13:17:08 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:12.741 13:17:08 -- common/autotest_common.sh@10 -- # set +x 00:06:12.741 ************************************ 00:06:12.741 START TEST json_config 00:06:12.741 ************************************ 00:06:12.741 13:17:08 json_config -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:06:12.741 13:17:08 json_config -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:12.741 13:17:08 json_config -- common/autotest_common.sh@1681 -- # lcov --version 00:06:12.741 13:17:08 json_config -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:12.741 13:17:08 json_config -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:12.741 13:17:08 json_config -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:12.741 13:17:08 json_config -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:12.741 13:17:08 json_config -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:12.741 13:17:08 json_config -- scripts/common.sh@336 -- # IFS=.-: 00:06:12.741 13:17:08 json_config -- scripts/common.sh@336 -- # read -ra ver1 00:06:12.742 13:17:08 json_config -- scripts/common.sh@337 -- # IFS=.-: 00:06:12.742 13:17:08 json_config -- scripts/common.sh@337 -- # read -ra ver2 00:06:12.742 13:17:08 json_config -- scripts/common.sh@338 -- # local 'op=<' 00:06:12.742 13:17:08 json_config -- scripts/common.sh@340 -- # ver1_l=2 00:06:12.742 13:17:08 json_config -- scripts/common.sh@341 -- # ver2_l=1 00:06:12.742 13:17:08 json_config -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:12.742 13:17:08 json_config -- scripts/common.sh@344 -- # case "$op" in 00:06:12.742 13:17:08 json_config -- scripts/common.sh@345 -- # : 1 00:06:12.742 13:17:08 json_config -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:12.742 13:17:08 json_config -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:12.742 13:17:08 json_config -- scripts/common.sh@365 -- # decimal 1 00:06:12.742 13:17:08 json_config -- scripts/common.sh@353 -- # local d=1 00:06:12.742 13:17:08 json_config -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:12.742 13:17:08 json_config -- scripts/common.sh@355 -- # echo 1 00:06:12.742 13:17:08 json_config -- scripts/common.sh@365 -- # ver1[v]=1 00:06:12.742 13:17:08 json_config -- scripts/common.sh@366 -- # decimal 2 00:06:12.742 13:17:08 json_config -- scripts/common.sh@353 -- # local d=2 00:06:12.742 13:17:08 json_config -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:12.742 13:17:08 json_config -- scripts/common.sh@355 -- # echo 2 00:06:12.742 13:17:08 json_config -- scripts/common.sh@366 -- # ver2[v]=2 00:06:12.742 13:17:08 json_config -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:12.742 13:17:08 json_config -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:12.742 13:17:08 json_config -- scripts/common.sh@368 -- # return 0 00:06:12.742 13:17:08 json_config -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:12.742 13:17:08 json_config -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:12.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.742 --rc genhtml_branch_coverage=1 00:06:12.742 --rc genhtml_function_coverage=1 00:06:12.742 --rc genhtml_legend=1 00:06:12.742 --rc geninfo_all_blocks=1 00:06:12.742 --rc geninfo_unexecuted_blocks=1 00:06:12.742 00:06:12.742 ' 00:06:12.742 13:17:08 json_config -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:12.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.742 --rc genhtml_branch_coverage=1 00:06:12.742 --rc genhtml_function_coverage=1 00:06:12.742 --rc genhtml_legend=1 00:06:12.742 --rc geninfo_all_blocks=1 00:06:12.742 --rc geninfo_unexecuted_blocks=1 00:06:12.742 00:06:12.742 ' 00:06:12.742 13:17:08 json_config -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:12.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.742 --rc genhtml_branch_coverage=1 00:06:12.742 --rc genhtml_function_coverage=1 00:06:12.742 --rc genhtml_legend=1 00:06:12.742 --rc geninfo_all_blocks=1 00:06:12.742 --rc geninfo_unexecuted_blocks=1 00:06:12.742 00:06:12.742 ' 00:06:12.742 13:17:08 json_config -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:12.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:12.742 --rc genhtml_branch_coverage=1 00:06:12.742 --rc genhtml_function_coverage=1 00:06:12.742 --rc genhtml_legend=1 00:06:12.742 --rc geninfo_all_blocks=1 00:06:12.742 --rc geninfo_unexecuted_blocks=1 00:06:12.742 00:06:12.742 ' 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@7 -- # uname -s 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:12.742 13:17:08 json_config -- scripts/common.sh@15 -- # shopt -s extglob 00:06:12.742 13:17:08 json_config -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:12.742 13:17:08 json_config -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:12.742 13:17:08 json_config -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:12.742 13:17:08 json_config -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:12.742 13:17:08 json_config -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:12.742 13:17:08 json_config -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:12.742 13:17:08 json_config -- paths/export.sh@5 -- # export PATH 00:06:12.742 13:17:08 json_config -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@51 -- # : 0 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:06:12.742 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:06:12.742 13:17:08 json_config -- nvmf/common.sh@55 -- # have_pci_nics=0 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/common.sh 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@31 -- # declare -A app_pid 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@32 -- # declare -A app_socket 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@33 -- # declare -A app_params 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@34 -- # declare -A configs_path 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@40 -- # last_event_id=0 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@362 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@363 -- # echo 'INFO: JSON configuration test init' 00:06:12.742 INFO: JSON configuration test init 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@364 -- # json_config_test_init 00:06:12.742 13:17:08 json_config -- json_config/json_config.sh@269 -- # timing_enter json_config_test_init 00:06:12.742 13:17:08 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:12.742 13:17:08 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:13.002 13:17:08 json_config -- json_config/json_config.sh@270 -- # timing_enter json_config_setup_target 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:13.002 13:17:08 json_config -- json_config/json_config.sh@272 -- # json_config_test_start_app target --wait-for-rpc 00:06:13.002 13:17:08 json_config -- json_config/common.sh@9 -- # local app=target 00:06:13.002 13:17:08 json_config -- json_config/common.sh@10 -- # shift 00:06:13.002 13:17:08 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:13.002 13:17:08 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:13.002 13:17:08 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:06:13.002 13:17:08 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:13.002 13:17:08 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:13.002 13:17:08 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=514210 00:06:13.002 13:17:08 json_config -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:06:13.002 13:17:08 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:13.002 Waiting for target to run... 00:06:13.002 13:17:08 json_config -- json_config/common.sh@25 -- # waitforlisten 514210 /var/tmp/spdk_tgt.sock 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@831 -- # '[' -z 514210 ']' 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:13.002 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:13.002 13:17:08 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:13.002 [2024-10-07 13:17:08.739405] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:13.002 [2024-10-07 13:17:08.739526] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid514210 ] 00:06:13.569 [2024-10-07 13:17:09.275681] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.569 [2024-10-07 13:17:09.368393] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.827 13:17:09 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:13.827 13:17:09 json_config -- common/autotest_common.sh@864 -- # return 0 00:06:13.827 13:17:09 json_config -- json_config/common.sh@26 -- # echo '' 00:06:13.827 00:06:13.827 13:17:09 json_config -- json_config/json_config.sh@276 -- # create_accel_config 00:06:13.827 13:17:09 json_config -- json_config/json_config.sh@100 -- # timing_enter create_accel_config 00:06:13.827 13:17:09 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:13.827 13:17:09 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:13.827 13:17:09 json_config -- json_config/json_config.sh@102 -- # [[ 0 -eq 1 ]] 00:06:13.827 13:17:09 json_config -- json_config/json_config.sh@108 -- # timing_exit create_accel_config 00:06:13.827 13:17:09 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:13.827 13:17:09 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:13.827 13:17:09 json_config -- json_config/json_config.sh@280 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:06:13.827 13:17:09 json_config -- json_config/json_config.sh@281 -- # tgt_rpc load_config 00:06:13.827 13:17:09 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@283 -- # tgt_check_notification_types 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:06:17.120 13:17:12 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:17.120 13:17:12 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@45 -- # local ret=0 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@46 -- # local enabled_types 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@47 -- # [[ y == y ]] 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@48 -- # enabled_types+=("fsdev_register" "fsdev_unregister") 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:06:17.120 13:17:12 json_config -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:06:17.120 13:17:12 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@51 -- # get_types=('fsdev_register' 'fsdev_unregister' 'bdev_register' 'bdev_unregister') 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@51 -- # local get_types 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@53 -- # local type_diff 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@54 -- # echo bdev_register bdev_unregister fsdev_register fsdev_unregister fsdev_register fsdev_unregister bdev_register bdev_unregister 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@54 -- # tr ' ' '\n' 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@54 -- # sort 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@54 -- # uniq -u 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@54 -- # type_diff= 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@56 -- # [[ -n '' ]] 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@61 -- # timing_exit tgt_check_notification_types 00:06:17.378 13:17:13 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:17.378 13:17:13 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@62 -- # return 0 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@285 -- # [[ 0 -eq 1 ]] 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@289 -- # [[ 0 -eq 1 ]] 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@293 -- # [[ 0 -eq 1 ]] 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@297 -- # [[ 1 -eq 1 ]] 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@298 -- # create_nvmf_subsystem_config 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@237 -- # timing_enter create_nvmf_subsystem_config 00:06:17.378 13:17:13 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:17.378 13:17:13 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@239 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@240 -- # [[ tcp == \r\d\m\a ]] 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@244 -- # [[ -z 127.0.0.1 ]] 00:06:17.378 13:17:13 json_config -- json_config/json_config.sh@249 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:17.378 13:17:13 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:17.636 MallocForNvmf0 00:06:17.636 13:17:13 json_config -- json_config/json_config.sh@250 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:17.636 13:17:13 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:17.894 MallocForNvmf1 00:06:17.894 13:17:13 json_config -- json_config/json_config.sh@252 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:06:17.894 13:17:13 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:06:18.151 [2024-10-07 13:17:14.032589] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:18.151 13:17:14 json_config -- json_config/json_config.sh@253 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:18.151 13:17:14 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:18.409 13:17:14 json_config -- json_config/json_config.sh@254 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:18.409 13:17:14 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:18.666 13:17:14 json_config -- json_config/json_config.sh@255 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:18.667 13:17:14 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:19.232 13:17:14 json_config -- json_config/json_config.sh@256 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:19.232 13:17:14 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:06:19.232 [2024-10-07 13:17:15.112052] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:19.232 13:17:15 json_config -- json_config/json_config.sh@258 -- # timing_exit create_nvmf_subsystem_config 00:06:19.232 13:17:15 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:19.232 13:17:15 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:19.232 13:17:15 json_config -- json_config/json_config.sh@300 -- # timing_exit json_config_setup_target 00:06:19.232 13:17:15 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:19.232 13:17:15 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:19.490 13:17:15 json_config -- json_config/json_config.sh@302 -- # [[ 0 -eq 1 ]] 00:06:19.490 13:17:15 json_config -- json_config/json_config.sh@307 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:19.490 13:17:15 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:19.748 MallocBdevForConfigChangeCheck 00:06:19.748 13:17:15 json_config -- json_config/json_config.sh@309 -- # timing_exit json_config_test_init 00:06:19.748 13:17:15 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:19.748 13:17:15 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:19.748 13:17:15 json_config -- json_config/json_config.sh@366 -- # tgt_rpc save_config 00:06:19.748 13:17:15 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:20.006 13:17:15 json_config -- json_config/json_config.sh@368 -- # echo 'INFO: shutting down applications...' 00:06:20.006 INFO: shutting down applications... 00:06:20.006 13:17:15 json_config -- json_config/json_config.sh@369 -- # [[ 0 -eq 1 ]] 00:06:20.006 13:17:15 json_config -- json_config/json_config.sh@375 -- # json_config_clear target 00:06:20.006 13:17:15 json_config -- json_config/json_config.sh@339 -- # [[ -n 22 ]] 00:06:20.006 13:17:15 json_config -- json_config/json_config.sh@340 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:21.903 Calling clear_iscsi_subsystem 00:06:21.903 Calling clear_nvmf_subsystem 00:06:21.903 Calling clear_nbd_subsystem 00:06:21.903 Calling clear_ublk_subsystem 00:06:21.903 Calling clear_vhost_blk_subsystem 00:06:21.903 Calling clear_vhost_scsi_subsystem 00:06:21.903 Calling clear_bdev_subsystem 00:06:21.903 13:17:17 json_config -- json_config/json_config.sh@344 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:06:21.903 13:17:17 json_config -- json_config/json_config.sh@350 -- # count=100 00:06:21.903 13:17:17 json_config -- json_config/json_config.sh@351 -- # '[' 100 -gt 0 ']' 00:06:21.903 13:17:17 json_config -- json_config/json_config.sh@352 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:21.903 13:17:17 json_config -- json_config/json_config.sh@352 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:21.903 13:17:17 json_config -- json_config/json_config.sh@352 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:22.161 13:17:17 json_config -- json_config/json_config.sh@352 -- # break 00:06:22.161 13:17:17 json_config -- json_config/json_config.sh@357 -- # '[' 100 -eq 0 ']' 00:06:22.161 13:17:17 json_config -- json_config/json_config.sh@376 -- # json_config_test_shutdown_app target 00:06:22.161 13:17:17 json_config -- json_config/common.sh@31 -- # local app=target 00:06:22.161 13:17:17 json_config -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:22.161 13:17:17 json_config -- json_config/common.sh@35 -- # [[ -n 514210 ]] 00:06:22.161 13:17:17 json_config -- json_config/common.sh@38 -- # kill -SIGINT 514210 00:06:22.161 13:17:17 json_config -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:22.161 13:17:17 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:22.161 13:17:17 json_config -- json_config/common.sh@41 -- # kill -0 514210 00:06:22.161 13:17:17 json_config -- json_config/common.sh@45 -- # sleep 0.5 00:06:22.731 13:17:18 json_config -- json_config/common.sh@40 -- # (( i++ )) 00:06:22.731 13:17:18 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:22.731 13:17:18 json_config -- json_config/common.sh@41 -- # kill -0 514210 00:06:22.731 13:17:18 json_config -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:22.731 13:17:18 json_config -- json_config/common.sh@43 -- # break 00:06:22.731 13:17:18 json_config -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:22.731 13:17:18 json_config -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:22.731 SPDK target shutdown done 00:06:22.731 13:17:18 json_config -- json_config/json_config.sh@378 -- # echo 'INFO: relaunching applications...' 00:06:22.731 INFO: relaunching applications... 00:06:22.731 13:17:18 json_config -- json_config/json_config.sh@379 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:22.731 13:17:18 json_config -- json_config/common.sh@9 -- # local app=target 00:06:22.731 13:17:18 json_config -- json_config/common.sh@10 -- # shift 00:06:22.731 13:17:18 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:22.731 13:17:18 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:22.731 13:17:18 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:06:22.731 13:17:18 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:22.731 13:17:18 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:22.731 13:17:18 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=515535 00:06:22.731 13:17:18 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:22.731 Waiting for target to run... 00:06:22.731 13:17:18 json_config -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:22.731 13:17:18 json_config -- json_config/common.sh@25 -- # waitforlisten 515535 /var/tmp/spdk_tgt.sock 00:06:22.731 13:17:18 json_config -- common/autotest_common.sh@831 -- # '[' -z 515535 ']' 00:06:22.731 13:17:18 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:22.731 13:17:18 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:22.731 13:17:18 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:22.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:22.731 13:17:18 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:22.731 13:17:18 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:22.731 [2024-10-07 13:17:18.512338] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:22.731 [2024-10-07 13:17:18.512416] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid515535 ] 00:06:22.989 [2024-10-07 13:17:18.841199] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.989 [2024-10-07 13:17:18.919784] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.276 [2024-10-07 13:17:21.970721] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:26.276 [2024-10-07 13:17:22.003255] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:06:26.276 13:17:22 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:26.276 13:17:22 json_config -- common/autotest_common.sh@864 -- # return 0 00:06:26.276 13:17:22 json_config -- json_config/common.sh@26 -- # echo '' 00:06:26.276 00:06:26.276 13:17:22 json_config -- json_config/json_config.sh@380 -- # [[ 0 -eq 1 ]] 00:06:26.276 13:17:22 json_config -- json_config/json_config.sh@384 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:26.276 INFO: Checking if target configuration is the same... 00:06:26.276 13:17:22 json_config -- json_config/json_config.sh@385 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:26.276 13:17:22 json_config -- json_config/json_config.sh@385 -- # tgt_rpc save_config 00:06:26.276 13:17:22 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:26.276 + '[' 2 -ne 2 ']' 00:06:26.276 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:26.276 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:26.276 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:26.276 +++ basename /dev/fd/62 00:06:26.276 ++ mktemp /tmp/62.XXX 00:06:26.276 + tmp_file_1=/tmp/62.6Oc 00:06:26.276 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:26.277 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:26.277 + tmp_file_2=/tmp/spdk_tgt_config.json.Y24 00:06:26.277 + ret=0 00:06:26.277 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:26.535 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:26.793 + diff -u /tmp/62.6Oc /tmp/spdk_tgt_config.json.Y24 00:06:26.793 + echo 'INFO: JSON config files are the same' 00:06:26.793 INFO: JSON config files are the same 00:06:26.793 + rm /tmp/62.6Oc /tmp/spdk_tgt_config.json.Y24 00:06:26.793 + exit 0 00:06:26.793 13:17:22 json_config -- json_config/json_config.sh@386 -- # [[ 0 -eq 1 ]] 00:06:26.793 13:17:22 json_config -- json_config/json_config.sh@391 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:26.793 INFO: changing configuration and checking if this can be detected... 00:06:26.793 13:17:22 json_config -- json_config/json_config.sh@393 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:26.793 13:17:22 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:27.051 13:17:22 json_config -- json_config/json_config.sh@394 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:27.051 13:17:22 json_config -- json_config/json_config.sh@394 -- # tgt_rpc save_config 00:06:27.051 13:17:22 json_config -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:27.051 + '[' 2 -ne 2 ']' 00:06:27.051 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:27.051 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:06:27.051 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:27.051 +++ basename /dev/fd/62 00:06:27.051 ++ mktemp /tmp/62.XXX 00:06:27.051 + tmp_file_1=/tmp/62.0Qu 00:06:27.051 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:27.051 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:27.051 + tmp_file_2=/tmp/spdk_tgt_config.json.H1e 00:06:27.051 + ret=0 00:06:27.051 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:27.310 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:27.310 + diff -u /tmp/62.0Qu /tmp/spdk_tgt_config.json.H1e 00:06:27.310 + ret=1 00:06:27.310 + echo '=== Start of file: /tmp/62.0Qu ===' 00:06:27.310 + cat /tmp/62.0Qu 00:06:27.310 + echo '=== End of file: /tmp/62.0Qu ===' 00:06:27.310 + echo '' 00:06:27.310 + echo '=== Start of file: /tmp/spdk_tgt_config.json.H1e ===' 00:06:27.310 + cat /tmp/spdk_tgt_config.json.H1e 00:06:27.310 + echo '=== End of file: /tmp/spdk_tgt_config.json.H1e ===' 00:06:27.310 + echo '' 00:06:27.310 + rm /tmp/62.0Qu /tmp/spdk_tgt_config.json.H1e 00:06:27.310 + exit 1 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@398 -- # echo 'INFO: configuration change detected.' 00:06:27.310 INFO: configuration change detected. 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@401 -- # json_config_test_fini 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@313 -- # timing_enter json_config_test_fini 00:06:27.310 13:17:23 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:27.310 13:17:23 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@314 -- # local ret=0 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@316 -- # [[ -n '' ]] 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@324 -- # [[ -n 515535 ]] 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@327 -- # cleanup_bdev_subsystem_config 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@191 -- # timing_enter cleanup_bdev_subsystem_config 00:06:27.310 13:17:23 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:27.310 13:17:23 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:27.310 13:17:23 json_config -- json_config/json_config.sh@193 -- # [[ 0 -eq 1 ]] 00:06:27.569 13:17:23 json_config -- json_config/json_config.sh@200 -- # uname -s 00:06:27.569 13:17:23 json_config -- json_config/json_config.sh@200 -- # [[ Linux = Linux ]] 00:06:27.569 13:17:23 json_config -- json_config/json_config.sh@201 -- # rm -f /sample_aio 00:06:27.569 13:17:23 json_config -- json_config/json_config.sh@204 -- # [[ 0 -eq 1 ]] 00:06:27.569 13:17:23 json_config -- json_config/json_config.sh@208 -- # timing_exit cleanup_bdev_subsystem_config 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:27.569 13:17:23 json_config -- json_config/json_config.sh@330 -- # killprocess 515535 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@950 -- # '[' -z 515535 ']' 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@954 -- # kill -0 515535 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@955 -- # uname 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 515535 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@968 -- # echo 'killing process with pid 515535' 00:06:27.569 killing process with pid 515535 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@969 -- # kill 515535 00:06:27.569 13:17:23 json_config -- common/autotest_common.sh@974 -- # wait 515535 00:06:29.469 13:17:25 json_config -- json_config/json_config.sh@333 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:06:29.469 13:17:25 json_config -- json_config/json_config.sh@334 -- # timing_exit json_config_test_fini 00:06:29.469 13:17:25 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:29.469 13:17:25 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:29.469 13:17:25 json_config -- json_config/json_config.sh@335 -- # return 0 00:06:29.469 13:17:25 json_config -- json_config/json_config.sh@403 -- # echo 'INFO: Success' 00:06:29.469 INFO: Success 00:06:29.469 00:06:29.469 real 0m16.498s 00:06:29.469 user 0m18.103s 00:06:29.469 sys 0m2.626s 00:06:29.469 13:17:25 json_config -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:29.469 13:17:25 json_config -- common/autotest_common.sh@10 -- # set +x 00:06:29.469 ************************************ 00:06:29.469 END TEST json_config 00:06:29.469 ************************************ 00:06:29.469 13:17:25 -- spdk/autotest.sh@160 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:29.469 13:17:25 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:29.469 13:17:25 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:29.469 13:17:25 -- common/autotest_common.sh@10 -- # set +x 00:06:29.469 ************************************ 00:06:29.469 START TEST json_config_extra_key 00:06:29.469 ************************************ 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1681 -- # lcov --version 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@336 -- # IFS=.-: 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@336 -- # read -ra ver1 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@337 -- # IFS=.-: 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@337 -- # read -ra ver2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@338 -- # local 'op=<' 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@340 -- # ver1_l=2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@341 -- # ver2_l=1 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@344 -- # case "$op" in 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@345 -- # : 1 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@365 -- # decimal 1 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@353 -- # local d=1 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@355 -- # echo 1 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@365 -- # ver1[v]=1 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@366 -- # decimal 2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@353 -- # local d=2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@355 -- # echo 2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@366 -- # ver2[v]=2 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@368 -- # return 0 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:29.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.469 --rc genhtml_branch_coverage=1 00:06:29.469 --rc genhtml_function_coverage=1 00:06:29.469 --rc genhtml_legend=1 00:06:29.469 --rc geninfo_all_blocks=1 00:06:29.469 --rc geninfo_unexecuted_blocks=1 00:06:29.469 00:06:29.469 ' 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:29.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.469 --rc genhtml_branch_coverage=1 00:06:29.469 --rc genhtml_function_coverage=1 00:06:29.469 --rc genhtml_legend=1 00:06:29.469 --rc geninfo_all_blocks=1 00:06:29.469 --rc geninfo_unexecuted_blocks=1 00:06:29.469 00:06:29.469 ' 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:29.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.469 --rc genhtml_branch_coverage=1 00:06:29.469 --rc genhtml_function_coverage=1 00:06:29.469 --rc genhtml_legend=1 00:06:29.469 --rc geninfo_all_blocks=1 00:06:29.469 --rc geninfo_unexecuted_blocks=1 00:06:29.469 00:06:29.469 ' 00:06:29.469 13:17:25 json_config_extra_key -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:29.469 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.469 --rc genhtml_branch_coverage=1 00:06:29.469 --rc genhtml_function_coverage=1 00:06:29.469 --rc genhtml_legend=1 00:06:29.469 --rc geninfo_all_blocks=1 00:06:29.469 --rc geninfo_unexecuted_blocks=1 00:06:29.469 00:06:29.469 ' 00:06:29.469 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@7 -- # uname -s 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@15 -- # shopt -s extglob 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:29.469 13:17:25 json_config_extra_key -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:29.469 13:17:25 json_config_extra_key -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:29.469 13:17:25 json_config_extra_key -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:29.469 13:17:25 json_config_extra_key -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:29.469 13:17:25 json_config_extra_key -- paths/export.sh@5 -- # export PATH 00:06:29.469 13:17:25 json_config_extra_key -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@51 -- # : 0 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:06:29.469 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:06:29.469 13:17:25 json_config_extra_key -- nvmf/common.sh@55 -- # have_pci_nics=0 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/common.sh 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:06:29.470 INFO: launching applications... 00:06:29.470 13:17:25 json_config_extra_key -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@9 -- # local app=target 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@10 -- # shift 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@15 -- # local app_extra_params= 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@22 -- # app_pid["$app"]=516450 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:29.470 Waiting for target to run... 00:06:29.470 13:17:25 json_config_extra_key -- json_config/common.sh@25 -- # waitforlisten 516450 /var/tmp/spdk_tgt.sock 00:06:29.470 13:17:25 json_config_extra_key -- common/autotest_common.sh@831 -- # '[' -z 516450 ']' 00:06:29.470 13:17:25 json_config_extra_key -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:29.470 13:17:25 json_config_extra_key -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:29.470 13:17:25 json_config_extra_key -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:29.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:29.470 13:17:25 json_config_extra_key -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:29.470 13:17:25 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:06:29.470 [2024-10-07 13:17:25.275511] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:29.470 [2024-10-07 13:17:25.275594] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid516450 ] 00:06:29.728 [2024-10-07 13:17:25.605418] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.986 [2024-10-07 13:17:25.683703] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.551 13:17:26 json_config_extra_key -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:30.551 13:17:26 json_config_extra_key -- common/autotest_common.sh@864 -- # return 0 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@26 -- # echo '' 00:06:30.551 00:06:30.551 13:17:26 json_config_extra_key -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:06:30.551 INFO: shutting down applications... 00:06:30.551 13:17:26 json_config_extra_key -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@31 -- # local app=target 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@35 -- # [[ -n 516450 ]] 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@38 -- # kill -SIGINT 516450 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 516450 00:06:30.551 13:17:26 json_config_extra_key -- json_config/common.sh@45 -- # sleep 0.5 00:06:31.117 13:17:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i++ )) 00:06:31.117 13:17:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:31.117 13:17:26 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 516450 00:06:31.117 13:17:26 json_config_extra_key -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:31.117 13:17:26 json_config_extra_key -- json_config/common.sh@43 -- # break 00:06:31.117 13:17:26 json_config_extra_key -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:31.117 13:17:26 json_config_extra_key -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:31.117 SPDK target shutdown done 00:06:31.117 13:17:26 json_config_extra_key -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:06:31.117 Success 00:06:31.117 00:06:31.117 real 0m1.672s 00:06:31.117 user 0m1.697s 00:06:31.117 sys 0m0.449s 00:06:31.117 13:17:26 json_config_extra_key -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:31.117 13:17:26 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:06:31.117 ************************************ 00:06:31.117 END TEST json_config_extra_key 00:06:31.117 ************************************ 00:06:31.117 13:17:26 -- spdk/autotest.sh@161 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:31.117 13:17:26 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:31.117 13:17:26 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:31.117 13:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:31.117 ************************************ 00:06:31.117 START TEST alias_rpc 00:06:31.117 ************************************ 00:06:31.117 13:17:26 alias_rpc -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:31.117 * Looking for test storage... 00:06:31.117 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:31.117 13:17:26 alias_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:31.117 13:17:26 alias_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:06:31.117 13:17:26 alias_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:31.117 13:17:26 alias_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:06:31.117 13:17:26 alias_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@344 -- # case "$op" in 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@345 -- # : 1 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@365 -- # decimal 1 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@353 -- # local d=1 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@355 -- # echo 1 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@366 -- # decimal 2 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@353 -- # local d=2 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@355 -- # echo 2 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:31.118 13:17:26 alias_rpc -- scripts/common.sh@368 -- # return 0 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:31.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.118 --rc genhtml_branch_coverage=1 00:06:31.118 --rc genhtml_function_coverage=1 00:06:31.118 --rc genhtml_legend=1 00:06:31.118 --rc geninfo_all_blocks=1 00:06:31.118 --rc geninfo_unexecuted_blocks=1 00:06:31.118 00:06:31.118 ' 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:31.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.118 --rc genhtml_branch_coverage=1 00:06:31.118 --rc genhtml_function_coverage=1 00:06:31.118 --rc genhtml_legend=1 00:06:31.118 --rc geninfo_all_blocks=1 00:06:31.118 --rc geninfo_unexecuted_blocks=1 00:06:31.118 00:06:31.118 ' 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:31.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.118 --rc genhtml_branch_coverage=1 00:06:31.118 --rc genhtml_function_coverage=1 00:06:31.118 --rc genhtml_legend=1 00:06:31.118 --rc geninfo_all_blocks=1 00:06:31.118 --rc geninfo_unexecuted_blocks=1 00:06:31.118 00:06:31.118 ' 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:31.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.118 --rc genhtml_branch_coverage=1 00:06:31.118 --rc genhtml_function_coverage=1 00:06:31.118 --rc genhtml_legend=1 00:06:31.118 --rc geninfo_all_blocks=1 00:06:31.118 --rc geninfo_unexecuted_blocks=1 00:06:31.118 00:06:31.118 ' 00:06:31.118 13:17:26 alias_rpc -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:31.118 13:17:26 alias_rpc -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=516651 00:06:31.118 13:17:26 alias_rpc -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:31.118 13:17:26 alias_rpc -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 516651 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@831 -- # '[' -z 516651 ']' 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:31.118 13:17:26 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:31.118 [2024-10-07 13:17:27.004208] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:31.118 [2024-10-07 13:17:27.004290] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid516651 ] 00:06:31.376 [2024-10-07 13:17:27.065548] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.376 [2024-10-07 13:17:27.176237] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.634 13:17:27 alias_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:31.634 13:17:27 alias_rpc -- common/autotest_common.sh@864 -- # return 0 00:06:31.634 13:17:27 alias_rpc -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:31.892 13:17:27 alias_rpc -- alias_rpc/alias_rpc.sh@19 -- # killprocess 516651 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@950 -- # '[' -z 516651 ']' 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@954 -- # kill -0 516651 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@955 -- # uname 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 516651 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 516651' 00:06:31.892 killing process with pid 516651 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@969 -- # kill 516651 00:06:31.892 13:17:27 alias_rpc -- common/autotest_common.sh@974 -- # wait 516651 00:06:32.457 00:06:32.457 real 0m1.419s 00:06:32.457 user 0m1.529s 00:06:32.457 sys 0m0.455s 00:06:32.457 13:17:28 alias_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:32.457 13:17:28 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:06:32.457 ************************************ 00:06:32.457 END TEST alias_rpc 00:06:32.457 ************************************ 00:06:32.457 13:17:28 -- spdk/autotest.sh@163 -- # [[ 0 -eq 0 ]] 00:06:32.457 13:17:28 -- spdk/autotest.sh@164 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:32.457 13:17:28 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:32.457 13:17:28 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:32.457 13:17:28 -- common/autotest_common.sh@10 -- # set +x 00:06:32.457 ************************************ 00:06:32.457 START TEST spdkcli_tcp 00:06:32.457 ************************************ 00:06:32.457 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:32.457 * Looking for test storage... 00:06:32.457 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:32.457 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:32.457 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1681 -- # lcov --version 00:06:32.457 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@336 -- # IFS=.-: 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@336 -- # read -ra ver1 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@337 -- # IFS=.-: 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@337 -- # read -ra ver2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@338 -- # local 'op=<' 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@340 -- # ver1_l=2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@341 -- # ver2_l=1 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@344 -- # case "$op" in 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@345 -- # : 1 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@365 -- # decimal 1 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@353 -- # local d=1 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@355 -- # echo 1 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@365 -- # ver1[v]=1 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@366 -- # decimal 2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@353 -- # local d=2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@355 -- # echo 2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@366 -- # ver2[v]=2 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:32.714 13:17:28 spdkcli_tcp -- scripts/common.sh@368 -- # return 0 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:32.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.714 --rc genhtml_branch_coverage=1 00:06:32.714 --rc genhtml_function_coverage=1 00:06:32.714 --rc genhtml_legend=1 00:06:32.714 --rc geninfo_all_blocks=1 00:06:32.714 --rc geninfo_unexecuted_blocks=1 00:06:32.714 00:06:32.714 ' 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:32.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.714 --rc genhtml_branch_coverage=1 00:06:32.714 --rc genhtml_function_coverage=1 00:06:32.714 --rc genhtml_legend=1 00:06:32.714 --rc geninfo_all_blocks=1 00:06:32.714 --rc geninfo_unexecuted_blocks=1 00:06:32.714 00:06:32.714 ' 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:32.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.714 --rc genhtml_branch_coverage=1 00:06:32.714 --rc genhtml_function_coverage=1 00:06:32.714 --rc genhtml_legend=1 00:06:32.714 --rc geninfo_all_blocks=1 00:06:32.714 --rc geninfo_unexecuted_blocks=1 00:06:32.714 00:06:32.714 ' 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:32.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.714 --rc genhtml_branch_coverage=1 00:06:32.714 --rc genhtml_function_coverage=1 00:06:32.714 --rc genhtml_legend=1 00:06:32.714 --rc geninfo_all_blocks=1 00:06:32.714 --rc geninfo_unexecuted_blocks=1 00:06:32.714 00:06:32.714 ' 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=516961 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:32.714 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@27 -- # waitforlisten 516961 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@831 -- # '[' -z 516961 ']' 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:32.714 13:17:28 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:06:32.714 [2024-10-07 13:17:28.476727] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:32.714 [2024-10-07 13:17:28.476835] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid516961 ] 00:06:32.714 [2024-10-07 13:17:28.536410] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:32.714 [2024-10-07 13:17:28.644299] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:32.714 [2024-10-07 13:17:28.644304] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.280 13:17:28 spdkcli_tcp -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:33.280 13:17:28 spdkcli_tcp -- common/autotest_common.sh@864 -- # return 0 00:06:33.280 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@31 -- # socat_pid=516976 00:06:33.280 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:33.280 13:17:28 spdkcli_tcp -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:33.280 [ 00:06:33.280 "bdev_malloc_delete", 00:06:33.280 "bdev_malloc_create", 00:06:33.280 "bdev_null_resize", 00:06:33.280 "bdev_null_delete", 00:06:33.280 "bdev_null_create", 00:06:33.280 "bdev_nvme_cuse_unregister", 00:06:33.280 "bdev_nvme_cuse_register", 00:06:33.280 "bdev_opal_new_user", 00:06:33.280 "bdev_opal_set_lock_state", 00:06:33.280 "bdev_opal_delete", 00:06:33.280 "bdev_opal_get_info", 00:06:33.280 "bdev_opal_create", 00:06:33.280 "bdev_nvme_opal_revert", 00:06:33.280 "bdev_nvme_opal_init", 00:06:33.280 "bdev_nvme_send_cmd", 00:06:33.280 "bdev_nvme_set_keys", 00:06:33.280 "bdev_nvme_get_path_iostat", 00:06:33.280 "bdev_nvme_get_mdns_discovery_info", 00:06:33.280 "bdev_nvme_stop_mdns_discovery", 00:06:33.280 "bdev_nvme_start_mdns_discovery", 00:06:33.280 "bdev_nvme_set_multipath_policy", 00:06:33.280 "bdev_nvme_set_preferred_path", 00:06:33.280 "bdev_nvme_get_io_paths", 00:06:33.280 "bdev_nvme_remove_error_injection", 00:06:33.280 "bdev_nvme_add_error_injection", 00:06:33.280 "bdev_nvme_get_discovery_info", 00:06:33.280 "bdev_nvme_stop_discovery", 00:06:33.280 "bdev_nvme_start_discovery", 00:06:33.280 "bdev_nvme_get_controller_health_info", 00:06:33.280 "bdev_nvme_disable_controller", 00:06:33.280 "bdev_nvme_enable_controller", 00:06:33.280 "bdev_nvme_reset_controller", 00:06:33.280 "bdev_nvme_get_transport_statistics", 00:06:33.280 "bdev_nvme_apply_firmware", 00:06:33.280 "bdev_nvme_detach_controller", 00:06:33.280 "bdev_nvme_get_controllers", 00:06:33.280 "bdev_nvme_attach_controller", 00:06:33.280 "bdev_nvme_set_hotplug", 00:06:33.280 "bdev_nvme_set_options", 00:06:33.280 "bdev_passthru_delete", 00:06:33.280 "bdev_passthru_create", 00:06:33.280 "bdev_lvol_set_parent_bdev", 00:06:33.280 "bdev_lvol_set_parent", 00:06:33.280 "bdev_lvol_check_shallow_copy", 00:06:33.280 "bdev_lvol_start_shallow_copy", 00:06:33.280 "bdev_lvol_grow_lvstore", 00:06:33.280 "bdev_lvol_get_lvols", 00:06:33.280 "bdev_lvol_get_lvstores", 00:06:33.280 "bdev_lvol_delete", 00:06:33.280 "bdev_lvol_set_read_only", 00:06:33.280 "bdev_lvol_resize", 00:06:33.280 "bdev_lvol_decouple_parent", 00:06:33.280 "bdev_lvol_inflate", 00:06:33.280 "bdev_lvol_rename", 00:06:33.280 "bdev_lvol_clone_bdev", 00:06:33.280 "bdev_lvol_clone", 00:06:33.280 "bdev_lvol_snapshot", 00:06:33.280 "bdev_lvol_create", 00:06:33.280 "bdev_lvol_delete_lvstore", 00:06:33.280 "bdev_lvol_rename_lvstore", 00:06:33.280 "bdev_lvol_create_lvstore", 00:06:33.280 "bdev_raid_set_options", 00:06:33.280 "bdev_raid_remove_base_bdev", 00:06:33.280 "bdev_raid_add_base_bdev", 00:06:33.280 "bdev_raid_delete", 00:06:33.280 "bdev_raid_create", 00:06:33.280 "bdev_raid_get_bdevs", 00:06:33.280 "bdev_error_inject_error", 00:06:33.280 "bdev_error_delete", 00:06:33.280 "bdev_error_create", 00:06:33.280 "bdev_split_delete", 00:06:33.280 "bdev_split_create", 00:06:33.280 "bdev_delay_delete", 00:06:33.280 "bdev_delay_create", 00:06:33.280 "bdev_delay_update_latency", 00:06:33.280 "bdev_zone_block_delete", 00:06:33.280 "bdev_zone_block_create", 00:06:33.280 "blobfs_create", 00:06:33.280 "blobfs_detect", 00:06:33.280 "blobfs_set_cache_size", 00:06:33.280 "bdev_aio_delete", 00:06:33.280 "bdev_aio_rescan", 00:06:33.280 "bdev_aio_create", 00:06:33.280 "bdev_ftl_set_property", 00:06:33.280 "bdev_ftl_get_properties", 00:06:33.280 "bdev_ftl_get_stats", 00:06:33.280 "bdev_ftl_unmap", 00:06:33.280 "bdev_ftl_unload", 00:06:33.280 "bdev_ftl_delete", 00:06:33.280 "bdev_ftl_load", 00:06:33.280 "bdev_ftl_create", 00:06:33.280 "bdev_virtio_attach_controller", 00:06:33.280 "bdev_virtio_scsi_get_devices", 00:06:33.280 "bdev_virtio_detach_controller", 00:06:33.280 "bdev_virtio_blk_set_hotplug", 00:06:33.280 "bdev_iscsi_delete", 00:06:33.280 "bdev_iscsi_create", 00:06:33.280 "bdev_iscsi_set_options", 00:06:33.280 "accel_error_inject_error", 00:06:33.280 "ioat_scan_accel_module", 00:06:33.280 "dsa_scan_accel_module", 00:06:33.280 "iaa_scan_accel_module", 00:06:33.280 "vfu_virtio_create_fs_endpoint", 00:06:33.280 "vfu_virtio_create_scsi_endpoint", 00:06:33.280 "vfu_virtio_scsi_remove_target", 00:06:33.280 "vfu_virtio_scsi_add_target", 00:06:33.280 "vfu_virtio_create_blk_endpoint", 00:06:33.280 "vfu_virtio_delete_endpoint", 00:06:33.280 "keyring_file_remove_key", 00:06:33.280 "keyring_file_add_key", 00:06:33.280 "keyring_linux_set_options", 00:06:33.280 "fsdev_aio_delete", 00:06:33.280 "fsdev_aio_create", 00:06:33.280 "iscsi_get_histogram", 00:06:33.280 "iscsi_enable_histogram", 00:06:33.280 "iscsi_set_options", 00:06:33.280 "iscsi_get_auth_groups", 00:06:33.280 "iscsi_auth_group_remove_secret", 00:06:33.280 "iscsi_auth_group_add_secret", 00:06:33.280 "iscsi_delete_auth_group", 00:06:33.280 "iscsi_create_auth_group", 00:06:33.280 "iscsi_set_discovery_auth", 00:06:33.280 "iscsi_get_options", 00:06:33.280 "iscsi_target_node_request_logout", 00:06:33.280 "iscsi_target_node_set_redirect", 00:06:33.280 "iscsi_target_node_set_auth", 00:06:33.280 "iscsi_target_node_add_lun", 00:06:33.280 "iscsi_get_stats", 00:06:33.280 "iscsi_get_connections", 00:06:33.280 "iscsi_portal_group_set_auth", 00:06:33.280 "iscsi_start_portal_group", 00:06:33.280 "iscsi_delete_portal_group", 00:06:33.280 "iscsi_create_portal_group", 00:06:33.280 "iscsi_get_portal_groups", 00:06:33.280 "iscsi_delete_target_node", 00:06:33.280 "iscsi_target_node_remove_pg_ig_maps", 00:06:33.280 "iscsi_target_node_add_pg_ig_maps", 00:06:33.280 "iscsi_create_target_node", 00:06:33.280 "iscsi_get_target_nodes", 00:06:33.280 "iscsi_delete_initiator_group", 00:06:33.280 "iscsi_initiator_group_remove_initiators", 00:06:33.280 "iscsi_initiator_group_add_initiators", 00:06:33.280 "iscsi_create_initiator_group", 00:06:33.280 "iscsi_get_initiator_groups", 00:06:33.280 "nvmf_set_crdt", 00:06:33.280 "nvmf_set_config", 00:06:33.280 "nvmf_set_max_subsystems", 00:06:33.280 "nvmf_stop_mdns_prr", 00:06:33.280 "nvmf_publish_mdns_prr", 00:06:33.280 "nvmf_subsystem_get_listeners", 00:06:33.280 "nvmf_subsystem_get_qpairs", 00:06:33.280 "nvmf_subsystem_get_controllers", 00:06:33.280 "nvmf_get_stats", 00:06:33.280 "nvmf_get_transports", 00:06:33.280 "nvmf_create_transport", 00:06:33.280 "nvmf_get_targets", 00:06:33.280 "nvmf_delete_target", 00:06:33.280 "nvmf_create_target", 00:06:33.280 "nvmf_subsystem_allow_any_host", 00:06:33.280 "nvmf_subsystem_set_keys", 00:06:33.280 "nvmf_subsystem_remove_host", 00:06:33.280 "nvmf_subsystem_add_host", 00:06:33.280 "nvmf_ns_remove_host", 00:06:33.280 "nvmf_ns_add_host", 00:06:33.280 "nvmf_subsystem_remove_ns", 00:06:33.280 "nvmf_subsystem_set_ns_ana_group", 00:06:33.280 "nvmf_subsystem_add_ns", 00:06:33.280 "nvmf_subsystem_listener_set_ana_state", 00:06:33.280 "nvmf_discovery_get_referrals", 00:06:33.280 "nvmf_discovery_remove_referral", 00:06:33.280 "nvmf_discovery_add_referral", 00:06:33.280 "nvmf_subsystem_remove_listener", 00:06:33.280 "nvmf_subsystem_add_listener", 00:06:33.280 "nvmf_delete_subsystem", 00:06:33.280 "nvmf_create_subsystem", 00:06:33.280 "nvmf_get_subsystems", 00:06:33.280 "env_dpdk_get_mem_stats", 00:06:33.280 "nbd_get_disks", 00:06:33.280 "nbd_stop_disk", 00:06:33.280 "nbd_start_disk", 00:06:33.280 "ublk_recover_disk", 00:06:33.280 "ublk_get_disks", 00:06:33.280 "ublk_stop_disk", 00:06:33.280 "ublk_start_disk", 00:06:33.280 "ublk_destroy_target", 00:06:33.280 "ublk_create_target", 00:06:33.280 "virtio_blk_create_transport", 00:06:33.280 "virtio_blk_get_transports", 00:06:33.280 "vhost_controller_set_coalescing", 00:06:33.280 "vhost_get_controllers", 00:06:33.280 "vhost_delete_controller", 00:06:33.280 "vhost_create_blk_controller", 00:06:33.280 "vhost_scsi_controller_remove_target", 00:06:33.280 "vhost_scsi_controller_add_target", 00:06:33.280 "vhost_start_scsi_controller", 00:06:33.280 "vhost_create_scsi_controller", 00:06:33.280 "thread_set_cpumask", 00:06:33.280 "scheduler_set_options", 00:06:33.280 "framework_get_governor", 00:06:33.280 "framework_get_scheduler", 00:06:33.280 "framework_set_scheduler", 00:06:33.280 "framework_get_reactors", 00:06:33.280 "thread_get_io_channels", 00:06:33.280 "thread_get_pollers", 00:06:33.280 "thread_get_stats", 00:06:33.280 "framework_monitor_context_switch", 00:06:33.280 "spdk_kill_instance", 00:06:33.280 "log_enable_timestamps", 00:06:33.280 "log_get_flags", 00:06:33.280 "log_clear_flag", 00:06:33.280 "log_set_flag", 00:06:33.280 "log_get_level", 00:06:33.280 "log_set_level", 00:06:33.280 "log_get_print_level", 00:06:33.280 "log_set_print_level", 00:06:33.280 "framework_enable_cpumask_locks", 00:06:33.280 "framework_disable_cpumask_locks", 00:06:33.280 "framework_wait_init", 00:06:33.280 "framework_start_init", 00:06:33.280 "scsi_get_devices", 00:06:33.280 "bdev_get_histogram", 00:06:33.280 "bdev_enable_histogram", 00:06:33.280 "bdev_set_qos_limit", 00:06:33.280 "bdev_set_qd_sampling_period", 00:06:33.280 "bdev_get_bdevs", 00:06:33.280 "bdev_reset_iostat", 00:06:33.280 "bdev_get_iostat", 00:06:33.280 "bdev_examine", 00:06:33.280 "bdev_wait_for_examine", 00:06:33.280 "bdev_set_options", 00:06:33.280 "accel_get_stats", 00:06:33.280 "accel_set_options", 00:06:33.280 "accel_set_driver", 00:06:33.280 "accel_crypto_key_destroy", 00:06:33.280 "accel_crypto_keys_get", 00:06:33.280 "accel_crypto_key_create", 00:06:33.280 "accel_assign_opc", 00:06:33.280 "accel_get_module_info", 00:06:33.280 "accel_get_opc_assignments", 00:06:33.280 "vmd_rescan", 00:06:33.280 "vmd_remove_device", 00:06:33.280 "vmd_enable", 00:06:33.280 "sock_get_default_impl", 00:06:33.280 "sock_set_default_impl", 00:06:33.280 "sock_impl_set_options", 00:06:33.280 "sock_impl_get_options", 00:06:33.280 "iobuf_get_stats", 00:06:33.280 "iobuf_set_options", 00:06:33.280 "keyring_get_keys", 00:06:33.280 "vfu_tgt_set_base_path", 00:06:33.280 "framework_get_pci_devices", 00:06:33.280 "framework_get_config", 00:06:33.280 "framework_get_subsystems", 00:06:33.280 "fsdev_set_opts", 00:06:33.280 "fsdev_get_opts", 00:06:33.280 "trace_get_info", 00:06:33.280 "trace_get_tpoint_group_mask", 00:06:33.280 "trace_disable_tpoint_group", 00:06:33.280 "trace_enable_tpoint_group", 00:06:33.280 "trace_clear_tpoint_mask", 00:06:33.280 "trace_set_tpoint_mask", 00:06:33.280 "notify_get_notifications", 00:06:33.280 "notify_get_types", 00:06:33.280 "spdk_get_version", 00:06:33.280 "rpc_get_methods" 00:06:33.280 ] 00:06:33.280 13:17:29 spdkcli_tcp -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:33.280 13:17:29 spdkcli_tcp -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:33.280 13:17:29 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:06:33.280 13:17:29 spdkcli_tcp -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:33.280 13:17:29 spdkcli_tcp -- spdkcli/tcp.sh@38 -- # killprocess 516961 00:06:33.280 13:17:29 spdkcli_tcp -- common/autotest_common.sh@950 -- # '[' -z 516961 ']' 00:06:33.280 13:17:29 spdkcli_tcp -- common/autotest_common.sh@954 -- # kill -0 516961 00:06:33.280 13:17:29 spdkcli_tcp -- common/autotest_common.sh@955 -- # uname 00:06:33.537 13:17:29 spdkcli_tcp -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:33.537 13:17:29 spdkcli_tcp -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 516961 00:06:33.537 13:17:29 spdkcli_tcp -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:33.537 13:17:29 spdkcli_tcp -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:33.537 13:17:29 spdkcli_tcp -- common/autotest_common.sh@968 -- # echo 'killing process with pid 516961' 00:06:33.537 killing process with pid 516961 00:06:33.537 13:17:29 spdkcli_tcp -- common/autotest_common.sh@969 -- # kill 516961 00:06:33.537 13:17:29 spdkcli_tcp -- common/autotest_common.sh@974 -- # wait 516961 00:06:33.794 00:06:33.794 real 0m1.443s 00:06:33.794 user 0m2.482s 00:06:33.794 sys 0m0.494s 00:06:33.794 13:17:29 spdkcli_tcp -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:33.794 13:17:29 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:06:33.794 ************************************ 00:06:33.794 END TEST spdkcli_tcp 00:06:33.794 ************************************ 00:06:34.053 13:17:29 -- spdk/autotest.sh@167 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:34.053 13:17:29 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:34.053 13:17:29 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:34.053 13:17:29 -- common/autotest_common.sh@10 -- # set +x 00:06:34.053 ************************************ 00:06:34.053 START TEST dpdk_mem_utility 00:06:34.053 ************************************ 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:34.053 * Looking for test storage... 00:06:34.053 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lcov --version 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@336 -- # IFS=.-: 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@336 -- # read -ra ver1 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@337 -- # IFS=.-: 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@337 -- # read -ra ver2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@338 -- # local 'op=<' 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@340 -- # ver1_l=2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@341 -- # ver2_l=1 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@344 -- # case "$op" in 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@345 -- # : 1 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@365 -- # decimal 1 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=1 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 1 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@365 -- # ver1[v]=1 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@366 -- # decimal 2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@366 -- # ver2[v]=2 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:34.053 13:17:29 dpdk_mem_utility -- scripts/common.sh@368 -- # return 0 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:34.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.053 --rc genhtml_branch_coverage=1 00:06:34.053 --rc genhtml_function_coverage=1 00:06:34.053 --rc genhtml_legend=1 00:06:34.053 --rc geninfo_all_blocks=1 00:06:34.053 --rc geninfo_unexecuted_blocks=1 00:06:34.053 00:06:34.053 ' 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:34.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.053 --rc genhtml_branch_coverage=1 00:06:34.053 --rc genhtml_function_coverage=1 00:06:34.053 --rc genhtml_legend=1 00:06:34.053 --rc geninfo_all_blocks=1 00:06:34.053 --rc geninfo_unexecuted_blocks=1 00:06:34.053 00:06:34.053 ' 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:34.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.053 --rc genhtml_branch_coverage=1 00:06:34.053 --rc genhtml_function_coverage=1 00:06:34.053 --rc genhtml_legend=1 00:06:34.053 --rc geninfo_all_blocks=1 00:06:34.053 --rc geninfo_unexecuted_blocks=1 00:06:34.053 00:06:34.053 ' 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:34.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.053 --rc genhtml_branch_coverage=1 00:06:34.053 --rc genhtml_function_coverage=1 00:06:34.053 --rc genhtml_legend=1 00:06:34.053 --rc geninfo_all_blocks=1 00:06:34.053 --rc geninfo_unexecuted_blocks=1 00:06:34.053 00:06:34.053 ' 00:06:34.053 13:17:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:34.053 13:17:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=517182 00:06:34.053 13:17:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:34.053 13:17:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 517182 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@831 -- # '[' -z 517182 ']' 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:34.053 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:34.053 13:17:29 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:06:34.053 [2024-10-07 13:17:29.962610] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:34.053 [2024-10-07 13:17:29.962700] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid517182 ] 00:06:34.311 [2024-10-07 13:17:30.029822] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.311 [2024-10-07 13:17:30.141422] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.570 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:34.570 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@864 -- # return 0 00:06:34.570 13:17:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:34.570 13:17:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:34.570 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:34.570 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:06:34.570 { 00:06:34.570 "filename": "/tmp/spdk_mem_dump.txt" 00:06:34.570 } 00:06:34.570 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:34.570 13:17:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:34.570 DPDK memory size 860.000000 MiB in 1 heap(s) 00:06:34.570 1 heaps totaling size 860.000000 MiB 00:06:34.570 size: 860.000000 MiB heap id: 0 00:06:34.570 end heaps---------- 00:06:34.570 9 mempools totaling size 642.649841 MiB 00:06:34.570 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:34.570 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:34.570 size: 92.545471 MiB name: bdev_io_517182 00:06:34.570 size: 51.011292 MiB name: evtpool_517182 00:06:34.570 size: 50.003479 MiB name: msgpool_517182 00:06:34.570 size: 36.509338 MiB name: fsdev_io_517182 00:06:34.570 size: 21.763794 MiB name: PDU_Pool 00:06:34.570 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:34.570 size: 0.026123 MiB name: Session_Pool 00:06:34.570 end mempools------- 00:06:34.570 6 memzones totaling size 4.142822 MiB 00:06:34.570 size: 1.000366 MiB name: RG_ring_0_517182 00:06:34.570 size: 1.000366 MiB name: RG_ring_1_517182 00:06:34.570 size: 1.000366 MiB name: RG_ring_4_517182 00:06:34.571 size: 1.000366 MiB name: RG_ring_5_517182 00:06:34.571 size: 0.125366 MiB name: RG_ring_2_517182 00:06:34.571 size: 0.015991 MiB name: RG_ring_3_517182 00:06:34.571 end memzones------- 00:06:34.571 13:17:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:34.829 heap id: 0 total size: 860.000000 MiB number of busy elements: 44 number of free elements: 16 00:06:34.829 list of free elements. size: 13.984680 MiB 00:06:34.829 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:34.829 element at address: 0x200000800000 with size: 1.996948 MiB 00:06:34.829 element at address: 0x20001bc00000 with size: 0.999878 MiB 00:06:34.829 element at address: 0x20001be00000 with size: 0.999878 MiB 00:06:34.829 element at address: 0x200034a00000 with size: 0.994446 MiB 00:06:34.829 element at address: 0x200009600000 with size: 0.959839 MiB 00:06:34.829 element at address: 0x200015e00000 with size: 0.954285 MiB 00:06:34.829 element at address: 0x20001c000000 with size: 0.936584 MiB 00:06:34.829 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:34.829 element at address: 0x20001d800000 with size: 0.582886 MiB 00:06:34.829 element at address: 0x200003e00000 with size: 0.495422 MiB 00:06:34.829 element at address: 0x20000d800000 with size: 0.490723 MiB 00:06:34.829 element at address: 0x20001c200000 with size: 0.485657 MiB 00:06:34.829 element at address: 0x200007000000 with size: 0.481934 MiB 00:06:34.829 element at address: 0x20002ac00000 with size: 0.410034 MiB 00:06:34.829 element at address: 0x200003a00000 with size: 0.355042 MiB 00:06:34.829 list of standard malloc elements. size: 199.218628 MiB 00:06:34.829 element at address: 0x20000d9fff80 with size: 132.000122 MiB 00:06:34.829 element at address: 0x2000097fff80 with size: 64.000122 MiB 00:06:34.829 element at address: 0x20001bcfff80 with size: 1.000122 MiB 00:06:34.829 element at address: 0x20001befff80 with size: 1.000122 MiB 00:06:34.829 element at address: 0x20001c0fff80 with size: 1.000122 MiB 00:06:34.829 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:34.829 element at address: 0x20001c0eff00 with size: 0.062622 MiB 00:06:34.829 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:34.829 element at address: 0x20001c0efdc0 with size: 0.000305 MiB 00:06:34.829 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003a5ae40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003a5f300 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003a7f5c0 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003a7f680 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003aff940 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003e7ed40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003eff000 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20000707b600 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20000707b6c0 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000070fb980 with size: 0.000183 MiB 00:06:34.829 element at address: 0x2000096fdd80 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20000d87da00 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20000d87dac0 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20000d8fdd80 with size: 0.000183 MiB 00:06:34.829 element at address: 0x200015ef44c0 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20001c0efc40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20001c0efd00 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20001c2bc740 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20001d895380 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20001d895440 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20002ac68f80 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20002ac69040 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20002ac6fc40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20002ac6fe40 with size: 0.000183 MiB 00:06:34.829 element at address: 0x20002ac6ff00 with size: 0.000183 MiB 00:06:34.829 list of memzone associated elements. size: 646.796692 MiB 00:06:34.829 element at address: 0x20001d895500 with size: 211.416748 MiB 00:06:34.829 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:34.829 element at address: 0x20002ac6ffc0 with size: 157.562561 MiB 00:06:34.829 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:34.829 element at address: 0x200015ff4780 with size: 92.045044 MiB 00:06:34.829 associated memzone info: size: 92.044922 MiB name: MP_bdev_io_517182_0 00:06:34.829 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:34.829 associated memzone info: size: 48.002930 MiB name: MP_evtpool_517182_0 00:06:34.829 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:34.829 associated memzone info: size: 48.002930 MiB name: MP_msgpool_517182_0 00:06:34.829 element at address: 0x2000071fdb80 with size: 36.008911 MiB 00:06:34.830 associated memzone info: size: 36.008789 MiB name: MP_fsdev_io_517182_0 00:06:34.830 element at address: 0x20001c3be940 with size: 20.255554 MiB 00:06:34.830 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:34.830 element at address: 0x200034bfeb40 with size: 18.005066 MiB 00:06:34.830 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:34.830 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:34.830 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_517182 00:06:34.830 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:34.830 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_517182 00:06:34.830 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:34.830 associated memzone info: size: 1.007996 MiB name: MP_evtpool_517182 00:06:34.830 element at address: 0x20000d8fde40 with size: 1.008118 MiB 00:06:34.830 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:34.830 element at address: 0x20001c2bc800 with size: 1.008118 MiB 00:06:34.830 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:34.830 element at address: 0x2000096fde40 with size: 1.008118 MiB 00:06:34.830 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:34.830 element at address: 0x2000070fba40 with size: 1.008118 MiB 00:06:34.830 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:34.830 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:34.830 associated memzone info: size: 1.000366 MiB name: RG_ring_0_517182 00:06:34.830 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:34.830 associated memzone info: size: 1.000366 MiB name: RG_ring_1_517182 00:06:34.830 element at address: 0x200015ef4580 with size: 1.000488 MiB 00:06:34.830 associated memzone info: size: 1.000366 MiB name: RG_ring_4_517182 00:06:34.830 element at address: 0x200034afe940 with size: 1.000488 MiB 00:06:34.830 associated memzone info: size: 1.000366 MiB name: RG_ring_5_517182 00:06:34.830 element at address: 0x200003a7f740 with size: 0.500488 MiB 00:06:34.830 associated memzone info: size: 0.500366 MiB name: RG_MP_fsdev_io_517182 00:06:34.830 element at address: 0x200003e7ee00 with size: 0.500488 MiB 00:06:34.830 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_517182 00:06:34.830 element at address: 0x20000d87db80 with size: 0.500488 MiB 00:06:34.830 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:34.830 element at address: 0x20000707b780 with size: 0.500488 MiB 00:06:34.830 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:34.830 element at address: 0x20001c27c540 with size: 0.250488 MiB 00:06:34.830 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:34.830 element at address: 0x200003a5f3c0 with size: 0.125488 MiB 00:06:34.830 associated memzone info: size: 0.125366 MiB name: RG_ring_2_517182 00:06:34.830 element at address: 0x2000096f5b80 with size: 0.031738 MiB 00:06:34.830 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:34.830 element at address: 0x20002ac69100 with size: 0.023743 MiB 00:06:34.830 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:34.830 element at address: 0x200003a5b100 with size: 0.016113 MiB 00:06:34.830 associated memzone info: size: 0.015991 MiB name: RG_ring_3_517182 00:06:34.830 element at address: 0x20002ac6f240 with size: 0.002441 MiB 00:06:34.830 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:34.830 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:34.830 associated memzone info: size: 0.000183 MiB name: MP_msgpool_517182 00:06:34.830 element at address: 0x200003affa00 with size: 0.000305 MiB 00:06:34.830 associated memzone info: size: 0.000183 MiB name: MP_fsdev_io_517182 00:06:34.830 element at address: 0x200003a5af00 with size: 0.000305 MiB 00:06:34.830 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_517182 00:06:34.830 element at address: 0x20002ac6fd00 with size: 0.000305 MiB 00:06:34.830 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:34.830 13:17:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:34.830 13:17:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 517182 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@950 -- # '[' -z 517182 ']' 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@954 -- # kill -0 517182 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@955 -- # uname 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 517182 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@968 -- # echo 'killing process with pid 517182' 00:06:34.830 killing process with pid 517182 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@969 -- # kill 517182 00:06:34.830 13:17:30 dpdk_mem_utility -- common/autotest_common.sh@974 -- # wait 517182 00:06:35.088 00:06:35.088 real 0m1.255s 00:06:35.088 user 0m1.215s 00:06:35.088 sys 0m0.446s 00:06:35.088 13:17:31 dpdk_mem_utility -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:35.088 13:17:31 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:06:35.088 ************************************ 00:06:35.088 END TEST dpdk_mem_utility 00:06:35.088 ************************************ 00:06:35.347 13:17:31 -- spdk/autotest.sh@168 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:35.347 13:17:31 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:35.347 13:17:31 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:35.347 13:17:31 -- common/autotest_common.sh@10 -- # set +x 00:06:35.347 ************************************ 00:06:35.347 START TEST event 00:06:35.347 ************************************ 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:35.347 * Looking for test storage... 00:06:35.347 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1681 -- # lcov --version 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:35.347 13:17:31 event -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:35.347 13:17:31 event -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:35.347 13:17:31 event -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:35.347 13:17:31 event -- scripts/common.sh@336 -- # IFS=.-: 00:06:35.347 13:17:31 event -- scripts/common.sh@336 -- # read -ra ver1 00:06:35.347 13:17:31 event -- scripts/common.sh@337 -- # IFS=.-: 00:06:35.347 13:17:31 event -- scripts/common.sh@337 -- # read -ra ver2 00:06:35.347 13:17:31 event -- scripts/common.sh@338 -- # local 'op=<' 00:06:35.347 13:17:31 event -- scripts/common.sh@340 -- # ver1_l=2 00:06:35.347 13:17:31 event -- scripts/common.sh@341 -- # ver2_l=1 00:06:35.347 13:17:31 event -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:35.347 13:17:31 event -- scripts/common.sh@344 -- # case "$op" in 00:06:35.347 13:17:31 event -- scripts/common.sh@345 -- # : 1 00:06:35.347 13:17:31 event -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:35.347 13:17:31 event -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:35.347 13:17:31 event -- scripts/common.sh@365 -- # decimal 1 00:06:35.347 13:17:31 event -- scripts/common.sh@353 -- # local d=1 00:06:35.347 13:17:31 event -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:35.347 13:17:31 event -- scripts/common.sh@355 -- # echo 1 00:06:35.347 13:17:31 event -- scripts/common.sh@365 -- # ver1[v]=1 00:06:35.347 13:17:31 event -- scripts/common.sh@366 -- # decimal 2 00:06:35.347 13:17:31 event -- scripts/common.sh@353 -- # local d=2 00:06:35.347 13:17:31 event -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:35.347 13:17:31 event -- scripts/common.sh@355 -- # echo 2 00:06:35.347 13:17:31 event -- scripts/common.sh@366 -- # ver2[v]=2 00:06:35.347 13:17:31 event -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:35.347 13:17:31 event -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:35.347 13:17:31 event -- scripts/common.sh@368 -- # return 0 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:35.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.347 --rc genhtml_branch_coverage=1 00:06:35.347 --rc genhtml_function_coverage=1 00:06:35.347 --rc genhtml_legend=1 00:06:35.347 --rc geninfo_all_blocks=1 00:06:35.347 --rc geninfo_unexecuted_blocks=1 00:06:35.347 00:06:35.347 ' 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:35.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.347 --rc genhtml_branch_coverage=1 00:06:35.347 --rc genhtml_function_coverage=1 00:06:35.347 --rc genhtml_legend=1 00:06:35.347 --rc geninfo_all_blocks=1 00:06:35.347 --rc geninfo_unexecuted_blocks=1 00:06:35.347 00:06:35.347 ' 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:35.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.347 --rc genhtml_branch_coverage=1 00:06:35.347 --rc genhtml_function_coverage=1 00:06:35.347 --rc genhtml_legend=1 00:06:35.347 --rc geninfo_all_blocks=1 00:06:35.347 --rc geninfo_unexecuted_blocks=1 00:06:35.347 00:06:35.347 ' 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:35.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.347 --rc genhtml_branch_coverage=1 00:06:35.347 --rc genhtml_function_coverage=1 00:06:35.347 --rc genhtml_legend=1 00:06:35.347 --rc geninfo_all_blocks=1 00:06:35.347 --rc geninfo_unexecuted_blocks=1 00:06:35.347 00:06:35.347 ' 00:06:35.347 13:17:31 event -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:35.347 13:17:31 event -- bdev/nbd_common.sh@6 -- # set -e 00:06:35.347 13:17:31 event -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1101 -- # '[' 6 -le 1 ']' 00:06:35.347 13:17:31 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:35.347 13:17:31 event -- common/autotest_common.sh@10 -- # set +x 00:06:35.347 ************************************ 00:06:35.347 START TEST event_perf 00:06:35.347 ************************************ 00:06:35.347 13:17:31 event.event_perf -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:35.347 Running I/O for 1 seconds...[2024-10-07 13:17:31.255550] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:35.347 [2024-10-07 13:17:31.255614] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid517378 ] 00:06:35.606 [2024-10-07 13:17:31.315610] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:35.606 [2024-10-07 13:17:31.424049] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:35.606 [2024-10-07 13:17:31.424110] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:06:35.606 [2024-10-07 13:17:31.424221] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:06:35.606 [2024-10-07 13:17:31.424224] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.978 Running I/O for 1 seconds... 00:06:36.978 lcore 0: 228890 00:06:36.978 lcore 1: 228889 00:06:36.978 lcore 2: 228890 00:06:36.978 lcore 3: 228889 00:06:36.978 done. 00:06:36.978 00:06:36.978 real 0m1.291s 00:06:36.978 user 0m4.199s 00:06:36.978 sys 0m0.087s 00:06:36.978 13:17:32 event.event_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:36.978 13:17:32 event.event_perf -- common/autotest_common.sh@10 -- # set +x 00:06:36.978 ************************************ 00:06:36.978 END TEST event_perf 00:06:36.978 ************************************ 00:06:36.978 13:17:32 event -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:36.978 13:17:32 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:06:36.978 13:17:32 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:36.978 13:17:32 event -- common/autotest_common.sh@10 -- # set +x 00:06:36.978 ************************************ 00:06:36.978 START TEST event_reactor 00:06:36.978 ************************************ 00:06:36.978 13:17:32 event.event_reactor -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:36.978 [2024-10-07 13:17:32.597372] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:36.978 [2024-10-07 13:17:32.597438] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid517543 ] 00:06:36.978 [2024-10-07 13:17:32.657196] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.978 [2024-10-07 13:17:32.761025] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.352 test_start 00:06:38.352 oneshot 00:06:38.352 tick 100 00:06:38.352 tick 100 00:06:38.352 tick 250 00:06:38.352 tick 100 00:06:38.352 tick 100 00:06:38.352 tick 100 00:06:38.352 tick 250 00:06:38.352 tick 500 00:06:38.352 tick 100 00:06:38.352 tick 100 00:06:38.352 tick 250 00:06:38.352 tick 100 00:06:38.352 tick 100 00:06:38.352 test_end 00:06:38.352 00:06:38.352 real 0m1.287s 00:06:38.352 user 0m1.211s 00:06:38.352 sys 0m0.072s 00:06:38.352 13:17:33 event.event_reactor -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:38.352 13:17:33 event.event_reactor -- common/autotest_common.sh@10 -- # set +x 00:06:38.352 ************************************ 00:06:38.352 END TEST event_reactor 00:06:38.352 ************************************ 00:06:38.352 13:17:33 event -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:38.352 13:17:33 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:06:38.352 13:17:33 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:38.352 13:17:33 event -- common/autotest_common.sh@10 -- # set +x 00:06:38.352 ************************************ 00:06:38.352 START TEST event_reactor_perf 00:06:38.352 ************************************ 00:06:38.352 13:17:33 event.event_reactor_perf -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:38.352 [2024-10-07 13:17:33.936760] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:38.352 [2024-10-07 13:17:33.936843] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid517813 ] 00:06:38.352 [2024-10-07 13:17:33.995605] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.352 [2024-10-07 13:17:34.098314] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.286 test_start 00:06:39.286 test_end 00:06:39.286 Performance: 441956 events per second 00:06:39.286 00:06:39.286 real 0m1.286s 00:06:39.286 user 0m1.205s 00:06:39.286 sys 0m0.076s 00:06:39.286 13:17:35 event.event_reactor_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:39.286 13:17:35 event.event_reactor_perf -- common/autotest_common.sh@10 -- # set +x 00:06:39.286 ************************************ 00:06:39.286 END TEST event_reactor_perf 00:06:39.286 ************************************ 00:06:39.589 13:17:35 event -- event/event.sh@49 -- # uname -s 00:06:39.589 13:17:35 event -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:39.589 13:17:35 event -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:39.589 13:17:35 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:39.589 13:17:35 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:39.589 13:17:35 event -- common/autotest_common.sh@10 -- # set +x 00:06:39.589 ************************************ 00:06:39.589 START TEST event_scheduler 00:06:39.589 ************************************ 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:39.589 * Looking for test storage... 00:06:39.589 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1681 -- # lcov --version 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@336 -- # IFS=.-: 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@336 -- # read -ra ver1 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@337 -- # IFS=.-: 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@337 -- # read -ra ver2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@338 -- # local 'op=<' 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@340 -- # ver1_l=2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@341 -- # ver2_l=1 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@344 -- # case "$op" in 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@345 -- # : 1 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@365 -- # decimal 1 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@353 -- # local d=1 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@355 -- # echo 1 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@365 -- # ver1[v]=1 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@366 -- # decimal 2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@353 -- # local d=2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@355 -- # echo 2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@366 -- # ver2[v]=2 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:39.589 13:17:35 event.event_scheduler -- scripts/common.sh@368 -- # return 0 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:39.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.589 --rc genhtml_branch_coverage=1 00:06:39.589 --rc genhtml_function_coverage=1 00:06:39.589 --rc genhtml_legend=1 00:06:39.589 --rc geninfo_all_blocks=1 00:06:39.589 --rc geninfo_unexecuted_blocks=1 00:06:39.589 00:06:39.589 ' 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:39.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.589 --rc genhtml_branch_coverage=1 00:06:39.589 --rc genhtml_function_coverage=1 00:06:39.589 --rc genhtml_legend=1 00:06:39.589 --rc geninfo_all_blocks=1 00:06:39.589 --rc geninfo_unexecuted_blocks=1 00:06:39.589 00:06:39.589 ' 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:39.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.589 --rc genhtml_branch_coverage=1 00:06:39.589 --rc genhtml_function_coverage=1 00:06:39.589 --rc genhtml_legend=1 00:06:39.589 --rc geninfo_all_blocks=1 00:06:39.589 --rc geninfo_unexecuted_blocks=1 00:06:39.589 00:06:39.589 ' 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:39.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.589 --rc genhtml_branch_coverage=1 00:06:39.589 --rc genhtml_function_coverage=1 00:06:39.589 --rc genhtml_legend=1 00:06:39.589 --rc geninfo_all_blocks=1 00:06:39.589 --rc geninfo_unexecuted_blocks=1 00:06:39.589 00:06:39.589 ' 00:06:39.589 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:39.589 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@35 -- # scheduler_pid=518003 00:06:39.589 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:39.589 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:39.589 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@37 -- # waitforlisten 518003 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@831 -- # '[' -z 518003 ']' 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:39.589 13:17:35 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:06:39.589 [2024-10-07 13:17:35.451703] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:39.589 [2024-10-07 13:17:35.451813] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid518003 ] 00:06:39.878 [2024-10-07 13:17:35.512602] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:39.878 [2024-10-07 13:17:35.620528] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.878 [2024-10-07 13:17:35.621001] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.878 [2024-10-07 13:17:35.621063] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:06:39.878 [2024-10-07 13:17:35.621066] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@864 -- # return 0 00:06:39.878 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:06:39.878 [2024-10-07 13:17:35.682085] dpdk_governor.c: 173:_init: *ERROR*: App core mask contains some but not all of a set of SMT siblings 00:06:39.878 [2024-10-07 13:17:35.682112] scheduler_dynamic.c: 280:init: *NOTICE*: Unable to initialize dpdk governor 00:06:39.878 [2024-10-07 13:17:35.682146] scheduler_dynamic.c: 427:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:39.878 [2024-10-07 13:17:35.682157] scheduler_dynamic.c: 429:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:39.878 [2024-10-07 13:17:35.682168] scheduler_dynamic.c: 431:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.878 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:06:39.878 [2024-10-07 13:17:35.775096] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.878 13:17:35 event.event_scheduler -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:39.878 13:17:35 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 ************************************ 00:06:40.162 START TEST scheduler_create_thread 00:06:40.162 ************************************ 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1125 -- # scheduler_create_thread 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 2 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 3 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 4 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 5 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 6 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 7 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 8 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 9 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 10 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:40.162 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.163 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:40.163 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:40.163 13:17:35 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:40.163 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:40.163 13:17:35 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:41.536 13:17:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:41.536 13:17:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:41.536 13:17:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:41.536 13:17:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:41.536 13:17:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:42.908 13:17:38 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.908 00:06:42.908 real 0m2.615s 00:06:42.908 user 0m0.011s 00:06:42.908 sys 0m0.005s 00:06:42.908 13:17:38 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:42.908 13:17:38 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:06:42.908 ************************************ 00:06:42.908 END TEST scheduler_create_thread 00:06:42.908 ************************************ 00:06:42.908 13:17:38 event.event_scheduler -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:42.908 13:17:38 event.event_scheduler -- scheduler/scheduler.sh@46 -- # killprocess 518003 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@950 -- # '[' -z 518003 ']' 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@954 -- # kill -0 518003 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@955 -- # uname 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 518003 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@968 -- # echo 'killing process with pid 518003' 00:06:42.908 killing process with pid 518003 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@969 -- # kill 518003 00:06:42.908 13:17:38 event.event_scheduler -- common/autotest_common.sh@974 -- # wait 518003 00:06:43.167 [2024-10-07 13:17:38.893950] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:43.426 00:06:43.426 real 0m3.904s 00:06:43.426 user 0m5.837s 00:06:43.426 sys 0m0.333s 00:06:43.426 13:17:39 event.event_scheduler -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:43.426 13:17:39 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:06:43.426 ************************************ 00:06:43.426 END TEST event_scheduler 00:06:43.426 ************************************ 00:06:43.426 13:17:39 event -- event/event.sh@51 -- # modprobe -n nbd 00:06:43.426 13:17:39 event -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:43.426 13:17:39 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:06:43.426 13:17:39 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:43.426 13:17:39 event -- common/autotest_common.sh@10 -- # set +x 00:06:43.426 ************************************ 00:06:43.426 START TEST app_repeat 00:06:43.426 ************************************ 00:06:43.426 13:17:39 event.app_repeat -- common/autotest_common.sh@1125 -- # app_repeat_test 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@13 -- # local nbd_list 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@14 -- # local bdev_list 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@15 -- # local repeat_times=4 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@17 -- # modprobe nbd 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@19 -- # repeat_pid=518468 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@21 -- # echo 'Process app_repeat pid: 518468' 00:06:43.426 Process app_repeat pid: 518468 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:43.426 spdk_app_start Round 0 00:06:43.426 13:17:39 event.app_repeat -- event/event.sh@25 -- # waitforlisten 518468 /var/tmp/spdk-nbd.sock 00:06:43.426 13:17:39 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 518468 ']' 00:06:43.426 13:17:39 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:43.426 13:17:39 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:43.426 13:17:39 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:43.426 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:43.426 13:17:39 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:43.426 13:17:39 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:06:43.426 [2024-10-07 13:17:39.249441] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:06:43.426 [2024-10-07 13:17:39.249511] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid518468 ] 00:06:43.426 [2024-10-07 13:17:39.305016] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:43.684 [2024-10-07 13:17:39.408810] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:43.684 [2024-10-07 13:17:39.408815] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.684 13:17:39 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:43.684 13:17:39 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:06:43.684 13:17:39 event.app_repeat -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:43.943 Malloc0 00:06:43.943 13:17:39 event.app_repeat -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:44.201 Malloc1 00:06:44.201 13:17:40 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:44.201 13:17:40 event.app_repeat -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:44.767 /dev/nbd0 00:06:44.767 13:17:40 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:44.767 13:17:40 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:44.767 1+0 records in 00:06:44.767 1+0 records out 00:06:44.767 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000133421 s, 30.7 MB/s 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:06:44.767 13:17:40 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:06:44.767 13:17:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:44.767 13:17:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:44.767 13:17:40 event.app_repeat -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:45.025 /dev/nbd1 00:06:45.025 13:17:40 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:45.025 13:17:40 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:45.025 1+0 records in 00:06:45.025 1+0 records out 00:06:45.025 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00015482 s, 26.5 MB/s 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:06:45.025 13:17:40 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:06:45.025 13:17:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:45.025 13:17:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:45.025 13:17:40 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:45.025 13:17:40 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:45.025 13:17:40 event.app_repeat -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:45.283 13:17:41 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:45.283 { 00:06:45.283 "nbd_device": "/dev/nbd0", 00:06:45.283 "bdev_name": "Malloc0" 00:06:45.283 }, 00:06:45.283 { 00:06:45.283 "nbd_device": "/dev/nbd1", 00:06:45.284 "bdev_name": "Malloc1" 00:06:45.284 } 00:06:45.284 ]' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:45.284 { 00:06:45.284 "nbd_device": "/dev/nbd0", 00:06:45.284 "bdev_name": "Malloc0" 00:06:45.284 }, 00:06:45.284 { 00:06:45.284 "nbd_device": "/dev/nbd1", 00:06:45.284 "bdev_name": "Malloc1" 00:06:45.284 } 00:06:45.284 ]' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:45.284 /dev/nbd1' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:45.284 /dev/nbd1' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:45.284 256+0 records in 00:06:45.284 256+0 records out 00:06:45.284 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0037963 s, 276 MB/s 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:45.284 256+0 records in 00:06:45.284 256+0 records out 00:06:45.284 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211623 s, 49.5 MB/s 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:45.284 256+0 records in 00:06:45.284 256+0 records out 00:06:45.284 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219962 s, 47.7 MB/s 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:45.284 13:17:41 event.app_repeat -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:45.542 13:17:41 event.app_repeat -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:46.108 13:17:41 event.app_repeat -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:46.108 13:17:42 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:46.108 13:17:42 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:46.108 13:17:42 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:46.365 13:17:42 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:06:46.365 13:17:42 event.app_repeat -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:46.623 13:17:42 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:06:46.882 [2024-10-07 13:17:42.606298] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:46.882 [2024-10-07 13:17:42.708355] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.882 [2024-10-07 13:17:42.708360] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:46.882 [2024-10-07 13:17:42.762760] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:46.882 [2024-10-07 13:17:42.762844] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:50.162 13:17:45 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:06:50.162 13:17:45 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:50.162 spdk_app_start Round 1 00:06:50.162 13:17:45 event.app_repeat -- event/event.sh@25 -- # waitforlisten 518468 /var/tmp/spdk-nbd.sock 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 518468 ']' 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:50.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:50.162 13:17:45 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:06:50.162 13:17:45 event.app_repeat -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:50.162 Malloc0 00:06:50.162 13:17:45 event.app_repeat -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:50.420 Malloc1 00:06:50.420 13:17:46 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:50.420 13:17:46 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:50.421 13:17:46 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:06:50.421 13:17:46 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:50.421 13:17:46 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:50.421 13:17:46 event.app_repeat -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:50.679 /dev/nbd0 00:06:50.679 13:17:46 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:50.679 13:17:46 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:50.679 1+0 records in 00:06:50.679 1+0 records out 00:06:50.679 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00023772 s, 17.2 MB/s 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:06:50.679 13:17:46 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:06:50.679 13:17:46 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:50.679 13:17:46 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:50.679 13:17:46 event.app_repeat -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:50.937 /dev/nbd1 00:06:50.937 13:17:46 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:50.937 13:17:46 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:50.937 1+0 records in 00:06:50.937 1+0 records out 00:06:50.937 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00015073 s, 27.2 MB/s 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:06:50.937 13:17:46 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:06:50.937 13:17:46 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:50.937 13:17:46 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:50.937 13:17:46 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:50.937 13:17:46 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:50.937 13:17:46 event.app_repeat -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:51.194 13:17:47 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:51.194 { 00:06:51.194 "nbd_device": "/dev/nbd0", 00:06:51.194 "bdev_name": "Malloc0" 00:06:51.194 }, 00:06:51.194 { 00:06:51.194 "nbd_device": "/dev/nbd1", 00:06:51.194 "bdev_name": "Malloc1" 00:06:51.194 } 00:06:51.194 ]' 00:06:51.194 13:17:47 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:51.194 { 00:06:51.194 "nbd_device": "/dev/nbd0", 00:06:51.194 "bdev_name": "Malloc0" 00:06:51.194 }, 00:06:51.194 { 00:06:51.194 "nbd_device": "/dev/nbd1", 00:06:51.194 "bdev_name": "Malloc1" 00:06:51.194 } 00:06:51.194 ]' 00:06:51.194 13:17:47 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:51.452 /dev/nbd1' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:51.452 /dev/nbd1' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:51.452 256+0 records in 00:06:51.452 256+0 records out 00:06:51.452 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00483185 s, 217 MB/s 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:51.452 256+0 records in 00:06:51.452 256+0 records out 00:06:51.452 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192588 s, 54.4 MB/s 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:51.452 256+0 records in 00:06:51.452 256+0 records out 00:06:51.452 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221198 s, 47.4 MB/s 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:51.452 13:17:47 event.app_repeat -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:51.710 13:17:47 event.app_repeat -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:51.968 13:17:47 event.app_repeat -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:06:52.225 13:17:48 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:52.226 13:17:48 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:06:52.226 13:17:48 event.app_repeat -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:52.483 13:17:48 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:06:52.741 [2024-10-07 13:17:48.667657] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:52.999 [2024-10-07 13:17:48.769691] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:53.000 [2024-10-07 13:17:48.769691] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.000 [2024-10-07 13:17:48.827097] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:53.000 [2024-10-07 13:17:48.827180] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:55.527 13:17:51 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:06:55.527 13:17:51 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:55.527 spdk_app_start Round 2 00:06:55.527 13:17:51 event.app_repeat -- event/event.sh@25 -- # waitforlisten 518468 /var/tmp/spdk-nbd.sock 00:06:55.527 13:17:51 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 518468 ']' 00:06:55.527 13:17:51 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:55.527 13:17:51 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:55.527 13:17:51 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:55.527 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:55.527 13:17:51 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:55.527 13:17:51 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:06:55.785 13:17:51 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:55.785 13:17:51 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:06:55.785 13:17:51 event.app_repeat -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:56.043 Malloc0 00:06:56.043 13:17:51 event.app_repeat -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:56.301 Malloc1 00:06:56.559 13:17:52 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:56.559 13:17:52 event.app_repeat -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:56.817 /dev/nbd0 00:06:56.817 13:17:52 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:56.817 13:17:52 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:56.817 1+0 records in 00:06:56.817 1+0 records out 00:06:56.817 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209654 s, 19.5 MB/s 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:06:56.817 13:17:52 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:06:56.817 13:17:52 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:56.817 13:17:52 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:56.817 13:17:52 event.app_repeat -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:57.074 /dev/nbd1 00:06:57.074 13:17:52 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:57.074 13:17:52 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:57.074 1+0 records in 00:06:57.074 1+0 records out 00:06:57.074 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203753 s, 20.1 MB/s 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:06:57.074 13:17:52 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:06:57.074 13:17:52 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:57.074 13:17:52 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:57.074 13:17:52 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:57.074 13:17:52 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:57.074 13:17:52 event.app_repeat -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:57.332 { 00:06:57.332 "nbd_device": "/dev/nbd0", 00:06:57.332 "bdev_name": "Malloc0" 00:06:57.332 }, 00:06:57.332 { 00:06:57.332 "nbd_device": "/dev/nbd1", 00:06:57.332 "bdev_name": "Malloc1" 00:06:57.332 } 00:06:57.332 ]' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:57.332 { 00:06:57.332 "nbd_device": "/dev/nbd0", 00:06:57.332 "bdev_name": "Malloc0" 00:06:57.332 }, 00:06:57.332 { 00:06:57.332 "nbd_device": "/dev/nbd1", 00:06:57.332 "bdev_name": "Malloc1" 00:06:57.332 } 00:06:57.332 ]' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:57.332 /dev/nbd1' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:57.332 /dev/nbd1' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:57.332 256+0 records in 00:06:57.332 256+0 records out 00:06:57.332 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0051926 s, 202 MB/s 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:57.332 256+0 records in 00:06:57.332 256+0 records out 00:06:57.332 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201599 s, 52.0 MB/s 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:57.332 256+0 records in 00:06:57.332 256+0 records out 00:06:57.332 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226049 s, 46.4 MB/s 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:57.332 13:17:53 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:57.590 13:17:53 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:57.590 13:17:53 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:57.591 13:17:53 event.app_repeat -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:57.848 13:17:53 event.app_repeat -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:58.107 13:17:53 event.app_repeat -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:58.365 13:17:54 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:06:58.365 13:17:54 event.app_repeat -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:58.623 13:17:54 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:06:58.882 [2024-10-07 13:17:54.752429] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:59.140 [2024-10-07 13:17:54.856150] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:59.140 [2024-10-07 13:17:54.856154] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.140 [2024-10-07 13:17:54.913072] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:59.140 [2024-10-07 13:17:54.913151] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:01.667 13:17:57 event.app_repeat -- event/event.sh@38 -- # waitforlisten 518468 /var/tmp/spdk-nbd.sock 00:07:01.667 13:17:57 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 518468 ']' 00:07:01.667 13:17:57 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:01.667 13:17:57 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:01.667 13:17:57 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:01.667 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:01.667 13:17:57 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:01.667 13:17:57 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:07:01.925 13:17:57 event.app_repeat -- event/event.sh@39 -- # killprocess 518468 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@950 -- # '[' -z 518468 ']' 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@954 -- # kill -0 518468 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@955 -- # uname 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 518468 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@968 -- # echo 'killing process with pid 518468' 00:07:01.925 killing process with pid 518468 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@969 -- # kill 518468 00:07:01.925 13:17:57 event.app_repeat -- common/autotest_common.sh@974 -- # wait 518468 00:07:02.183 spdk_app_start is called in Round 0. 00:07:02.183 Shutdown signal received, stop current app iteration 00:07:02.183 Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 reinitialization... 00:07:02.183 spdk_app_start is called in Round 1. 00:07:02.183 Shutdown signal received, stop current app iteration 00:07:02.183 Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 reinitialization... 00:07:02.183 spdk_app_start is called in Round 2. 00:07:02.183 Shutdown signal received, stop current app iteration 00:07:02.183 Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 reinitialization... 00:07:02.183 spdk_app_start is called in Round 3. 00:07:02.183 Shutdown signal received, stop current app iteration 00:07:02.183 13:17:58 event.app_repeat -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:07:02.183 13:17:58 event.app_repeat -- event/event.sh@42 -- # return 0 00:07:02.183 00:07:02.183 real 0m18.837s 00:07:02.183 user 0m41.255s 00:07:02.183 sys 0m3.274s 00:07:02.183 13:17:58 event.app_repeat -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:02.183 13:17:58 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:07:02.183 ************************************ 00:07:02.183 END TEST app_repeat 00:07:02.183 ************************************ 00:07:02.183 13:17:58 event -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:07:02.183 13:17:58 event -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:02.183 13:17:58 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:02.183 13:17:58 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:02.183 13:17:58 event -- common/autotest_common.sh@10 -- # set +x 00:07:02.183 ************************************ 00:07:02.183 START TEST cpu_locks 00:07:02.183 ************************************ 00:07:02.183 13:17:58 event.cpu_locks -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:02.441 * Looking for test storage... 00:07:02.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1681 -- # lcov --version 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@336 -- # IFS=.-: 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@336 -- # read -ra ver1 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@337 -- # IFS=.-: 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@337 -- # read -ra ver2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@338 -- # local 'op=<' 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@340 -- # ver1_l=2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@341 -- # ver2_l=1 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@344 -- # case "$op" in 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@345 -- # : 1 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@365 -- # decimal 1 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@353 -- # local d=1 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@355 -- # echo 1 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@365 -- # ver1[v]=1 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@366 -- # decimal 2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@353 -- # local d=2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@355 -- # echo 2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@366 -- # ver2[v]=2 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:02.441 13:17:58 event.cpu_locks -- scripts/common.sh@368 -- # return 0 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:02.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.441 --rc genhtml_branch_coverage=1 00:07:02.441 --rc genhtml_function_coverage=1 00:07:02.441 --rc genhtml_legend=1 00:07:02.441 --rc geninfo_all_blocks=1 00:07:02.441 --rc geninfo_unexecuted_blocks=1 00:07:02.441 00:07:02.441 ' 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:02.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.441 --rc genhtml_branch_coverage=1 00:07:02.441 --rc genhtml_function_coverage=1 00:07:02.441 --rc genhtml_legend=1 00:07:02.441 --rc geninfo_all_blocks=1 00:07:02.441 --rc geninfo_unexecuted_blocks=1 00:07:02.441 00:07:02.441 ' 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:02.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.441 --rc genhtml_branch_coverage=1 00:07:02.441 --rc genhtml_function_coverage=1 00:07:02.441 --rc genhtml_legend=1 00:07:02.441 --rc geninfo_all_blocks=1 00:07:02.441 --rc geninfo_unexecuted_blocks=1 00:07:02.441 00:07:02.441 ' 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:02.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:02.441 --rc genhtml_branch_coverage=1 00:07:02.441 --rc genhtml_function_coverage=1 00:07:02.441 --rc genhtml_legend=1 00:07:02.441 --rc geninfo_all_blocks=1 00:07:02.441 --rc geninfo_unexecuted_blocks=1 00:07:02.441 00:07:02.441 ' 00:07:02.441 13:17:58 event.cpu_locks -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:07:02.441 13:17:58 event.cpu_locks -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:07:02.441 13:17:58 event.cpu_locks -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:07:02.441 13:17:58 event.cpu_locks -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:02.441 13:17:58 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:02.441 ************************************ 00:07:02.441 START TEST default_locks 00:07:02.441 ************************************ 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@1125 -- # default_locks 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=520962 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- event/cpu_locks.sh@47 -- # waitforlisten 520962 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 520962 ']' 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:02.441 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:02.441 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:07:02.441 [2024-10-07 13:17:58.328658] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:02.441 [2024-10-07 13:17:58.328742] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid520962 ] 00:07:02.699 [2024-10-07 13:17:58.386900] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.699 [2024-10-07 13:17:58.489656] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.956 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:02.956 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 0 00:07:02.956 13:17:58 event.cpu_locks.default_locks -- event/cpu_locks.sh@49 -- # locks_exist 520962 00:07:02.956 13:17:58 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # lslocks -p 520962 00:07:02.956 13:17:58 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:03.213 lslocks: write error 00:07:03.213 13:17:58 event.cpu_locks.default_locks -- event/cpu_locks.sh@50 -- # killprocess 520962 00:07:03.213 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@950 -- # '[' -z 520962 ']' 00:07:03.213 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@954 -- # kill -0 520962 00:07:03.213 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # uname 00:07:03.213 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:03.213 13:17:58 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 520962 00:07:03.213 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:03.213 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:03.213 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 520962' 00:07:03.213 killing process with pid 520962 00:07:03.213 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@969 -- # kill 520962 00:07:03.213 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@974 -- # wait 520962 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- event/cpu_locks.sh@52 -- # NOT waitforlisten 520962 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@650 -- # local es=0 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 520962 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # waitforlisten 520962 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 520962 ']' 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:03.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:07:03.781 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 846: kill: (520962) - No such process 00:07:03.781 ERROR: process (pid: 520962) is no longer running 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 1 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # es=1 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- event/cpu_locks.sh@54 -- # no_locks 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # local lock_files 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:03.781 00:07:03.781 real 0m1.207s 00:07:03.781 user 0m1.151s 00:07:03.781 sys 0m0.511s 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:03.781 13:17:59 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:07:03.781 ************************************ 00:07:03.781 END TEST default_locks 00:07:03.781 ************************************ 00:07:03.781 13:17:59 event.cpu_locks -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:07:03.781 13:17:59 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:03.781 13:17:59 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:03.781 13:17:59 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:03.781 ************************************ 00:07:03.781 START TEST default_locks_via_rpc 00:07:03.781 ************************************ 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1125 -- # default_locks_via_rpc 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=521124 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@63 -- # waitforlisten 521124 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 521124 ']' 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:03.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:03.781 13:17:59 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:03.781 [2024-10-07 13:17:59.591576] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:03.781 [2024-10-07 13:17:59.591690] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid521124 ] 00:07:03.781 [2024-10-07 13:17:59.649671] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.041 [2024-10-07 13:17:59.761227] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@67 -- # no_locks 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # local lock_files 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@71 -- # locks_exist 521124 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # lslocks -p 521124 00:07:04.301 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@73 -- # killprocess 521124 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@950 -- # '[' -z 521124 ']' 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@954 -- # kill -0 521124 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # uname 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 521124 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 521124' 00:07:04.558 killing process with pid 521124 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@969 -- # kill 521124 00:07:04.558 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@974 -- # wait 521124 00:07:05.190 00:07:05.190 real 0m1.263s 00:07:05.190 user 0m1.256s 00:07:05.190 sys 0m0.499s 00:07:05.190 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:05.190 13:18:00 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:05.190 ************************************ 00:07:05.190 END TEST default_locks_via_rpc 00:07:05.190 ************************************ 00:07:05.190 13:18:00 event.cpu_locks -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:07:05.190 13:18:00 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:05.190 13:18:00 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:05.190 13:18:00 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:05.190 ************************************ 00:07:05.190 START TEST non_locking_app_on_locked_coremask 00:07:05.190 ************************************ 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # non_locking_app_on_locked_coremask 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=521390 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@81 -- # waitforlisten 521390 /var/tmp/spdk.sock 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 521390 ']' 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.190 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:05.190 13:18:00 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:05.190 [2024-10-07 13:18:00.901663] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:05.190 [2024-10-07 13:18:00.901765] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid521390 ] 00:07:05.190 [2024-10-07 13:18:00.961570] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.190 [2024-10-07 13:18:01.075162] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=521498 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@85 -- # waitforlisten 521498 /var/tmp/spdk2.sock 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 521498 ']' 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:05.448 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:05.448 13:18:01 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:05.706 [2024-10-07 13:18:01.399282] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:05.706 [2024-10-07 13:18:01.399377] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid521498 ] 00:07:05.706 [2024-10-07 13:18:01.482927] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:05.706 [2024-10-07 13:18:01.482952] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.964 [2024-10-07 13:18:01.694180] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.530 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:06.530 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:07:06.530 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@87 -- # locks_exist 521390 00:07:06.530 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 521390 00:07:06.530 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:07.096 lslocks: write error 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@89 -- # killprocess 521390 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 521390 ']' 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 521390 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 521390 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 521390' 00:07:07.096 killing process with pid 521390 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 521390 00:07:07.096 13:18:02 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 521390 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@90 -- # killprocess 521498 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 521498 ']' 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 521498 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 521498 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 521498' 00:07:08.030 killing process with pid 521498 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 521498 00:07:08.030 13:18:03 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 521498 00:07:08.596 00:07:08.596 real 0m3.515s 00:07:08.596 user 0m3.719s 00:07:08.596 sys 0m1.127s 00:07:08.596 13:18:04 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:08.596 13:18:04 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:08.596 ************************************ 00:07:08.596 END TEST non_locking_app_on_locked_coremask 00:07:08.596 ************************************ 00:07:08.596 13:18:04 event.cpu_locks -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:07:08.596 13:18:04 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:08.596 13:18:04 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:08.596 13:18:04 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:08.596 ************************************ 00:07:08.596 START TEST locking_app_on_unlocked_coremask 00:07:08.596 ************************************ 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_unlocked_coremask 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=521959 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@99 -- # waitforlisten 521959 /var/tmp/spdk.sock 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 521959 ']' 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:08.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:08.596 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:08.596 [2024-10-07 13:18:04.463084] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:08.596 [2024-10-07 13:18:04.463168] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid521959 ] 00:07:08.596 [2024-10-07 13:18:04.520207] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:08.596 [2024-10-07 13:18:04.520235] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.855 [2024-10-07 13:18:04.624060] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=521962 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@103 -- # waitforlisten 521962 /var/tmp/spdk2.sock 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 521962 ']' 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:09.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:09.114 13:18:04 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:09.114 [2024-10-07 13:18:04.943783] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:09.114 [2024-10-07 13:18:04.943875] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid521962 ] 00:07:09.114 [2024-10-07 13:18:05.025270] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.373 [2024-10-07 13:18:05.238535] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.309 13:18:05 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:10.309 13:18:05 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:07:10.309 13:18:05 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@105 -- # locks_exist 521962 00:07:10.309 13:18:05 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 521962 00:07:10.309 13:18:05 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:10.567 lslocks: write error 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@107 -- # killprocess 521959 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 521959 ']' 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 521959 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 521959 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 521959' 00:07:10.567 killing process with pid 521959 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 521959 00:07:10.567 13:18:06 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 521959 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@108 -- # killprocess 521962 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 521962 ']' 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 521962 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 521962 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 521962' 00:07:11.499 killing process with pid 521962 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 521962 00:07:11.499 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 521962 00:07:12.120 00:07:12.120 real 0m3.387s 00:07:12.120 user 0m3.615s 00:07:12.120 sys 0m1.064s 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:12.120 ************************************ 00:07:12.120 END TEST locking_app_on_unlocked_coremask 00:07:12.120 ************************************ 00:07:12.120 13:18:07 event.cpu_locks -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:07:12.120 13:18:07 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:12.120 13:18:07 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:12.120 13:18:07 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:12.120 ************************************ 00:07:12.120 START TEST locking_app_on_locked_coremask 00:07:12.120 ************************************ 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_locked_coremask 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=522512 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@116 -- # waitforlisten 522512 /var/tmp/spdk.sock 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 522512 ']' 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:12.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:12.120 13:18:07 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:12.120 [2024-10-07 13:18:07.897847] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:12.120 [2024-10-07 13:18:07.897941] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid522512 ] 00:07:12.120 [2024-10-07 13:18:07.955147] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.393 [2024-10-07 13:18:08.074417] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=522654 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@120 -- # NOT waitforlisten 522654 /var/tmp/spdk2.sock 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@650 -- # local es=0 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 522654 /var/tmp/spdk2.sock 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # waitforlisten 522654 /var/tmp/spdk2.sock 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 522654 ']' 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:12.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:12.655 13:18:08 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:12.655 [2024-10-07 13:18:08.382911] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:12.655 [2024-10-07 13:18:08.383001] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid522654 ] 00:07:12.656 [2024-10-07 13:18:08.466002] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 522512 has claimed it. 00:07:12.656 [2024-10-07 13:18:08.466056] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:13.223 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 846: kill: (522654) - No such process 00:07:13.223 ERROR: process (pid: 522654) is no longer running 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 1 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # es=1 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@122 -- # locks_exist 522512 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 522512 00:07:13.223 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:13.789 lslocks: write error 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@124 -- # killprocess 522512 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 522512 ']' 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 522512 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 522512 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 522512' 00:07:13.789 killing process with pid 522512 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 522512 00:07:13.789 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 522512 00:07:14.048 00:07:14.048 real 0m2.102s 00:07:14.048 user 0m2.339s 00:07:14.048 sys 0m0.650s 00:07:14.048 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:14.048 13:18:09 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:14.048 ************************************ 00:07:14.048 END TEST locking_app_on_locked_coremask 00:07:14.048 ************************************ 00:07:14.048 13:18:09 event.cpu_locks -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:07:14.048 13:18:09 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:14.048 13:18:09 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:14.048 13:18:09 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:14.306 ************************************ 00:07:14.306 START TEST locking_overlapped_coremask 00:07:14.306 ************************************ 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=523201 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@133 -- # waitforlisten 523201 /var/tmp/spdk.sock 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 523201 ']' 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:14.306 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:14.306 13:18:09 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:14.306 [2024-10-07 13:18:10.044824] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:14.306 [2024-10-07 13:18:10.044944] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid523201 ] 00:07:14.306 [2024-10-07 13:18:10.105311] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:14.306 [2024-10-07 13:18:10.222465] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:14.306 [2024-10-07 13:18:10.222530] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:14.306 [2024-10-07 13:18:10.222535] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 0 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=523212 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@137 -- # NOT waitforlisten 523212 /var/tmp/spdk2.sock 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@650 -- # local es=0 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 523212 /var/tmp/spdk2.sock 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # waitforlisten 523212 /var/tmp/spdk2.sock 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 523212 ']' 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:14.873 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:14.873 13:18:10 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:14.873 [2024-10-07 13:18:10.563260] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:14.873 [2024-10-07 13:18:10.563339] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid523212 ] 00:07:14.873 [2024-10-07 13:18:10.648979] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 523201 has claimed it. 00:07:14.873 [2024-10-07 13:18:10.649042] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:15.438 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 846: kill: (523212) - No such process 00:07:15.438 ERROR: process (pid: 523212) is no longer running 00:07:15.438 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 1 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # es=1 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@141 -- # killprocess 523201 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@950 -- # '[' -z 523201 ']' 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@954 -- # kill -0 523201 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # uname 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 523201 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 523201' 00:07:15.439 killing process with pid 523201 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@969 -- # kill 523201 00:07:15.439 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@974 -- # wait 523201 00:07:16.005 00:07:16.005 real 0m1.791s 00:07:16.005 user 0m4.806s 00:07:16.005 sys 0m0.481s 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:07:16.005 ************************************ 00:07:16.005 END TEST locking_overlapped_coremask 00:07:16.005 ************************************ 00:07:16.005 13:18:11 event.cpu_locks -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:07:16.005 13:18:11 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:16.005 13:18:11 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:16.005 13:18:11 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:16.005 ************************************ 00:07:16.005 START TEST locking_overlapped_coremask_via_rpc 00:07:16.005 ************************************ 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask_via_rpc 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=523376 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@149 -- # waitforlisten 523376 /var/tmp/spdk.sock 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 523376 ']' 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:16.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:16.005 13:18:11 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:16.005 [2024-10-07 13:18:11.889736] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:16.005 [2024-10-07 13:18:11.889817] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid523376 ] 00:07:16.263 [2024-10-07 13:18:11.946627] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:16.263 [2024-10-07 13:18:11.946659] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:16.263 [2024-10-07 13:18:12.049379] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:16.263 [2024-10-07 13:18:12.049445] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:16.263 [2024-10-07 13:18:12.049451] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=523512 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@153 -- # waitforlisten 523512 /var/tmp/spdk2.sock 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 523512 ']' 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:16.522 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:16.522 13:18:12 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:16.522 [2024-10-07 13:18:12.376735] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:16.522 [2024-10-07 13:18:12.376840] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid523512 ] 00:07:16.780 [2024-10-07 13:18:12.465989] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:16.780 [2024-10-07 13:18:12.466031] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:16.780 [2024-10-07 13:18:12.688680] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:07:16.780 [2024-10-07 13:18:12.688738] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:07:16.780 [2024-10-07 13:18:12.688741] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.713 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:17.713 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@650 -- # local es=0 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:17.714 [2024-10-07 13:18:13.389594] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 523376 has claimed it. 00:07:17.714 request: 00:07:17.714 { 00:07:17.714 "method": "framework_enable_cpumask_locks", 00:07:17.714 "req_id": 1 00:07:17.714 } 00:07:17.714 Got JSON-RPC error response 00:07:17.714 response: 00:07:17.714 { 00:07:17.714 "code": -32603, 00:07:17.714 "message": "Failed to claim CPU core: 2" 00:07:17.714 } 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # es=1 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@158 -- # waitforlisten 523376 /var/tmp/spdk.sock 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 523376 ']' 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:17.714 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:17.971 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:17.971 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:07:17.972 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@159 -- # waitforlisten 523512 /var/tmp/spdk2.sock 00:07:17.972 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 523512 ']' 00:07:17.972 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:17.972 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:17.972 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:17.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:17.972 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:17.972 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:18.230 00:07:18.230 real 0m2.097s 00:07:18.230 user 0m1.129s 00:07:18.230 sys 0m0.183s 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:18.230 13:18:13 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:18.230 ************************************ 00:07:18.230 END TEST locking_overlapped_coremask_via_rpc 00:07:18.230 ************************************ 00:07:18.230 13:18:13 event.cpu_locks -- event/cpu_locks.sh@174 -- # cleanup 00:07:18.230 13:18:13 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 523376 ]] 00:07:18.230 13:18:13 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 523376 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 523376 ']' 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 523376 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 523376 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 523376' 00:07:18.230 killing process with pid 523376 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 523376 00:07:18.230 13:18:13 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 523376 00:07:18.796 13:18:14 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 523512 ]] 00:07:18.796 13:18:14 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 523512 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 523512 ']' 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 523512 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 523512 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 523512' 00:07:18.796 killing process with pid 523512 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 523512 00:07:18.796 13:18:14 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 523512 00:07:19.055 13:18:14 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:07:19.055 13:18:14 event.cpu_locks -- event/cpu_locks.sh@1 -- # cleanup 00:07:19.055 13:18:14 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 523376 ]] 00:07:19.055 13:18:14 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 523376 00:07:19.055 13:18:14 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 523376 ']' 00:07:19.055 13:18:14 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 523376 00:07:19.055 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 954: kill: (523376) - No such process 00:07:19.055 13:18:14 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 523376 is not found' 00:07:19.055 Process with pid 523376 is not found 00:07:19.315 13:18:14 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 523512 ]] 00:07:19.315 13:18:14 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 523512 00:07:19.315 13:18:14 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 523512 ']' 00:07:19.315 13:18:14 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 523512 00:07:19.315 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 954: kill: (523512) - No such process 00:07:19.315 13:18:14 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 523512 is not found' 00:07:19.315 Process with pid 523512 is not found 00:07:19.315 13:18:14 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:07:19.315 00:07:19.315 real 0m16.879s 00:07:19.315 user 0m29.864s 00:07:19.315 sys 0m5.468s 00:07:19.315 13:18:14 event.cpu_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:19.315 13:18:14 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:07:19.315 ************************************ 00:07:19.315 END TEST cpu_locks 00:07:19.315 ************************************ 00:07:19.315 00:07:19.315 real 0m43.948s 00:07:19.315 user 1m23.798s 00:07:19.315 sys 0m9.569s 00:07:19.315 13:18:15 event -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:19.315 13:18:15 event -- common/autotest_common.sh@10 -- # set +x 00:07:19.315 ************************************ 00:07:19.315 END TEST event 00:07:19.315 ************************************ 00:07:19.315 13:18:15 -- spdk/autotest.sh@169 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:19.315 13:18:15 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:19.315 13:18:15 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:19.315 13:18:15 -- common/autotest_common.sh@10 -- # set +x 00:07:19.315 ************************************ 00:07:19.315 START TEST thread 00:07:19.315 ************************************ 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:07:19.315 * Looking for test storage... 00:07:19.315 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1681 -- # lcov --version 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:19.315 13:18:15 thread -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:19.315 13:18:15 thread -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:19.315 13:18:15 thread -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:19.315 13:18:15 thread -- scripts/common.sh@336 -- # IFS=.-: 00:07:19.315 13:18:15 thread -- scripts/common.sh@336 -- # read -ra ver1 00:07:19.315 13:18:15 thread -- scripts/common.sh@337 -- # IFS=.-: 00:07:19.315 13:18:15 thread -- scripts/common.sh@337 -- # read -ra ver2 00:07:19.315 13:18:15 thread -- scripts/common.sh@338 -- # local 'op=<' 00:07:19.315 13:18:15 thread -- scripts/common.sh@340 -- # ver1_l=2 00:07:19.315 13:18:15 thread -- scripts/common.sh@341 -- # ver2_l=1 00:07:19.315 13:18:15 thread -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:19.315 13:18:15 thread -- scripts/common.sh@344 -- # case "$op" in 00:07:19.315 13:18:15 thread -- scripts/common.sh@345 -- # : 1 00:07:19.315 13:18:15 thread -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:19.315 13:18:15 thread -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:19.315 13:18:15 thread -- scripts/common.sh@365 -- # decimal 1 00:07:19.315 13:18:15 thread -- scripts/common.sh@353 -- # local d=1 00:07:19.315 13:18:15 thread -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:19.315 13:18:15 thread -- scripts/common.sh@355 -- # echo 1 00:07:19.315 13:18:15 thread -- scripts/common.sh@365 -- # ver1[v]=1 00:07:19.315 13:18:15 thread -- scripts/common.sh@366 -- # decimal 2 00:07:19.315 13:18:15 thread -- scripts/common.sh@353 -- # local d=2 00:07:19.315 13:18:15 thread -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:19.315 13:18:15 thread -- scripts/common.sh@355 -- # echo 2 00:07:19.315 13:18:15 thread -- scripts/common.sh@366 -- # ver2[v]=2 00:07:19.315 13:18:15 thread -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:19.315 13:18:15 thread -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:19.315 13:18:15 thread -- scripts/common.sh@368 -- # return 0 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:19.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.315 --rc genhtml_branch_coverage=1 00:07:19.315 --rc genhtml_function_coverage=1 00:07:19.315 --rc genhtml_legend=1 00:07:19.315 --rc geninfo_all_blocks=1 00:07:19.315 --rc geninfo_unexecuted_blocks=1 00:07:19.315 00:07:19.315 ' 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:19.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.315 --rc genhtml_branch_coverage=1 00:07:19.315 --rc genhtml_function_coverage=1 00:07:19.315 --rc genhtml_legend=1 00:07:19.315 --rc geninfo_all_blocks=1 00:07:19.315 --rc geninfo_unexecuted_blocks=1 00:07:19.315 00:07:19.315 ' 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:19.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.315 --rc genhtml_branch_coverage=1 00:07:19.315 --rc genhtml_function_coverage=1 00:07:19.315 --rc genhtml_legend=1 00:07:19.315 --rc geninfo_all_blocks=1 00:07:19.315 --rc geninfo_unexecuted_blocks=1 00:07:19.315 00:07:19.315 ' 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:19.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.315 --rc genhtml_branch_coverage=1 00:07:19.315 --rc genhtml_function_coverage=1 00:07:19.315 --rc genhtml_legend=1 00:07:19.315 --rc geninfo_all_blocks=1 00:07:19.315 --rc geninfo_unexecuted_blocks=1 00:07:19.315 00:07:19.315 ' 00:07:19.315 13:18:15 thread -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:19.315 13:18:15 thread -- common/autotest_common.sh@10 -- # set +x 00:07:19.315 ************************************ 00:07:19.315 START TEST thread_poller_perf 00:07:19.315 ************************************ 00:07:19.315 13:18:15 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:19.574 [2024-10-07 13:18:15.258363] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:19.574 [2024-10-07 13:18:15.258432] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid523889 ] 00:07:19.574 [2024-10-07 13:18:15.315879] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.574 [2024-10-07 13:18:15.420773] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.574 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:20.948 [2024-10-07T11:18:16.881Z] ====================================== 00:07:20.948 [2024-10-07T11:18:16.881Z] busy:2706972615 (cyc) 00:07:20.948 [2024-10-07T11:18:16.881Z] total_run_count: 366000 00:07:20.948 [2024-10-07T11:18:16.881Z] tsc_hz: 2700000000 (cyc) 00:07:20.948 [2024-10-07T11:18:16.881Z] ====================================== 00:07:20.948 [2024-10-07T11:18:16.881Z] poller_cost: 7396 (cyc), 2739 (nsec) 00:07:20.948 00:07:20.948 real 0m1.297s 00:07:20.948 user 0m1.213s 00:07:20.948 sys 0m0.079s 00:07:20.948 13:18:16 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:20.948 13:18:16 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:07:20.948 ************************************ 00:07:20.948 END TEST thread_poller_perf 00:07:20.948 ************************************ 00:07:20.948 13:18:16 thread -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:20.948 13:18:16 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:07:20.948 13:18:16 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:20.948 13:18:16 thread -- common/autotest_common.sh@10 -- # set +x 00:07:20.948 ************************************ 00:07:20.948 START TEST thread_poller_perf 00:07:20.948 ************************************ 00:07:20.948 13:18:16 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:20.948 [2024-10-07 13:18:16.600309] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:20.948 [2024-10-07 13:18:16.600380] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid524119 ] 00:07:20.948 [2024-10-07 13:18:16.659270] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.948 [2024-10-07 13:18:16.764252] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.948 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:22.321 [2024-10-07T11:18:18.254Z] ====================================== 00:07:22.321 [2024-10-07T11:18:18.254Z] busy:2702092797 (cyc) 00:07:22.321 [2024-10-07T11:18:18.254Z] total_run_count: 4827000 00:07:22.321 [2024-10-07T11:18:18.254Z] tsc_hz: 2700000000 (cyc) 00:07:22.321 [2024-10-07T11:18:18.254Z] ====================================== 00:07:22.321 [2024-10-07T11:18:18.254Z] poller_cost: 559 (cyc), 207 (nsec) 00:07:22.321 00:07:22.321 real 0m1.288s 00:07:22.321 user 0m1.208s 00:07:22.321 sys 0m0.075s 00:07:22.321 13:18:17 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:22.321 13:18:17 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:07:22.321 ************************************ 00:07:22.321 END TEST thread_poller_perf 00:07:22.321 ************************************ 00:07:22.321 13:18:17 thread -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:22.321 00:07:22.321 real 0m2.827s 00:07:22.321 user 0m2.554s 00:07:22.321 sys 0m0.278s 00:07:22.321 13:18:17 thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:22.321 13:18:17 thread -- common/autotest_common.sh@10 -- # set +x 00:07:22.321 ************************************ 00:07:22.321 END TEST thread 00:07:22.321 ************************************ 00:07:22.321 13:18:17 -- spdk/autotest.sh@171 -- # [[ 0 -eq 1 ]] 00:07:22.321 13:18:17 -- spdk/autotest.sh@176 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:22.321 13:18:17 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:22.321 13:18:17 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:22.321 13:18:17 -- common/autotest_common.sh@10 -- # set +x 00:07:22.321 ************************************ 00:07:22.321 START TEST app_cmdline 00:07:22.321 ************************************ 00:07:22.321 13:18:17 app_cmdline -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:22.321 * Looking for test storage... 00:07:22.321 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:22.321 13:18:18 app_cmdline -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:22.321 13:18:18 app_cmdline -- common/autotest_common.sh@1681 -- # lcov --version 00:07:22.321 13:18:18 app_cmdline -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:22.321 13:18:18 app_cmdline -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@336 -- # IFS=.-: 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@336 -- # read -ra ver1 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@337 -- # IFS=.-: 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@337 -- # read -ra ver2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@338 -- # local 'op=<' 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@340 -- # ver1_l=2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@341 -- # ver2_l=1 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@344 -- # case "$op" in 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@345 -- # : 1 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@365 -- # decimal 1 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@353 -- # local d=1 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@355 -- # echo 1 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@365 -- # ver1[v]=1 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@366 -- # decimal 2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@353 -- # local d=2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@355 -- # echo 2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@366 -- # ver2[v]=2 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:22.321 13:18:18 app_cmdline -- scripts/common.sh@368 -- # return 0 00:07:22.321 13:18:18 app_cmdline -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:22.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:22.322 --rc genhtml_branch_coverage=1 00:07:22.322 --rc genhtml_function_coverage=1 00:07:22.322 --rc genhtml_legend=1 00:07:22.322 --rc geninfo_all_blocks=1 00:07:22.322 --rc geninfo_unexecuted_blocks=1 00:07:22.322 00:07:22.322 ' 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:22.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:22.322 --rc genhtml_branch_coverage=1 00:07:22.322 --rc genhtml_function_coverage=1 00:07:22.322 --rc genhtml_legend=1 00:07:22.322 --rc geninfo_all_blocks=1 00:07:22.322 --rc geninfo_unexecuted_blocks=1 00:07:22.322 00:07:22.322 ' 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:22.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:22.322 --rc genhtml_branch_coverage=1 00:07:22.322 --rc genhtml_function_coverage=1 00:07:22.322 --rc genhtml_legend=1 00:07:22.322 --rc geninfo_all_blocks=1 00:07:22.322 --rc geninfo_unexecuted_blocks=1 00:07:22.322 00:07:22.322 ' 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:22.322 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:22.322 --rc genhtml_branch_coverage=1 00:07:22.322 --rc genhtml_function_coverage=1 00:07:22.322 --rc genhtml_legend=1 00:07:22.322 --rc geninfo_all_blocks=1 00:07:22.322 --rc geninfo_unexecuted_blocks=1 00:07:22.322 00:07:22.322 ' 00:07:22.322 13:18:18 app_cmdline -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:22.322 13:18:18 app_cmdline -- app/cmdline.sh@17 -- # spdk_tgt_pid=524369 00:07:22.322 13:18:18 app_cmdline -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:22.322 13:18:18 app_cmdline -- app/cmdline.sh@18 -- # waitforlisten 524369 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@831 -- # '[' -z 524369 ']' 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:22.322 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:22.322 13:18:18 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:07:22.322 [2024-10-07 13:18:18.149640] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:22.322 [2024-10-07 13:18:18.149722] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid524369 ] 00:07:22.322 [2024-10-07 13:18:18.206691] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.587 [2024-10-07 13:18:18.313567] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.847 13:18:18 app_cmdline -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:22.847 13:18:18 app_cmdline -- common/autotest_common.sh@864 -- # return 0 00:07:22.847 13:18:18 app_cmdline -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:23.105 { 00:07:23.105 "version": "SPDK v25.01-pre git sha1 2a4f56c54", 00:07:23.105 "fields": { 00:07:23.105 "major": 25, 00:07:23.105 "minor": 1, 00:07:23.105 "patch": 0, 00:07:23.105 "suffix": "-pre", 00:07:23.105 "commit": "2a4f56c54" 00:07:23.105 } 00:07:23.105 } 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@22 -- # expected_methods=() 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@26 -- # sort 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:23.105 13:18:18 app_cmdline -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@650 -- # local es=0 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:23.105 13:18:18 app_cmdline -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:23.363 request: 00:07:23.363 { 00:07:23.363 "method": "env_dpdk_get_mem_stats", 00:07:23.363 "req_id": 1 00:07:23.363 } 00:07:23.363 Got JSON-RPC error response 00:07:23.363 response: 00:07:23.363 { 00:07:23.363 "code": -32601, 00:07:23.363 "message": "Method not found" 00:07:23.363 } 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@653 -- # es=1 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:23.363 13:18:19 app_cmdline -- app/cmdline.sh@1 -- # killprocess 524369 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@950 -- # '[' -z 524369 ']' 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@954 -- # kill -0 524369 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@955 -- # uname 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 524369 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@968 -- # echo 'killing process with pid 524369' 00:07:23.363 killing process with pid 524369 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@969 -- # kill 524369 00:07:23.363 13:18:19 app_cmdline -- common/autotest_common.sh@974 -- # wait 524369 00:07:23.929 00:07:23.929 real 0m1.717s 00:07:23.929 user 0m2.078s 00:07:23.929 sys 0m0.496s 00:07:23.930 13:18:19 app_cmdline -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:23.930 13:18:19 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:07:23.930 ************************************ 00:07:23.930 END TEST app_cmdline 00:07:23.930 ************************************ 00:07:23.930 13:18:19 -- spdk/autotest.sh@177 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:23.930 13:18:19 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:23.930 13:18:19 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:23.930 13:18:19 -- common/autotest_common.sh@10 -- # set +x 00:07:23.930 ************************************ 00:07:23.930 START TEST version 00:07:23.930 ************************************ 00:07:23.930 13:18:19 version -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:23.930 * Looking for test storage... 00:07:23.930 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:23.930 13:18:19 version -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:23.930 13:18:19 version -- common/autotest_common.sh@1681 -- # lcov --version 00:07:23.930 13:18:19 version -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:23.930 13:18:19 version -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:23.930 13:18:19 version -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:23.930 13:18:19 version -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:23.930 13:18:19 version -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:23.930 13:18:19 version -- scripts/common.sh@336 -- # IFS=.-: 00:07:23.930 13:18:19 version -- scripts/common.sh@336 -- # read -ra ver1 00:07:23.930 13:18:19 version -- scripts/common.sh@337 -- # IFS=.-: 00:07:23.930 13:18:19 version -- scripts/common.sh@337 -- # read -ra ver2 00:07:23.930 13:18:19 version -- scripts/common.sh@338 -- # local 'op=<' 00:07:23.930 13:18:19 version -- scripts/common.sh@340 -- # ver1_l=2 00:07:23.930 13:18:19 version -- scripts/common.sh@341 -- # ver2_l=1 00:07:23.930 13:18:19 version -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:23.930 13:18:19 version -- scripts/common.sh@344 -- # case "$op" in 00:07:23.930 13:18:19 version -- scripts/common.sh@345 -- # : 1 00:07:23.930 13:18:19 version -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:23.930 13:18:19 version -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:23.930 13:18:19 version -- scripts/common.sh@365 -- # decimal 1 00:07:23.930 13:18:19 version -- scripts/common.sh@353 -- # local d=1 00:07:23.930 13:18:19 version -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:23.930 13:18:19 version -- scripts/common.sh@355 -- # echo 1 00:07:23.930 13:18:19 version -- scripts/common.sh@365 -- # ver1[v]=1 00:07:23.930 13:18:19 version -- scripts/common.sh@366 -- # decimal 2 00:07:23.930 13:18:19 version -- scripts/common.sh@353 -- # local d=2 00:07:23.930 13:18:19 version -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:23.930 13:18:19 version -- scripts/common.sh@355 -- # echo 2 00:07:23.930 13:18:19 version -- scripts/common.sh@366 -- # ver2[v]=2 00:07:23.930 13:18:19 version -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:23.930 13:18:19 version -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:23.930 13:18:19 version -- scripts/common.sh@368 -- # return 0 00:07:23.930 13:18:19 version -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:23.930 13:18:19 version -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:23.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:23.930 --rc genhtml_branch_coverage=1 00:07:23.930 --rc genhtml_function_coverage=1 00:07:23.930 --rc genhtml_legend=1 00:07:23.930 --rc geninfo_all_blocks=1 00:07:23.930 --rc geninfo_unexecuted_blocks=1 00:07:23.930 00:07:23.930 ' 00:07:24.189 13:18:19 version -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:24.189 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.189 --rc genhtml_branch_coverage=1 00:07:24.189 --rc genhtml_function_coverage=1 00:07:24.189 --rc genhtml_legend=1 00:07:24.189 --rc geninfo_all_blocks=1 00:07:24.189 --rc geninfo_unexecuted_blocks=1 00:07:24.189 00:07:24.189 ' 00:07:24.189 13:18:19 version -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:24.189 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.189 --rc genhtml_branch_coverage=1 00:07:24.189 --rc genhtml_function_coverage=1 00:07:24.189 --rc genhtml_legend=1 00:07:24.189 --rc geninfo_all_blocks=1 00:07:24.189 --rc geninfo_unexecuted_blocks=1 00:07:24.189 00:07:24.189 ' 00:07:24.189 13:18:19 version -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:24.189 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.189 --rc genhtml_branch_coverage=1 00:07:24.189 --rc genhtml_function_coverage=1 00:07:24.189 --rc genhtml_legend=1 00:07:24.189 --rc geninfo_all_blocks=1 00:07:24.189 --rc geninfo_unexecuted_blocks=1 00:07:24.189 00:07:24.189 ' 00:07:24.189 13:18:19 version -- app/version.sh@17 -- # get_header_version major 00:07:24.189 13:18:19 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # cut -f2 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # tr -d '"' 00:07:24.189 13:18:19 version -- app/version.sh@17 -- # major=25 00:07:24.189 13:18:19 version -- app/version.sh@18 -- # get_header_version minor 00:07:24.189 13:18:19 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # cut -f2 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # tr -d '"' 00:07:24.189 13:18:19 version -- app/version.sh@18 -- # minor=1 00:07:24.189 13:18:19 version -- app/version.sh@19 -- # get_header_version patch 00:07:24.189 13:18:19 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # cut -f2 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # tr -d '"' 00:07:24.189 13:18:19 version -- app/version.sh@19 -- # patch=0 00:07:24.189 13:18:19 version -- app/version.sh@20 -- # get_header_version suffix 00:07:24.189 13:18:19 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # cut -f2 00:07:24.189 13:18:19 version -- app/version.sh@14 -- # tr -d '"' 00:07:24.189 13:18:19 version -- app/version.sh@20 -- # suffix=-pre 00:07:24.189 13:18:19 version -- app/version.sh@22 -- # version=25.1 00:07:24.189 13:18:19 version -- app/version.sh@25 -- # (( patch != 0 )) 00:07:24.189 13:18:19 version -- app/version.sh@28 -- # version=25.1rc0 00:07:24.189 13:18:19 version -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:24.189 13:18:19 version -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:24.189 13:18:19 version -- app/version.sh@30 -- # py_version=25.1rc0 00:07:24.189 13:18:19 version -- app/version.sh@31 -- # [[ 25.1rc0 == \2\5\.\1\r\c\0 ]] 00:07:24.189 00:07:24.189 real 0m0.197s 00:07:24.189 user 0m0.131s 00:07:24.189 sys 0m0.092s 00:07:24.189 13:18:19 version -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:24.189 13:18:19 version -- common/autotest_common.sh@10 -- # set +x 00:07:24.189 ************************************ 00:07:24.189 END TEST version 00:07:24.189 ************************************ 00:07:24.189 13:18:19 -- spdk/autotest.sh@179 -- # '[' 0 -eq 1 ']' 00:07:24.189 13:18:19 -- spdk/autotest.sh@188 -- # [[ 0 -eq 1 ]] 00:07:24.189 13:18:19 -- spdk/autotest.sh@194 -- # uname -s 00:07:24.189 13:18:19 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:07:24.189 13:18:19 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:24.189 13:18:19 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:24.189 13:18:19 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:07:24.189 13:18:19 -- spdk/autotest.sh@252 -- # '[' 0 -eq 1 ']' 00:07:24.189 13:18:19 -- spdk/autotest.sh@256 -- # timing_exit lib 00:07:24.189 13:18:19 -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:24.189 13:18:19 -- common/autotest_common.sh@10 -- # set +x 00:07:24.189 13:18:19 -- spdk/autotest.sh@258 -- # '[' 0 -eq 1 ']' 00:07:24.189 13:18:19 -- spdk/autotest.sh@263 -- # '[' 0 -eq 1 ']' 00:07:24.189 13:18:19 -- spdk/autotest.sh@272 -- # '[' 1 -eq 1 ']' 00:07:24.189 13:18:19 -- spdk/autotest.sh@273 -- # export NET_TYPE 00:07:24.190 13:18:19 -- spdk/autotest.sh@276 -- # '[' tcp = rdma ']' 00:07:24.190 13:18:19 -- spdk/autotest.sh@279 -- # '[' tcp = tcp ']' 00:07:24.190 13:18:19 -- spdk/autotest.sh@280 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:24.190 13:18:19 -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:07:24.190 13:18:19 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:24.190 13:18:19 -- common/autotest_common.sh@10 -- # set +x 00:07:24.190 ************************************ 00:07:24.190 START TEST nvmf_tcp 00:07:24.190 ************************************ 00:07:24.190 13:18:19 nvmf_tcp -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:24.190 * Looking for test storage... 00:07:24.190 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1681 -- # lcov --version 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@336 -- # IFS=.-: 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@336 -- # read -ra ver1 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@337 -- # IFS=.-: 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@337 -- # read -ra ver2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@338 -- # local 'op=<' 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@340 -- # ver1_l=2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@341 -- # ver2_l=1 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@344 -- # case "$op" in 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@345 -- # : 1 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@365 -- # decimal 1 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@353 -- # local d=1 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@355 -- # echo 1 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@365 -- # ver1[v]=1 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@366 -- # decimal 2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@353 -- # local d=2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@355 -- # echo 2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@366 -- # ver2[v]=2 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:24.190 13:18:20 nvmf_tcp -- scripts/common.sh@368 -- # return 0 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:24.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.190 --rc genhtml_branch_coverage=1 00:07:24.190 --rc genhtml_function_coverage=1 00:07:24.190 --rc genhtml_legend=1 00:07:24.190 --rc geninfo_all_blocks=1 00:07:24.190 --rc geninfo_unexecuted_blocks=1 00:07:24.190 00:07:24.190 ' 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:24.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.190 --rc genhtml_branch_coverage=1 00:07:24.190 --rc genhtml_function_coverage=1 00:07:24.190 --rc genhtml_legend=1 00:07:24.190 --rc geninfo_all_blocks=1 00:07:24.190 --rc geninfo_unexecuted_blocks=1 00:07:24.190 00:07:24.190 ' 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:24.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.190 --rc genhtml_branch_coverage=1 00:07:24.190 --rc genhtml_function_coverage=1 00:07:24.190 --rc genhtml_legend=1 00:07:24.190 --rc geninfo_all_blocks=1 00:07:24.190 --rc geninfo_unexecuted_blocks=1 00:07:24.190 00:07:24.190 ' 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:24.190 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.190 --rc genhtml_branch_coverage=1 00:07:24.190 --rc genhtml_function_coverage=1 00:07:24.190 --rc genhtml_legend=1 00:07:24.190 --rc geninfo_all_blocks=1 00:07:24.190 --rc geninfo_unexecuted_blocks=1 00:07:24.190 00:07:24.190 ' 00:07:24.190 13:18:20 nvmf_tcp -- nvmf/nvmf.sh@10 -- # uname -s 00:07:24.190 13:18:20 nvmf_tcp -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:24.190 13:18:20 nvmf_tcp -- nvmf/nvmf.sh@14 -- # run_test nvmf_target_core /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:24.190 13:18:20 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:07:24.450 ************************************ 00:07:24.450 START TEST nvmf_target_core 00:07:24.450 ************************************ 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:07:24.450 * Looking for test storage... 00:07:24.450 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lcov --version 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # IFS=.-: 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # read -ra ver1 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # IFS=.-: 00:07:24.450 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # read -ra ver2 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@338 -- # local 'op=<' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@340 -- # ver1_l=2 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@341 -- # ver2_l=1 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@344 -- # case "$op" in 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@345 -- # : 1 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # decimal 1 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=1 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 1 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # ver1[v]=1 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # decimal 2 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=2 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 2 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # ver2[v]=2 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # return 0 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:24.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.451 --rc genhtml_branch_coverage=1 00:07:24.451 --rc genhtml_function_coverage=1 00:07:24.451 --rc genhtml_legend=1 00:07:24.451 --rc geninfo_all_blocks=1 00:07:24.451 --rc geninfo_unexecuted_blocks=1 00:07:24.451 00:07:24.451 ' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:24.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.451 --rc genhtml_branch_coverage=1 00:07:24.451 --rc genhtml_function_coverage=1 00:07:24.451 --rc genhtml_legend=1 00:07:24.451 --rc geninfo_all_blocks=1 00:07:24.451 --rc geninfo_unexecuted_blocks=1 00:07:24.451 00:07:24.451 ' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:24.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.451 --rc genhtml_branch_coverage=1 00:07:24.451 --rc genhtml_function_coverage=1 00:07:24.451 --rc genhtml_legend=1 00:07:24.451 --rc geninfo_all_blocks=1 00:07:24.451 --rc geninfo_unexecuted_blocks=1 00:07:24.451 00:07:24.451 ' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:24.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.451 --rc genhtml_branch_coverage=1 00:07:24.451 --rc genhtml_function_coverage=1 00:07:24.451 --rc genhtml_legend=1 00:07:24.451 --rc geninfo_all_blocks=1 00:07:24.451 --rc geninfo_unexecuted_blocks=1 00:07:24.451 00:07:24.451 ' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # uname -s 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # uname -s 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@15 -- # shopt -s extglob 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- paths/export.sh@5 -- # export PATH 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@51 -- # : 0 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:24.451 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@18 -- # TEST_ARGS=("$@") 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@20 -- # [[ 0 -eq 0 ]] 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@21 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:07:24.451 ************************************ 00:07:24.451 START TEST nvmf_abort 00:07:24.451 ************************************ 00:07:24.451 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:07:24.711 * Looking for test storage... 00:07:24.711 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # lcov --version 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@336 -- # IFS=.-: 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@336 -- # read -ra ver1 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@337 -- # IFS=.-: 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@337 -- # read -ra ver2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@338 -- # local 'op=<' 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@340 -- # ver1_l=2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@341 -- # ver2_l=1 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@344 -- # case "$op" in 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@345 -- # : 1 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@365 -- # decimal 1 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@353 -- # local d=1 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@355 -- # echo 1 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@365 -- # ver1[v]=1 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@366 -- # decimal 2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@353 -- # local d=2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@355 -- # echo 2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@366 -- # ver2[v]=2 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@368 -- # return 0 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:24.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.711 --rc genhtml_branch_coverage=1 00:07:24.711 --rc genhtml_function_coverage=1 00:07:24.711 --rc genhtml_legend=1 00:07:24.711 --rc geninfo_all_blocks=1 00:07:24.711 --rc geninfo_unexecuted_blocks=1 00:07:24.711 00:07:24.711 ' 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:24.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.711 --rc genhtml_branch_coverage=1 00:07:24.711 --rc genhtml_function_coverage=1 00:07:24.711 --rc genhtml_legend=1 00:07:24.711 --rc geninfo_all_blocks=1 00:07:24.711 --rc geninfo_unexecuted_blocks=1 00:07:24.711 00:07:24.711 ' 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:24.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.711 --rc genhtml_branch_coverage=1 00:07:24.711 --rc genhtml_function_coverage=1 00:07:24.711 --rc genhtml_legend=1 00:07:24.711 --rc geninfo_all_blocks=1 00:07:24.711 --rc geninfo_unexecuted_blocks=1 00:07:24.711 00:07:24.711 ' 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:24.711 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:24.711 --rc genhtml_branch_coverage=1 00:07:24.711 --rc genhtml_function_coverage=1 00:07:24.711 --rc genhtml_legend=1 00:07:24.711 --rc geninfo_all_blocks=1 00:07:24.711 --rc geninfo_unexecuted_blocks=1 00:07:24.711 00:07:24.711 ' 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:24.711 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@7 -- # uname -s 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@15 -- # shopt -s extglob 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@5 -- # export PATH 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@51 -- # : 0 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:24.712 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@14 -- # nvmftestinit 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@474 -- # prepare_net_devs 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@436 -- # local -g is_hw=no 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@438 -- # remove_spdk_ns 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@309 -- # xtrace_disable 00:07:24.712 13:18:20 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@315 -- # pci_devs=() 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@315 -- # local -a pci_devs 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@316 -- # pci_net_devs=() 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@317 -- # pci_drivers=() 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@317 -- # local -A pci_drivers 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@319 -- # net_devs=() 00:07:27.248 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@319 -- # local -ga net_devs 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@320 -- # e810=() 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@320 -- # local -ga e810 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@321 -- # x722=() 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@321 -- # local -ga x722 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@322 -- # mlx=() 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@322 -- # local -ga mlx 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:07:27.249 Found 0000:84:00.0 (0x8086 - 0x159b) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:07:27.249 Found 0000:84:00.1 (0x8086 - 0x159b) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@416 -- # [[ up == up ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:07:27.249 Found net devices under 0000:84:00.0: cvl_0_0 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@416 -- # [[ up == up ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:07:27.249 Found net devices under 0000:84:00.1: cvl_0_1 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@440 -- # is_hw=yes 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:07:27.249 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:27.249 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:07:27.249 00:07:27.249 --- 10.0.0.2 ping statistics --- 00:07:27.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:27.249 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:27.249 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:27.249 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.187 ms 00:07:27.249 00:07:27.249 --- 10.0.0.1 ping statistics --- 00:07:27.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:27.249 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@448 -- # return 0 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@507 -- # nvmfpid=526476 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@508 -- # waitforlisten 526476 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@831 -- # '[' -z 526476 ']' 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:27.249 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.250 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:27.250 13:18:22 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.250 [2024-10-07 13:18:22.940595] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:27.250 [2024-10-07 13:18:22.940697] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:27.250 [2024-10-07 13:18:23.009460] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:27.250 [2024-10-07 13:18:23.122532] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:27.250 [2024-10-07 13:18:23.122605] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:27.250 [2024-10-07 13:18:23.122636] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:27.250 [2024-10-07 13:18:23.122648] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:27.250 [2024-10-07 13:18:23.122658] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:27.250 [2024-10-07 13:18:23.123662] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:27.250 [2024-10-07 13:18:23.123726] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:07:27.250 [2024-10-07 13:18:23.123732] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@864 -- # return 0 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 [2024-10-07 13:18:23.270189] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 Malloc0 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 Delay0 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 [2024-10-07 13:18:23.333099] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.508 13:18:23 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:07:27.508 [2024-10-07 13:18:23.428647] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:07:30.037 Initializing NVMe Controllers 00:07:30.037 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:07:30.037 controller IO queue size 128 less than required 00:07:30.037 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:07:30.037 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:07:30.037 Initialization complete. Launching workers. 00:07:30.037 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 27887 00:07:30.037 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 27948, failed to submit 62 00:07:30.037 success 27891, unsuccessful 57, failed 0 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@38 -- # nvmftestfini 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@514 -- # nvmfcleanup 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@121 -- # sync 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@124 -- # set +e 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@125 -- # for i in {1..20} 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:07:30.037 rmmod nvme_tcp 00:07:30.037 rmmod nvme_fabrics 00:07:30.037 rmmod nvme_keyring 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@128 -- # set -e 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@129 -- # return 0 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@515 -- # '[' -n 526476 ']' 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@516 -- # killprocess 526476 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@950 -- # '[' -z 526476 ']' 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@954 -- # kill -0 526476 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@955 -- # uname 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 526476 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@968 -- # echo 'killing process with pid 526476' 00:07:30.037 killing process with pid 526476 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@969 -- # kill 526476 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@974 -- # wait 526476 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@297 -- # iptr 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # iptables-save 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # iptables-restore 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@302 -- # remove_spdk_ns 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:07:30.037 13:18:25 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:07:32.574 00:07:32.574 real 0m7.601s 00:07:32.574 user 0m10.629s 00:07:32.574 sys 0m2.734s 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:07:32.574 ************************************ 00:07:32.574 END TEST nvmf_abort 00:07:32.574 ************************************ 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@22 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:07:32.574 ************************************ 00:07:32.574 START TEST nvmf_ns_hotplug_stress 00:07:32.574 ************************************ 00:07:32.574 13:18:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:07:32.574 * Looking for test storage... 00:07:32.574 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # lcov --version 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@336 -- # IFS=.-: 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@336 -- # read -ra ver1 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@337 -- # IFS=.-: 00:07:32.574 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@337 -- # read -ra ver2 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@338 -- # local 'op=<' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@340 -- # ver1_l=2 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@341 -- # ver2_l=1 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@344 -- # case "$op" in 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@345 -- # : 1 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@365 -- # decimal 1 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@353 -- # local d=1 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@355 -- # echo 1 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@365 -- # ver1[v]=1 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@366 -- # decimal 2 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@353 -- # local d=2 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@355 -- # echo 2 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@366 -- # ver2[v]=2 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@368 -- # return 0 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:32.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.575 --rc genhtml_branch_coverage=1 00:07:32.575 --rc genhtml_function_coverage=1 00:07:32.575 --rc genhtml_legend=1 00:07:32.575 --rc geninfo_all_blocks=1 00:07:32.575 --rc geninfo_unexecuted_blocks=1 00:07:32.575 00:07:32.575 ' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:32.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.575 --rc genhtml_branch_coverage=1 00:07:32.575 --rc genhtml_function_coverage=1 00:07:32.575 --rc genhtml_legend=1 00:07:32.575 --rc geninfo_all_blocks=1 00:07:32.575 --rc geninfo_unexecuted_blocks=1 00:07:32.575 00:07:32.575 ' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:32.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.575 --rc genhtml_branch_coverage=1 00:07:32.575 --rc genhtml_function_coverage=1 00:07:32.575 --rc genhtml_legend=1 00:07:32.575 --rc geninfo_all_blocks=1 00:07:32.575 --rc geninfo_unexecuted_blocks=1 00:07:32.575 00:07:32.575 ' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:32.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.575 --rc genhtml_branch_coverage=1 00:07:32.575 --rc genhtml_function_coverage=1 00:07:32.575 --rc genhtml_legend=1 00:07:32.575 --rc geninfo_all_blocks=1 00:07:32.575 --rc geninfo_unexecuted_blocks=1 00:07:32.575 00:07:32.575 ' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@7 -- # uname -s 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@15 -- # shopt -s extglob 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@5 -- # export PATH 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@51 -- # : 0 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:32.575 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@474 -- # prepare_net_devs 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@436 -- # local -g is_hw=no 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@438 -- # remove_spdk_ns 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@309 -- # xtrace_disable 00:07:32.575 13:18:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@315 -- # pci_devs=() 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@315 -- # local -a pci_devs 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@316 -- # pci_net_devs=() 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@317 -- # pci_drivers=() 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@317 -- # local -A pci_drivers 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@319 -- # net_devs=() 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@319 -- # local -ga net_devs 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@320 -- # e810=() 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@320 -- # local -ga e810 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@321 -- # x722=() 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@321 -- # local -ga x722 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@322 -- # mlx=() 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@322 -- # local -ga mlx 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:34.477 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:07:34.478 Found 0000:84:00.0 (0x8086 - 0x159b) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:07:34.478 Found 0000:84:00.1 (0x8086 - 0x159b) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@416 -- # [[ up == up ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:07:34.478 Found net devices under 0000:84:00.0: cvl_0_0 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@416 -- # [[ up == up ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:07:34.478 Found net devices under 0000:84:00.1: cvl_0_1 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@440 -- # is_hw=yes 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:07:34.478 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:07:34.737 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:34.737 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.320 ms 00:07:34.737 00:07:34.737 --- 10.0.0.2 ping statistics --- 00:07:34.737 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:34.737 rtt min/avg/max/mdev = 0.320/0.320/0.320/0.000 ms 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:34.737 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:34.737 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:07:34.737 00:07:34.737 --- 10.0.0.1 ping statistics --- 00:07:34.737 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:34.737 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@448 -- # return 0 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@507 -- # nvmfpid=528862 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@508 -- # waitforlisten 528862 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@831 -- # '[' -z 528862 ']' 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:34.737 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:34.737 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:07:34.737 [2024-10-07 13:18:30.555391] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:07:34.737 [2024-10-07 13:18:30.555462] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:34.737 [2024-10-07 13:18:30.621053] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:34.995 [2024-10-07 13:18:30.728824] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:34.995 [2024-10-07 13:18:30.728901] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:34.995 [2024-10-07 13:18:30.728924] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:34.995 [2024-10-07 13:18:30.728936] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:34.995 [2024-10-07 13:18:30.728946] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:34.995 [2024-10-07 13:18:30.729982] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:34.995 [2024-10-07 13:18:30.730087] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:07:34.995 [2024-10-07 13:18:30.730096] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@864 -- # return 0 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:07:34.995 13:18:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:07:35.253 [2024-10-07 13:18:31.119590] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:35.253 13:18:31 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:07:35.512 13:18:31 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:35.770 [2024-10-07 13:18:31.675514] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:35.770 13:18:31 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:36.027 13:18:31 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:07:36.292 Malloc0 00:07:36.550 13:18:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:07:36.807 Delay0 00:07:36.807 13:18:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:37.065 13:18:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:07:37.324 NULL1 00:07:37.324 13:18:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:07:37.582 13:18:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=529159 00:07:37.582 13:18:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:07:37.582 13:18:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:37.582 13:18:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:38.954 Read completed with error (sct=0, sc=11) 00:07:38.954 13:18:34 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:38.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:38.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:38.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:38.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:38.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:38.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:38.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:38.954 13:18:34 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:07:38.954 13:18:34 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:07:39.540 true 00:07:39.540 13:18:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:39.540 13:18:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:40.105 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:40.105 13:18:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:40.363 13:18:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:07:40.363 13:18:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:07:40.620 true 00:07:40.620 13:18:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:40.620 13:18:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:40.878 13:18:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:41.136 13:18:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:07:41.136 13:18:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:07:41.393 true 00:07:41.393 13:18:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:41.393 13:18:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:41.650 13:18:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:41.907 13:18:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:07:41.907 13:18:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:07:42.164 true 00:07:42.422 13:18:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:42.422 13:18:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:43.353 13:18:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:43.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:43.353 13:18:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:07:43.353 13:18:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:07:43.616 true 00:07:43.616 13:18:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:43.616 13:18:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:43.916 13:18:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:44.204 13:18:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:07:44.204 13:18:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:07:44.461 true 00:07:44.461 13:18:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:44.461 13:18:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:44.719 13:18:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:45.284 13:18:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:07:45.284 13:18:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:07:45.284 true 00:07:45.542 13:18:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:45.542 13:18:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:46.474 13:18:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:46.474 13:18:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:07:46.474 13:18:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:07:46.731 true 00:07:46.731 13:18:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:46.731 13:18:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:46.989 13:18:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:47.553 13:18:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:07:47.553 13:18:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:07:47.553 true 00:07:47.553 13:18:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:47.553 13:18:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:48.117 13:18:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:48.117 13:18:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:07:48.117 13:18:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:07:48.375 true 00:07:48.375 13:18:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:48.375 13:18:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:49.305 13:18:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:49.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:49.563 13:18:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:07:49.563 13:18:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:07:49.821 true 00:07:49.821 13:18:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:49.821 13:18:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:50.385 13:18:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:50.385 13:18:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:07:50.385 13:18:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:07:50.642 true 00:07:50.642 13:18:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:50.642 13:18:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:51.207 13:18:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:51.207 13:18:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:07:51.207 13:18:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:07:51.772 true 00:07:51.772 13:18:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:51.772 13:18:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:52.703 13:18:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:52.703 13:18:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:07:52.703 13:18:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:07:52.960 true 00:07:52.960 13:18:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:52.960 13:18:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:53.217 13:18:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:53.781 13:18:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:07:53.781 13:18:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:07:53.781 true 00:07:53.781 13:18:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:53.781 13:18:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:54.038 13:18:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:54.602 13:18:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:07:54.602 13:18:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:07:54.602 true 00:07:54.860 13:18:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:54.860 13:18:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:55.424 13:18:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:55.681 13:18:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:07:55.681 13:18:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:07:55.938 true 00:07:56.195 13:18:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:56.195 13:18:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:56.452 13:18:52 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:56.710 13:18:52 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:07:56.710 13:18:52 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:07:56.967 true 00:07:56.967 13:18:52 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:56.967 13:18:52 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:57.224 13:18:52 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:57.482 13:18:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:07:57.482 13:18:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:07:57.739 true 00:07:57.739 13:18:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:57.739 13:18:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:58.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:07:58.670 13:18:54 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:58.927 13:18:54 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:07:58.927 13:18:54 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:07:59.184 true 00:07:59.184 13:18:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:07:59.184 13:18:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:07:59.442 13:18:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:07:59.699 13:18:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:07:59.699 13:18:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:07:59.957 true 00:08:00.214 13:18:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:00.214 13:18:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:00.471 13:18:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:00.729 13:18:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:08:00.729 13:18:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:08:00.986 true 00:08:00.986 13:18:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:00.986 13:18:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:01.917 13:18:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:02.174 13:18:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:08:02.174 13:18:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:08:02.431 true 00:08:02.431 13:18:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:02.431 13:18:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:02.688 13:18:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:02.945 13:18:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:08:02.945 13:18:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:08:03.202 true 00:08:03.202 13:18:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:03.202 13:18:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:03.459 13:18:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:03.716 13:18:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:08:03.716 13:18:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:08:03.974 true 00:08:03.974 13:18:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:03.974 13:18:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:04.903 13:19:00 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:04.903 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:05.160 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:08:05.160 13:19:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:08:05.160 13:19:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:08:05.417 true 00:08:05.673 13:19:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:05.673 13:19:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:05.930 13:19:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:06.197 13:19:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:08:06.197 13:19:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:08:06.459 true 00:08:06.459 13:19:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:06.459 13:19:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:06.715 13:19:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:06.972 13:19:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:08:06.972 13:19:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:08:07.230 true 00:08:07.230 13:19:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:07.230 13:19:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:08.159 Initializing NVMe Controllers 00:08:08.159 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:08.159 Controller IO queue size 128, less than required. 00:08:08.159 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:08:08.159 Controller IO queue size 128, less than required. 00:08:08.159 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:08:08.159 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:08.159 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:08:08.159 Initialization complete. Launching workers. 00:08:08.159 ======================================================== 00:08:08.159 Latency(us) 00:08:08.159 Device Information : IOPS MiB/s Average min max 00:08:08.159 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 483.47 0.24 106813.45 2699.09 1012602.93 00:08:08.159 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 8462.12 4.13 15126.30 2918.27 449535.16 00:08:08.159 ======================================================== 00:08:08.160 Total : 8945.59 4.37 20081.55 2699.09 1012602.93 00:08:08.160 00:08:08.160 13:19:03 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:08.417 13:19:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:08:08.417 13:19:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:08:08.674 true 00:08:08.674 13:19:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 529159 00:08:08.674 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (529159) - No such process 00:08:08.674 13:19:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@53 -- # wait 529159 00:08:08.674 13:19:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:08.931 13:19:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:09.188 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:08:09.188 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:08:09.188 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:08:09.188 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:09.188 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:08:09.444 null0 00:08:09.444 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:09.444 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:09.445 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:08:09.702 null1 00:08:09.702 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:09.702 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:09.702 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:08:09.959 null2 00:08:09.959 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:09.959 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:09.959 13:19:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:08:10.216 null3 00:08:10.216 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:10.216 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:10.216 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:08:10.475 null4 00:08:10.475 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:10.475 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:10.475 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:08:10.733 null5 00:08:10.733 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:10.733 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:10.733 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:08:11.297 null6 00:08:11.297 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:11.297 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:11.297 13:19:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:08:11.297 null7 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.297 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@66 -- # wait 533357 533358 533360 533362 533364 533366 533368 533370 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:11.298 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:11.864 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.120 13:19:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:12.377 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:12.634 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:12.894 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:12.894 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:12.895 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:12.895 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:12.895 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:12.895 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:12.895 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:12.895 13:19:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.153 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:13.410 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:13.410 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:13.410 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:13.410 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:13.668 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:13.668 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:13.668 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:13.668 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:13.926 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:14.183 13:19:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.440 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:14.708 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:14.708 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:14.708 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:14.708 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:14.709 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:14.709 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:14.709 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:14.709 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:14.968 13:19:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:15.226 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:15.226 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:15.226 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:15.226 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:15.226 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:15.226 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:15.485 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:15.485 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:15.743 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:16.004 13:19:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.262 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.263 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:16.520 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:16.778 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:08:17.036 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:08:17.036 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:08:17.036 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:08:17.037 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:17.037 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:08:17.037 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:08:17.037 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:08:17.037 13:19:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:17.602 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.602 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.602 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.602 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@121 -- # sync 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@124 -- # set +e 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:17.603 rmmod nvme_tcp 00:08:17.603 rmmod nvme_fabrics 00:08:17.603 rmmod nvme_keyring 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@128 -- # set -e 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@129 -- # return 0 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@515 -- # '[' -n 528862 ']' 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@516 -- # killprocess 528862 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@950 -- # '[' -z 528862 ']' 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@954 -- # kill -0 528862 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@955 -- # uname 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 528862 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@968 -- # echo 'killing process with pid 528862' 00:08:17.603 killing process with pid 528862 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@969 -- # kill 528862 00:08:17.603 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@974 -- # wait 528862 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@297 -- # iptr 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # iptables-save 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # iptables-restore 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@302 -- # remove_spdk_ns 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:17.863 13:19:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:08:20.400 00:08:20.400 real 0m47.728s 00:08:20.400 user 3m41.347s 00:08:20.400 sys 0m16.450s 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:08:20.400 ************************************ 00:08:20.400 END TEST nvmf_ns_hotplug_stress 00:08:20.400 ************************************ 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@23 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:08:20.400 ************************************ 00:08:20.400 START TEST nvmf_delete_subsystem 00:08:20.400 ************************************ 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:08:20.400 * Looking for test storage... 00:08:20.400 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # lcov --version 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@336 -- # IFS=.-: 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@336 -- # read -ra ver1 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@337 -- # IFS=.-: 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@337 -- # read -ra ver2 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@338 -- # local 'op=<' 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@340 -- # ver1_l=2 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@341 -- # ver2_l=1 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@344 -- # case "$op" in 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@345 -- # : 1 00:08:20.400 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@365 -- # decimal 1 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@353 -- # local d=1 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@355 -- # echo 1 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@365 -- # ver1[v]=1 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@366 -- # decimal 2 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@353 -- # local d=2 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@355 -- # echo 2 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@366 -- # ver2[v]=2 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@368 -- # return 0 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:20.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:20.401 --rc genhtml_branch_coverage=1 00:08:20.401 --rc genhtml_function_coverage=1 00:08:20.401 --rc genhtml_legend=1 00:08:20.401 --rc geninfo_all_blocks=1 00:08:20.401 --rc geninfo_unexecuted_blocks=1 00:08:20.401 00:08:20.401 ' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:20.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:20.401 --rc genhtml_branch_coverage=1 00:08:20.401 --rc genhtml_function_coverage=1 00:08:20.401 --rc genhtml_legend=1 00:08:20.401 --rc geninfo_all_blocks=1 00:08:20.401 --rc geninfo_unexecuted_blocks=1 00:08:20.401 00:08:20.401 ' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:20.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:20.401 --rc genhtml_branch_coverage=1 00:08:20.401 --rc genhtml_function_coverage=1 00:08:20.401 --rc genhtml_legend=1 00:08:20.401 --rc geninfo_all_blocks=1 00:08:20.401 --rc geninfo_unexecuted_blocks=1 00:08:20.401 00:08:20.401 ' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:20.401 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:20.401 --rc genhtml_branch_coverage=1 00:08:20.401 --rc genhtml_function_coverage=1 00:08:20.401 --rc genhtml_legend=1 00:08:20.401 --rc geninfo_all_blocks=1 00:08:20.401 --rc geninfo_unexecuted_blocks=1 00:08:20.401 00:08:20.401 ' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@7 -- # uname -s 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@15 -- # shopt -s extglob 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@5 -- # export PATH 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@51 -- # : 0 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:20.401 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@474 -- # prepare_net_devs 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@436 -- # local -g is_hw=no 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@438 -- # remove_spdk_ns 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:08:20.401 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@309 -- # xtrace_disable 00:08:20.402 13:19:15 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@315 -- # pci_devs=() 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@315 -- # local -a pci_devs 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@316 -- # pci_net_devs=() 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@317 -- # pci_drivers=() 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@317 -- # local -A pci_drivers 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@319 -- # net_devs=() 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@319 -- # local -ga net_devs 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@320 -- # e810=() 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@320 -- # local -ga e810 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@321 -- # x722=() 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@321 -- # local -ga x722 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@322 -- # mlx=() 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@322 -- # local -ga mlx 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:22.307 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:08:22.308 Found 0000:84:00.0 (0x8086 - 0x159b) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:08:22.308 Found 0000:84:00.1 (0x8086 - 0x159b) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@416 -- # [[ up == up ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:08:22.308 Found net devices under 0000:84:00.0: cvl_0_0 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@416 -- # [[ up == up ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:08:22.308 Found net devices under 0000:84:00.1: cvl_0_1 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@440 -- # is_hw=yes 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:08:22.308 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:22.308 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:08:22.308 00:08:22.308 --- 10.0.0.2 ping statistics --- 00:08:22.308 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:22.308 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:22.308 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:22.308 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:08:22.308 00:08:22.308 --- 10.0.0.1 ping statistics --- 00:08:22.308 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:22.308 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@448 -- # return 0 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:22.308 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@507 -- # nvmfpid=536276 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@508 -- # waitforlisten 536276 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@831 -- # '[' -z 536276 ']' 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:22.568 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:22.568 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.568 [2024-10-07 13:19:18.293159] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:22.568 [2024-10-07 13:19:18.293237] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:22.568 [2024-10-07 13:19:18.356189] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:08:22.569 [2024-10-07 13:19:18.458318] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:22.569 [2024-10-07 13:19:18.458384] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:22.569 [2024-10-07 13:19:18.458397] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:22.569 [2024-10-07 13:19:18.458408] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:22.569 [2024-10-07 13:19:18.458417] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:22.569 [2024-10-07 13:19:18.459253] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:22.569 [2024-10-07 13:19:18.459279] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@864 -- # return 0 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.827 [2024-10-07 13:19:18.608380] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.827 [2024-10-07 13:19:18.624672] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.827 NULL1 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.827 Delay0 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@28 -- # perf_pid=536302 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@30 -- # sleep 2 00:08:22.827 13:19:18 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:08:22.827 [2024-10-07 13:19:18.699442] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:08:24.724 13:19:20 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:24.724 13:19:20 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:24.724 13:19:20 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 starting I/O failed: -6 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 starting I/O failed: -6 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 starting I/O failed: -6 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Write completed with error (sct=0, sc=8) 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Write completed with error (sct=0, sc=8) 00:08:25.349 starting I/O failed: -6 00:08:25.349 Read completed with error (sct=0, sc=8) 00:08:25.349 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 [2024-10-07 13:19:20.951568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fe53c000c00 is same with the state(6) to be set 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 starting I/O failed: -6 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 [2024-10-07 13:19:20.952360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202c750 is same with the state(6) to be set 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.350 Read completed with error (sct=0, sc=8) 00:08:25.350 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Write completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:25.351 Read completed with error (sct=0, sc=8) 00:08:26.287 [2024-10-07 13:19:21.916431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202da70 is same with the state(6) to be set 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 [2024-10-07 13:19:21.953913] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fe53c00d640 is same with the state(6) to be set 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 [2024-10-07 13:19:21.954096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202c570 is same with the state(6) to be set 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 [2024-10-07 13:19:21.954258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202c930 is same with the state(6) to be set 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Write completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.287 Read completed with error (sct=0, sc=8) 00:08:26.288 Read completed with error (sct=0, sc=8) 00:08:26.288 [2024-10-07 13:19:21.955264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fe53c00cfe0 is same with the state(6) to be set 00:08:26.288 Initializing NVMe Controllers 00:08:26.288 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:26.288 Controller IO queue size 128, less than required. 00:08:26.288 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:08:26.288 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:08:26.288 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:08:26.288 Initialization complete. Launching workers. 00:08:26.288 ======================================================== 00:08:26.288 Latency(us) 00:08:26.288 Device Information : IOPS MiB/s Average min max 00:08:26.288 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 165.60 0.08 904440.35 427.00 1014553.83 00:08:26.288 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 162.13 0.08 914484.64 713.35 1014391.80 00:08:26.288 ======================================================== 00:08:26.288 Total : 327.73 0.16 909409.31 427.00 1014553.83 00:08:26.288 00:08:26.288 [2024-10-07 13:19:21.956436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202da70 (9): Bad file descriptor 00:08:26.288 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:08:26.288 13:19:21 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:26.288 13:19:21 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@34 -- # delay=0 00:08:26.288 13:19:21 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@35 -- # kill -0 536302 00:08:26.288 13:19:21 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@35 -- # kill -0 536302 00:08:26.545 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (536302) - No such process 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@45 -- # NOT wait 536302 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@650 -- # local es=0 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@652 -- # valid_exec_arg wait 536302 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@638 -- # local arg=wait 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # type -t wait 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@653 -- # wait 536302 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@653 -- # es=1 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:26.545 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:26.546 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:08:26.546 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:26.546 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:26.546 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:26.546 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:26.546 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:26.546 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:26.546 [2024-10-07 13:19:22.479293] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@54 -- # perf_pid=536722 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@56 -- # delay=0 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:26.803 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:08:26.803 [2024-10-07 13:19:22.544128] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:08:27.368 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:08:27.368 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:27.368 13:19:22 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:08:27.625 13:19:23 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:08:27.625 13:19:23 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:27.625 13:19:23 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:08:28.190 13:19:23 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:08:28.190 13:19:23 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:28.190 13:19:23 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:08:28.758 13:19:24 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:08:28.758 13:19:24 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:28.758 13:19:24 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:08:29.322 13:19:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:08:29.322 13:19:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:29.322 13:19:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:08:29.579 13:19:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:08:29.579 13:19:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:29.579 13:19:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:08:30.144 Initializing NVMe Controllers 00:08:30.144 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:30.144 Controller IO queue size 128, less than required. 00:08:30.144 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:08:30.144 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:08:30.144 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:08:30.144 Initialization complete. Launching workers. 00:08:30.144 ======================================================== 00:08:30.144 Latency(us) 00:08:30.144 Device Information : IOPS MiB/s Average min max 00:08:30.144 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003642.38 1000240.88 1012270.90 00:08:30.144 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005210.83 1000300.85 1041204.86 00:08:30.144 ======================================================== 00:08:30.144 Total : 256.00 0.12 1004426.61 1000240.88 1041204.86 00:08:30.144 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 536722 00:08:30.144 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (536722) - No such process 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@67 -- # wait 536722 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@121 -- # sync 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@124 -- # set +e 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:30.144 rmmod nvme_tcp 00:08:30.144 rmmod nvme_fabrics 00:08:30.144 rmmod nvme_keyring 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@128 -- # set -e 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@129 -- # return 0 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@515 -- # '[' -n 536276 ']' 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@516 -- # killprocess 536276 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@950 -- # '[' -z 536276 ']' 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@954 -- # kill -0 536276 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@955 -- # uname 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:30.144 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 536276 00:08:30.402 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:30.402 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:30.402 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@968 -- # echo 'killing process with pid 536276' 00:08:30.402 killing process with pid 536276 00:08:30.402 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@969 -- # kill 536276 00:08:30.402 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@974 -- # wait 536276 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@297 -- # iptr 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # iptables-save 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # iptables-restore 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@302 -- # remove_spdk_ns 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:30.661 13:19:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:32.627 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:08:32.628 00:08:32.628 real 0m12.638s 00:08:32.628 user 0m28.368s 00:08:32.628 sys 0m3.099s 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:08:32.628 ************************************ 00:08:32.628 END TEST nvmf_delete_subsystem 00:08:32.628 ************************************ 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@26 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:08:32.628 ************************************ 00:08:32.628 START TEST nvmf_host_management 00:08:32.628 ************************************ 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:08:32.628 * Looking for test storage... 00:08:32.628 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lcov --version 00:08:32.628 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # IFS=.-: 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # read -ra ver1 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # IFS=.-: 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # read -ra ver2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@338 -- # local 'op=<' 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@340 -- # ver1_l=2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@341 -- # ver2_l=1 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@344 -- # case "$op" in 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@345 -- # : 1 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # decimal 1 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=1 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 1 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # ver1[v]=1 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # decimal 2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # ver2[v]=2 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:32.906 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # return 0 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:32.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.907 --rc genhtml_branch_coverage=1 00:08:32.907 --rc genhtml_function_coverage=1 00:08:32.907 --rc genhtml_legend=1 00:08:32.907 --rc geninfo_all_blocks=1 00:08:32.907 --rc geninfo_unexecuted_blocks=1 00:08:32.907 00:08:32.907 ' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:32.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.907 --rc genhtml_branch_coverage=1 00:08:32.907 --rc genhtml_function_coverage=1 00:08:32.907 --rc genhtml_legend=1 00:08:32.907 --rc geninfo_all_blocks=1 00:08:32.907 --rc geninfo_unexecuted_blocks=1 00:08:32.907 00:08:32.907 ' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:32.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.907 --rc genhtml_branch_coverage=1 00:08:32.907 --rc genhtml_function_coverage=1 00:08:32.907 --rc genhtml_legend=1 00:08:32.907 --rc geninfo_all_blocks=1 00:08:32.907 --rc geninfo_unexecuted_blocks=1 00:08:32.907 00:08:32.907 ' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:32.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.907 --rc genhtml_branch_coverage=1 00:08:32.907 --rc genhtml_function_coverage=1 00:08:32.907 --rc genhtml_legend=1 00:08:32.907 --rc geninfo_all_blocks=1 00:08:32.907 --rc geninfo_unexecuted_blocks=1 00:08:32.907 00:08:32.907 ' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # uname -s 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@15 -- # shopt -s extglob 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@5 -- # export PATH 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@51 -- # : 0 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:32.907 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@105 -- # nvmftestinit 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@474 -- # prepare_net_devs 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@436 -- # local -g is_hw=no 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@438 -- # remove_spdk_ns 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@309 -- # xtrace_disable 00:08:32.907 13:19:28 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@315 -- # pci_devs=() 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@315 -- # local -a pci_devs 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@316 -- # pci_net_devs=() 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@317 -- # pci_drivers=() 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@317 -- # local -A pci_drivers 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@319 -- # net_devs=() 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@319 -- # local -ga net_devs 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@320 -- # e810=() 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@320 -- # local -ga e810 00:08:35.440 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@321 -- # x722=() 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@321 -- # local -ga x722 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@322 -- # mlx=() 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@322 -- # local -ga mlx 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:08:35.441 Found 0000:84:00.0 (0x8086 - 0x159b) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:08:35.441 Found 0000:84:00.1 (0x8086 - 0x159b) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@416 -- # [[ up == up ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:08:35.441 Found net devices under 0000:84:00.0: cvl_0_0 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@416 -- # [[ up == up ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:08:35.441 Found net devices under 0000:84:00.1: cvl_0_1 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@440 -- # is_hw=yes 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:08:35.441 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:35.441 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.320 ms 00:08:35.441 00:08:35.441 --- 10.0.0.2 ping statistics --- 00:08:35.441 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:35.441 rtt min/avg/max/mdev = 0.320/0.320/0.320/0.000 ms 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:35.441 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:35.441 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:08:35.441 00:08:35.441 --- 10.0.0.1 ping statistics --- 00:08:35.441 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:35.441 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@448 -- # return 0 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@107 -- # nvmf_host_management 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@69 -- # starttarget 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:08:35.441 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@507 -- # nvmfpid=539205 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@508 -- # waitforlisten 539205 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 539205 ']' 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:35.442 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:35.442 13:19:30 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.442 [2024-10-07 13:19:30.980077] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:35.442 [2024-10-07 13:19:30.980169] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:35.442 [2024-10-07 13:19:31.045783] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:35.442 [2024-10-07 13:19:31.146498] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:35.442 [2024-10-07 13:19:31.146560] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:35.442 [2024-10-07 13:19:31.146583] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:35.442 [2024-10-07 13:19:31.146594] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:35.442 [2024-10-07 13:19:31.146608] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:35.442 [2024-10-07 13:19:31.148196] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:08:35.442 [2024-10-07 13:19:31.148259] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:08:35.442 [2024-10-07 13:19:31.148322] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:08:35.442 [2024-10-07 13:19:31.148325] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.442 [2024-10-07 13:19:31.309138] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@23 -- # cat 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@30 -- # rpc_cmd 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.442 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.442 Malloc0 00:08:35.700 [2024-10-07 13:19:31.374166] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@73 -- # perfpid=539256 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@74 -- # waitforlisten 539256 /var/tmp/bdevperf.sock 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 539256 ']' 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:08:35.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:35.700 { 00:08:35.700 "params": { 00:08:35.700 "name": "Nvme$subsystem", 00:08:35.700 "trtype": "$TEST_TRANSPORT", 00:08:35.700 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:35.700 "adrfam": "ipv4", 00:08:35.700 "trsvcid": "$NVMF_PORT", 00:08:35.700 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:35.700 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:35.700 "hdgst": ${hdgst:-false}, 00:08:35.700 "ddgst": ${ddgst:-false} 00:08:35.700 }, 00:08:35.700 "method": "bdev_nvme_attach_controller" 00:08:35.700 } 00:08:35.700 EOF 00:08:35.700 )") 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:08:35.700 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:08:35.701 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:08:35.701 13:19:31 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:35.701 "params": { 00:08:35.701 "name": "Nvme0", 00:08:35.701 "trtype": "tcp", 00:08:35.701 "traddr": "10.0.0.2", 00:08:35.701 "adrfam": "ipv4", 00:08:35.701 "trsvcid": "4420", 00:08:35.701 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:08:35.701 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:08:35.701 "hdgst": false, 00:08:35.701 "ddgst": false 00:08:35.701 }, 00:08:35.701 "method": "bdev_nvme_attach_controller" 00:08:35.701 }' 00:08:35.701 [2024-10-07 13:19:31.457903] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:35.701 [2024-10-07 13:19:31.457988] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid539256 ] 00:08:35.701 [2024-10-07 13:19:31.520323] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:35.701 [2024-10-07 13:19:31.631858] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:36.267 Running I/O for 10 seconds... 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@52 -- # local ret=1 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@53 -- # local i 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i = 10 )) 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i != 0 )) 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # read_io_count=67 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@58 -- # '[' 67 -ge 100 ']' 00:08:36.268 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@62 -- # sleep 0.25 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i-- )) 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i != 0 )) 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # read_io_count=515 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@58 -- # '[' 515 -ge 100 ']' 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@59 -- # ret=0 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@60 -- # break 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@64 -- # return 0 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:36.528 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:36.528 [2024-10-07 13:19:32.377878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:78720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.377948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.377977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:78848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.377993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:78976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:79104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:79232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:79360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:79488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:79616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:79744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:79872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:80000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:80128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:80256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:80384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:80512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:80640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:80768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:80896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:81024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:81152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:81280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:81408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:81536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:81664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:81792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.528 [2024-10-07 13:19:32.378823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.528 [2024-10-07 13:19:32.378837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.378857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.378871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.378885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.378903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.378920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.378934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.378949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.378963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.378980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.378993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:77952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:78208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:78336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:78464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.379971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.379986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:78592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:08:36.529 [2024-10-07 13:19:32.380000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:08:36.529 [2024-10-07 13:19:32.380097] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18881f0 was disconnected and freed. reset controller. 00:08:36.530 [2024-10-07 13:19:32.381258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:08:36.530 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:36.530 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:08:36.530 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:36.530 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:36.530 task offset: 78720 on job bdev=Nvme0n1 fails 00:08:36.530 00:08:36.530 Latency(us) 00:08:36.530 [2024-10-07T11:19:32.463Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:36.530 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:08:36.530 Job: Nvme0n1 ended in about 0.39 seconds with error 00:08:36.530 Verification LBA range: start 0x0 length 0x400 00:08:36.530 Nvme0n1 : 0.39 1463.84 91.49 162.65 0.00 38227.87 2803.48 33787.45 00:08:36.530 [2024-10-07T11:19:32.463Z] =================================================================================================================== 00:08:36.530 [2024-10-07T11:19:32.463Z] Total : 1463.84 91.49 162.65 0.00 38227.87 2803.48 33787.45 00:08:36.530 [2024-10-07 13:19:32.384198] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:36.530 [2024-10-07 13:19:32.384231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x166f100 (9): Bad file descriptor 00:08:36.530 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:36.530 13:19:32 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@87 -- # sleep 1 00:08:36.530 [2024-10-07 13:19:32.390413] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # kill -9 539256 00:08:37.463 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (539256) - No such process 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # true 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:37.463 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:37.463 { 00:08:37.463 "params": { 00:08:37.463 "name": "Nvme$subsystem", 00:08:37.463 "trtype": "$TEST_TRANSPORT", 00:08:37.463 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:37.463 "adrfam": "ipv4", 00:08:37.463 "trsvcid": "$NVMF_PORT", 00:08:37.463 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:37.463 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:37.463 "hdgst": ${hdgst:-false}, 00:08:37.463 "ddgst": ${ddgst:-false} 00:08:37.463 }, 00:08:37.463 "method": "bdev_nvme_attach_controller" 00:08:37.463 } 00:08:37.463 EOF 00:08:37.463 )") 00:08:37.721 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:08:37.721 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:08:37.721 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:08:37.721 13:19:33 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:37.721 "params": { 00:08:37.721 "name": "Nvme0", 00:08:37.721 "trtype": "tcp", 00:08:37.721 "traddr": "10.0.0.2", 00:08:37.721 "adrfam": "ipv4", 00:08:37.721 "trsvcid": "4420", 00:08:37.721 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:08:37.721 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:08:37.721 "hdgst": false, 00:08:37.721 "ddgst": false 00:08:37.721 }, 00:08:37.721 "method": "bdev_nvme_attach_controller" 00:08:37.721 }' 00:08:37.721 [2024-10-07 13:19:33.441952] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:37.721 [2024-10-07 13:19:33.442035] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid539538 ] 00:08:37.721 [2024-10-07 13:19:33.501158] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:37.721 [2024-10-07 13:19:33.614307] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:37.979 Running I/O for 1 seconds... 00:08:38.913 1536.00 IOPS, 96.00 MiB/s 00:08:38.913 Latency(us) 00:08:38.913 [2024-10-07T11:19:34.846Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:38.913 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:08:38.913 Verification LBA range: start 0x0 length 0x400 00:08:38.913 Nvme0n1 : 1.02 1570.44 98.15 0.00 0.00 40107.94 7136.14 34175.81 00:08:38.913 [2024-10-07T11:19:34.846Z] =================================================================================================================== 00:08:38.913 [2024-10-07T11:19:34.846Z] Total : 1570.44 98.15 0.00 0.00 40107.94 7136.14 34175.81 00:08:39.171 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@102 -- # stoptarget 00:08:39.171 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:08:39.171 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@40 -- # nvmftestfini 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@121 -- # sync 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@124 -- # set +e 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:39.172 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:39.430 rmmod nvme_tcp 00:08:39.430 rmmod nvme_fabrics 00:08:39.430 rmmod nvme_keyring 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@128 -- # set -e 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@129 -- # return 0 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@515 -- # '[' -n 539205 ']' 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@516 -- # killprocess 539205 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@950 -- # '[' -z 539205 ']' 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@954 -- # kill -0 539205 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # uname 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 539205 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@968 -- # echo 'killing process with pid 539205' 00:08:39.430 killing process with pid 539205 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@969 -- # kill 539205 00:08:39.430 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@974 -- # wait 539205 00:08:39.690 [2024-10-07 13:19:35.463049] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@297 -- # iptr 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-save 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-restore 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@302 -- # remove_spdk_ns 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:39.690 13:19:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:08:42.230 00:08:42.230 real 0m9.077s 00:08:42.230 user 0m20.416s 00:08:42.230 sys 0m2.927s 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:08:42.230 ************************************ 00:08:42.230 END TEST nvmf_host_management 00:08:42.230 ************************************ 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@27 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:08:42.230 ************************************ 00:08:42.230 START TEST nvmf_lvol 00:08:42.230 ************************************ 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:08:42.230 * Looking for test storage... 00:08:42.230 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lcov --version 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # IFS=.-: 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # read -ra ver1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # IFS=.-: 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # read -ra ver2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@338 -- # local 'op=<' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@340 -- # ver1_l=2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@341 -- # ver2_l=1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@344 -- # case "$op" in 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@345 -- # : 1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # decimal 1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # ver1[v]=1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # decimal 2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # ver2[v]=2 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # return 0 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:42.230 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.230 --rc genhtml_branch_coverage=1 00:08:42.230 --rc genhtml_function_coverage=1 00:08:42.230 --rc genhtml_legend=1 00:08:42.230 --rc geninfo_all_blocks=1 00:08:42.230 --rc geninfo_unexecuted_blocks=1 00:08:42.230 00:08:42.230 ' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:42.230 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.230 --rc genhtml_branch_coverage=1 00:08:42.230 --rc genhtml_function_coverage=1 00:08:42.230 --rc genhtml_legend=1 00:08:42.230 --rc geninfo_all_blocks=1 00:08:42.230 --rc geninfo_unexecuted_blocks=1 00:08:42.230 00:08:42.230 ' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:42.230 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.230 --rc genhtml_branch_coverage=1 00:08:42.230 --rc genhtml_function_coverage=1 00:08:42.230 --rc genhtml_legend=1 00:08:42.230 --rc geninfo_all_blocks=1 00:08:42.230 --rc geninfo_unexecuted_blocks=1 00:08:42.230 00:08:42.230 ' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:42.230 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:42.230 --rc genhtml_branch_coverage=1 00:08:42.230 --rc genhtml_function_coverage=1 00:08:42.230 --rc genhtml_legend=1 00:08:42.230 --rc geninfo_all_blocks=1 00:08:42.230 --rc geninfo_unexecuted_blocks=1 00:08:42.230 00:08:42.230 ' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # uname -s 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@15 -- # shopt -s extglob 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.230 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@5 -- # export PATH 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@51 -- # : 0 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:42.231 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@474 -- # prepare_net_devs 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@436 -- # local -g is_hw=no 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@438 -- # remove_spdk_ns 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@309 -- # xtrace_disable 00:08:42.231 13:19:37 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@315 -- # pci_devs=() 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@315 -- # local -a pci_devs 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@316 -- # pci_net_devs=() 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@317 -- # pci_drivers=() 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@317 -- # local -A pci_drivers 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@319 -- # net_devs=() 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@319 -- # local -ga net_devs 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@320 -- # e810=() 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@320 -- # local -ga e810 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@321 -- # x722=() 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@321 -- # local -ga x722 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@322 -- # mlx=() 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@322 -- # local -ga mlx 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:08:44.132 Found 0000:84:00.0 (0x8086 - 0x159b) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:08:44.132 Found 0000:84:00.1 (0x8086 - 0x159b) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@416 -- # [[ up == up ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:08:44.132 Found net devices under 0000:84:00.0: cvl_0_0 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@416 -- # [[ up == up ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:08:44.132 Found net devices under 0000:84:00.1: cvl_0_1 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@440 -- # is_hw=yes 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:44.132 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:08:44.133 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:08:44.391 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:44.391 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:08:44.391 00:08:44.391 --- 10.0.0.2 ping statistics --- 00:08:44.391 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:44.391 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:44.391 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:44.391 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:08:44.391 00:08:44.391 --- 10.0.0.1 ping statistics --- 00:08:44.391 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:44.391 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@448 -- # return 0 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@507 -- # nvmfpid=541763 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@508 -- # waitforlisten 541763 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@831 -- # '[' -z 541763 ']' 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:44.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:44.391 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:08:44.391 [2024-10-07 13:19:40.256154] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:44.391 [2024-10-07 13:19:40.256235] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:44.391 [2024-10-07 13:19:40.322521] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:44.649 [2024-10-07 13:19:40.433118] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:44.649 [2024-10-07 13:19:40.433177] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:44.649 [2024-10-07 13:19:40.433205] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:44.649 [2024-10-07 13:19:40.433216] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:44.649 [2024-10-07 13:19:40.433225] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:44.649 [2024-10-07 13:19:40.434171] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:44.649 [2024-10-07 13:19:40.434280] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:08:44.649 [2024-10-07 13:19:40.434288] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:44.649 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:44.649 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@864 -- # return 0 00:08:44.649 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:08:44.649 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:44.649 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:08:44.649 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:44.649 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:08:45.214 [2024-10-07 13:19:40.845625] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:45.214 13:19:40 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:08:45.471 13:19:41 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:08:45.471 13:19:41 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:08:45.728 13:19:41 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:08:45.728 13:19:41 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:08:45.986 13:19:41 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:08:46.243 13:19:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # lvs=83b61099-3a9a-43ed-a506-ca214c6e6b21 00:08:46.243 13:19:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 83b61099-3a9a-43ed-a506-ca214c6e6b21 lvol 20 00:08:46.500 13:19:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # lvol=b5a7e3aa-7f81-4358-8220-f5aa6bbfbd9f 00:08:46.500 13:19:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:08:46.757 13:19:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b5a7e3aa-7f81-4358-8220-f5aa6bbfbd9f 00:08:47.014 13:19:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:08:47.271 [2024-10-07 13:19:43.049037] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:47.271 13:19:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:47.528 13:19:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@42 -- # perf_pid=542188 00:08:47.528 13:19:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:08:47.528 13:19:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@44 -- # sleep 1 00:08:48.463 13:19:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot b5a7e3aa-7f81-4358-8220-f5aa6bbfbd9f MY_SNAPSHOT 00:08:49.031 13:19:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # snapshot=6f7f8c79-3bff-4882-a7f0-385b0875d1b2 00:08:49.031 13:19:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize b5a7e3aa-7f81-4358-8220-f5aa6bbfbd9f 30 00:08:49.290 13:19:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 6f7f8c79-3bff-4882-a7f0-385b0875d1b2 MY_CLONE 00:08:49.547 13:19:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # clone=5917bea9-7485-4291-826d-fca4781b0f55 00:08:49.547 13:19:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 5917bea9-7485-4291-826d-fca4781b0f55 00:08:50.482 13:19:46 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@53 -- # wait 542188 00:08:58.590 Initializing NVMe Controllers 00:08:58.590 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:08:58.590 Controller IO queue size 128, less than required. 00:08:58.590 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:08:58.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:08:58.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:08:58.590 Initialization complete. Launching workers. 00:08:58.590 ======================================================== 00:08:58.590 Latency(us) 00:08:58.590 Device Information : IOPS MiB/s Average min max 00:08:58.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10345.70 40.41 12380.59 1864.38 80044.22 00:08:58.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10272.00 40.12 12463.65 1993.77 78054.12 00:08:58.590 ======================================================== 00:08:58.590 Total : 20617.70 80.54 12421.97 1864.38 80044.22 00:08:58.590 00:08:58.590 13:19:53 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:08:58.590 13:19:53 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b5a7e3aa-7f81-4358-8220-f5aa6bbfbd9f 00:08:58.590 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 83b61099-3a9a-43ed-a506-ca214c6e6b21 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@60 -- # rm -f 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@121 -- # sync 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@124 -- # set +e 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:58.848 rmmod nvme_tcp 00:08:58.848 rmmod nvme_fabrics 00:08:58.848 rmmod nvme_keyring 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@128 -- # set -e 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@129 -- # return 0 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@515 -- # '[' -n 541763 ']' 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@516 -- # killprocess 541763 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@950 -- # '[' -z 541763 ']' 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@954 -- # kill -0 541763 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # uname 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 541763 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@968 -- # echo 'killing process with pid 541763' 00:08:58.848 killing process with pid 541763 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@969 -- # kill 541763 00:08:58.848 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@974 -- # wait 541763 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@297 -- # iptr 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-save 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-restore 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@302 -- # remove_spdk_ns 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:59.106 13:19:54 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:09:01.647 00:09:01.647 real 0m19.429s 00:09:01.647 user 1m5.608s 00:09:01.647 sys 0m5.803s 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:09:01.647 ************************************ 00:09:01.647 END TEST nvmf_lvol 00:09:01.647 ************************************ 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@28 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:01.647 ************************************ 00:09:01.647 START TEST nvmf_lvs_grow 00:09:01.647 ************************************ 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:09:01.647 * Looking for test storage... 00:09:01.647 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lcov --version 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # IFS=.-: 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # read -ra ver1 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # IFS=.-: 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # read -ra ver2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@338 -- # local 'op=<' 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@340 -- # ver1_l=2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@341 -- # ver2_l=1 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@344 -- # case "$op" in 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@345 -- # : 1 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # decimal 1 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=1 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 1 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # ver1[v]=1 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # decimal 2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # ver2[v]=2 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # return 0 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:01.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.647 --rc genhtml_branch_coverage=1 00:09:01.647 --rc genhtml_function_coverage=1 00:09:01.647 --rc genhtml_legend=1 00:09:01.647 --rc geninfo_all_blocks=1 00:09:01.647 --rc geninfo_unexecuted_blocks=1 00:09:01.647 00:09:01.647 ' 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:01.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.647 --rc genhtml_branch_coverage=1 00:09:01.647 --rc genhtml_function_coverage=1 00:09:01.647 --rc genhtml_legend=1 00:09:01.647 --rc geninfo_all_blocks=1 00:09:01.647 --rc geninfo_unexecuted_blocks=1 00:09:01.647 00:09:01.647 ' 00:09:01.647 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:01.647 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.647 --rc genhtml_branch_coverage=1 00:09:01.647 --rc genhtml_function_coverage=1 00:09:01.647 --rc genhtml_legend=1 00:09:01.648 --rc geninfo_all_blocks=1 00:09:01.648 --rc geninfo_unexecuted_blocks=1 00:09:01.648 00:09:01.648 ' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:01.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.648 --rc genhtml_branch_coverage=1 00:09:01.648 --rc genhtml_function_coverage=1 00:09:01.648 --rc genhtml_legend=1 00:09:01.648 --rc geninfo_all_blocks=1 00:09:01.648 --rc geninfo_unexecuted_blocks=1 00:09:01.648 00:09:01.648 ' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # uname -s 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@15 -- # shopt -s extglob 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@5 -- # export PATH 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@51 -- # : 0 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:01.648 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@98 -- # nvmftestinit 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@309 -- # xtrace_disable 00:09:01.648 13:19:57 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@315 -- # pci_devs=() 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@315 -- # local -a pci_devs 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@316 -- # pci_net_devs=() 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@317 -- # pci_drivers=() 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@317 -- # local -A pci_drivers 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@319 -- # net_devs=() 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@319 -- # local -ga net_devs 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@320 -- # e810=() 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@320 -- # local -ga e810 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@321 -- # x722=() 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@321 -- # local -ga x722 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@322 -- # mlx=() 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@322 -- # local -ga mlx 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:03.555 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:09:03.556 Found 0000:84:00.0 (0x8086 - 0x159b) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:09:03.556 Found 0000:84:00.1 (0x8086 - 0x159b) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@416 -- # [[ up == up ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:09:03.556 Found net devices under 0000:84:00.0: cvl_0_0 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@416 -- # [[ up == up ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:09:03.556 Found net devices under 0000:84:00.1: cvl_0_1 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@440 -- # is_hw=yes 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:09:03.556 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:03.556 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.354 ms 00:09:03.556 00:09:03.556 --- 10.0.0.2 ping statistics --- 00:09:03.556 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:03.556 rtt min/avg/max/mdev = 0.354/0.354/0.354/0.000 ms 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:03.556 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:03.556 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:09:03.556 00:09:03.556 --- 10.0.0.1 ping statistics --- 00:09:03.556 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:03.556 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@448 -- # return 0 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@99 -- # nvmfappstart -m 0x1 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:03.556 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@507 -- # nvmfpid=545482 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@508 -- # waitforlisten 545482 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@831 -- # '[' -z 545482 ']' 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:03.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:03.815 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:09:03.815 [2024-10-07 13:19:59.540089] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:03.815 [2024-10-07 13:19:59.540165] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:03.815 [2024-10-07 13:19:59.605253] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:03.815 [2024-10-07 13:19:59.712879] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:03.815 [2024-10-07 13:19:59.712937] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:03.815 [2024-10-07 13:19:59.712966] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:03.815 [2024-10-07 13:19:59.712977] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:03.815 [2024-10-07 13:19:59.712989] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:03.816 [2024-10-07 13:19:59.713626] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:04.073 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:04.073 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@864 -- # return 0 00:09:04.073 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:04.074 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:04.074 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:09:04.074 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:04.074 13:19:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:09:04.331 [2024-10-07 13:20:00.123422] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_clean lvs_grow 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:09:04.332 ************************************ 00:09:04.332 START TEST lvs_grow_clean 00:09:04.332 ************************************ 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1125 -- # lvs_grow 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:04.332 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:09:04.589 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:09:04.589 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:09:04.847 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # lvs=740cc747-66af-4afe-a174-97a0badfc60c 00:09:04.847 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:04.847 13:20:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:09:05.443 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:09:05.443 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:09:05.443 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 740cc747-66af-4afe-a174-97a0badfc60c lvol 150 00:09:05.443 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # lvol=c4744581-bae1-440b-a51a-278ee2589a7b 00:09:05.443 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:05.443 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:09:05.729 [2024-10-07 13:20:01.571003] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:09:05.729 [2024-10-07 13:20:01.571126] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:09:05.729 true 00:09:05.729 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:05.729 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:09:05.987 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:09:05.987 13:20:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:09:06.244 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c4744581-bae1-440b-a51a-278ee2589a7b 00:09:06.503 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:09:06.761 [2024-10-07 13:20:02.670396] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:06.761 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=545934 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 545934 /var/tmp/bdevperf.sock 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@831 -- # '[' -z 545934 ']' 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:09:07.327 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:07.327 13:20:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:09:07.327 [2024-10-07 13:20:03.003014] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:07.327 [2024-10-07 13:20:03.003104] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid545934 ] 00:09:07.327 [2024-10-07 13:20:03.061280] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:07.327 [2024-10-07 13:20:03.170321] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:07.585 13:20:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:07.585 13:20:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@864 -- # return 0 00:09:07.585 13:20:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:09:07.842 Nvme0n1 00:09:07.842 13:20:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:09:08.100 [ 00:09:08.100 { 00:09:08.100 "name": "Nvme0n1", 00:09:08.100 "aliases": [ 00:09:08.100 "c4744581-bae1-440b-a51a-278ee2589a7b" 00:09:08.100 ], 00:09:08.100 "product_name": "NVMe disk", 00:09:08.100 "block_size": 4096, 00:09:08.100 "num_blocks": 38912, 00:09:08.100 "uuid": "c4744581-bae1-440b-a51a-278ee2589a7b", 00:09:08.100 "numa_id": 1, 00:09:08.100 "assigned_rate_limits": { 00:09:08.100 "rw_ios_per_sec": 0, 00:09:08.100 "rw_mbytes_per_sec": 0, 00:09:08.100 "r_mbytes_per_sec": 0, 00:09:08.100 "w_mbytes_per_sec": 0 00:09:08.100 }, 00:09:08.100 "claimed": false, 00:09:08.100 "zoned": false, 00:09:08.100 "supported_io_types": { 00:09:08.100 "read": true, 00:09:08.100 "write": true, 00:09:08.100 "unmap": true, 00:09:08.100 "flush": true, 00:09:08.100 "reset": true, 00:09:08.100 "nvme_admin": true, 00:09:08.100 "nvme_io": true, 00:09:08.100 "nvme_io_md": false, 00:09:08.100 "write_zeroes": true, 00:09:08.100 "zcopy": false, 00:09:08.100 "get_zone_info": false, 00:09:08.100 "zone_management": false, 00:09:08.100 "zone_append": false, 00:09:08.100 "compare": true, 00:09:08.100 "compare_and_write": true, 00:09:08.100 "abort": true, 00:09:08.100 "seek_hole": false, 00:09:08.100 "seek_data": false, 00:09:08.100 "copy": true, 00:09:08.100 "nvme_iov_md": false 00:09:08.100 }, 00:09:08.100 "memory_domains": [ 00:09:08.100 { 00:09:08.100 "dma_device_id": "system", 00:09:08.100 "dma_device_type": 1 00:09:08.100 } 00:09:08.100 ], 00:09:08.100 "driver_specific": { 00:09:08.100 "nvme": [ 00:09:08.100 { 00:09:08.100 "trid": { 00:09:08.100 "trtype": "TCP", 00:09:08.100 "adrfam": "IPv4", 00:09:08.100 "traddr": "10.0.0.2", 00:09:08.100 "trsvcid": "4420", 00:09:08.100 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:09:08.100 }, 00:09:08.100 "ctrlr_data": { 00:09:08.100 "cntlid": 1, 00:09:08.100 "vendor_id": "0x8086", 00:09:08.100 "model_number": "SPDK bdev Controller", 00:09:08.100 "serial_number": "SPDK0", 00:09:08.100 "firmware_revision": "25.01", 00:09:08.100 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:09:08.100 "oacs": { 00:09:08.100 "security": 0, 00:09:08.100 "format": 0, 00:09:08.100 "firmware": 0, 00:09:08.100 "ns_manage": 0 00:09:08.100 }, 00:09:08.100 "multi_ctrlr": true, 00:09:08.100 "ana_reporting": false 00:09:08.100 }, 00:09:08.100 "vs": { 00:09:08.100 "nvme_version": "1.3" 00:09:08.100 }, 00:09:08.100 "ns_data": { 00:09:08.100 "id": 1, 00:09:08.100 "can_share": true 00:09:08.100 } 00:09:08.100 } 00:09:08.100 ], 00:09:08.100 "mp_policy": "active_passive" 00:09:08.100 } 00:09:08.100 } 00:09:08.100 ] 00:09:08.100 13:20:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=546068 00:09:08.100 13:20:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:09:08.100 13:20:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:09:08.358 Running I/O for 10 seconds... 00:09:09.292 Latency(us) 00:09:09.292 [2024-10-07T11:20:05.225Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:09.292 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:09.292 Nvme0n1 : 1.00 16408.00 64.09 0.00 0.00 0.00 0.00 0.00 00:09:09.292 [2024-10-07T11:20:05.225Z] =================================================================================================================== 00:09:09.292 [2024-10-07T11:20:05.225Z] Total : 16408.00 64.09 0.00 0.00 0.00 0.00 0.00 00:09:09.292 00:09:10.227 13:20:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:10.227 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:10.227 Nvme0n1 : 2.00 16545.50 64.63 0.00 0.00 0.00 0.00 0.00 00:09:10.227 [2024-10-07T11:20:06.160Z] =================================================================================================================== 00:09:10.227 [2024-10-07T11:20:06.160Z] Total : 16545.50 64.63 0.00 0.00 0.00 0.00 0.00 00:09:10.227 00:09:10.485 true 00:09:10.485 13:20:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:10.485 13:20:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:09:10.743 13:20:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:09:10.743 13:20:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:09:10.743 13:20:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@65 -- # wait 546068 00:09:11.309 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:11.309 Nvme0n1 : 3.00 16642.00 65.01 0.00 0.00 0.00 0.00 0.00 00:09:11.309 [2024-10-07T11:20:07.242Z] =================================================================================================================== 00:09:11.309 [2024-10-07T11:20:07.242Z] Total : 16642.00 65.01 0.00 0.00 0.00 0.00 0.00 00:09:11.309 00:09:12.243 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:12.243 Nvme0n1 : 4.00 16739.75 65.39 0.00 0.00 0.00 0.00 0.00 00:09:12.243 [2024-10-07T11:20:08.176Z] =================================================================================================================== 00:09:12.243 [2024-10-07T11:20:08.176Z] Total : 16739.75 65.39 0.00 0.00 0.00 0.00 0.00 00:09:12.243 00:09:13.617 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:13.617 Nvme0n1 : 5.00 16810.80 65.67 0.00 0.00 0.00 0.00 0.00 00:09:13.617 [2024-10-07T11:20:09.550Z] =================================================================================================================== 00:09:13.618 [2024-10-07T11:20:09.551Z] Total : 16810.80 65.67 0.00 0.00 0.00 0.00 0.00 00:09:13.618 00:09:14.551 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:14.551 Nvme0n1 : 6.00 16847.33 65.81 0.00 0.00 0.00 0.00 0.00 00:09:14.551 [2024-10-07T11:20:10.484Z] =================================================================================================================== 00:09:14.551 [2024-10-07T11:20:10.484Z] Total : 16847.33 65.81 0.00 0.00 0.00 0.00 0.00 00:09:14.551 00:09:15.485 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:15.485 Nvme0n1 : 7.00 16847.86 65.81 0.00 0.00 0.00 0.00 0.00 00:09:15.485 [2024-10-07T11:20:11.418Z] =================================================================================================================== 00:09:15.485 [2024-10-07T11:20:11.418Z] Total : 16847.86 65.81 0.00 0.00 0.00 0.00 0.00 00:09:15.485 00:09:16.419 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:16.419 Nvme0n1 : 8.00 16904.62 66.03 0.00 0.00 0.00 0.00 0.00 00:09:16.419 [2024-10-07T11:20:12.352Z] =================================================================================================================== 00:09:16.419 [2024-10-07T11:20:12.352Z] Total : 16904.62 66.03 0.00 0.00 0.00 0.00 0.00 00:09:16.419 00:09:17.354 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:17.354 Nvme0n1 : 9.00 16940.56 66.17 0.00 0.00 0.00 0.00 0.00 00:09:17.354 [2024-10-07T11:20:13.287Z] =================================================================================================================== 00:09:17.354 [2024-10-07T11:20:13.287Z] Total : 16940.56 66.17 0.00 0.00 0.00 0.00 0.00 00:09:17.354 00:09:18.293 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:18.293 Nvme0n1 : 10.00 16975.30 66.31 0.00 0.00 0.00 0.00 0.00 00:09:18.293 [2024-10-07T11:20:14.226Z] =================================================================================================================== 00:09:18.293 [2024-10-07T11:20:14.226Z] Total : 16975.30 66.31 0.00 0.00 0.00 0.00 0.00 00:09:18.293 00:09:18.293 00:09:18.293 Latency(us) 00:09:18.293 [2024-10-07T11:20:14.226Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:18.293 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:18.293 Nvme0n1 : 10.01 16974.97 66.31 0.00 0.00 7536.61 3786.52 15049.01 00:09:18.293 [2024-10-07T11:20:14.226Z] =================================================================================================================== 00:09:18.293 [2024-10-07T11:20:14.226Z] Total : 16974.97 66.31 0.00 0.00 7536.61 3786.52 15049.01 00:09:18.293 { 00:09:18.293 "results": [ 00:09:18.293 { 00:09:18.293 "job": "Nvme0n1", 00:09:18.293 "core_mask": "0x2", 00:09:18.293 "workload": "randwrite", 00:09:18.293 "status": "finished", 00:09:18.293 "queue_depth": 128, 00:09:18.293 "io_size": 4096, 00:09:18.293 "runtime": 10.007734, 00:09:18.293 "iops": 16974.971556997818, 00:09:18.293 "mibps": 66.30848264452273, 00:09:18.293 "io_failed": 0, 00:09:18.293 "io_timeout": 0, 00:09:18.293 "avg_latency_us": 7536.6137100850765, 00:09:18.293 "min_latency_us": 3786.5244444444443, 00:09:18.293 "max_latency_us": 15049.007407407407 00:09:18.293 } 00:09:18.293 ], 00:09:18.293 "core_count": 1 00:09:18.293 } 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@66 -- # killprocess 545934 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@950 -- # '[' -z 545934 ']' 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@954 -- # kill -0 545934 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # uname 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 545934 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@968 -- # echo 'killing process with pid 545934' 00:09:18.293 killing process with pid 545934 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@969 -- # kill 545934 00:09:18.293 Received shutdown signal, test time was about 10.000000 seconds 00:09:18.293 00:09:18.293 Latency(us) 00:09:18.293 [2024-10-07T11:20:14.226Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:18.293 [2024-10-07T11:20:14.226Z] =================================================================================================================== 00:09:18.293 [2024-10-07T11:20:14.226Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:09:18.293 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@974 -- # wait 545934 00:09:18.551 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:19.116 13:20:14 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:09:19.116 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:19.116 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:09:19.374 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:09:19.374 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@72 -- # [[ '' == \d\i\r\t\y ]] 00:09:19.374 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:09:19.632 [2024-10-07 13:20:15.548276] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@85 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@650 -- # local es=0 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:09:19.890 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:20.148 request: 00:09:20.148 { 00:09:20.148 "uuid": "740cc747-66af-4afe-a174-97a0badfc60c", 00:09:20.148 "method": "bdev_lvol_get_lvstores", 00:09:20.148 "req_id": 1 00:09:20.148 } 00:09:20.148 Got JSON-RPC error response 00:09:20.148 response: 00:09:20.148 { 00:09:20.148 "code": -19, 00:09:20.148 "message": "No such device" 00:09:20.148 } 00:09:20.148 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # es=1 00:09:20.148 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:20.148 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:20.148 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:20.148 13:20:15 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:09:20.406 aio_bdev 00:09:20.406 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev c4744581-bae1-440b-a51a-278ee2589a7b 00:09:20.406 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@899 -- # local bdev_name=c4744581-bae1-440b-a51a-278ee2589a7b 00:09:20.406 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:09:20.406 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@901 -- # local i 00:09:20.406 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:09:20.406 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:09:20.406 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:09:20.664 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@906 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c4744581-bae1-440b-a51a-278ee2589a7b -t 2000 00:09:20.922 [ 00:09:20.922 { 00:09:20.922 "name": "c4744581-bae1-440b-a51a-278ee2589a7b", 00:09:20.922 "aliases": [ 00:09:20.922 "lvs/lvol" 00:09:20.922 ], 00:09:20.922 "product_name": "Logical Volume", 00:09:20.922 "block_size": 4096, 00:09:20.922 "num_blocks": 38912, 00:09:20.922 "uuid": "c4744581-bae1-440b-a51a-278ee2589a7b", 00:09:20.922 "assigned_rate_limits": { 00:09:20.922 "rw_ios_per_sec": 0, 00:09:20.923 "rw_mbytes_per_sec": 0, 00:09:20.923 "r_mbytes_per_sec": 0, 00:09:20.923 "w_mbytes_per_sec": 0 00:09:20.923 }, 00:09:20.923 "claimed": false, 00:09:20.923 "zoned": false, 00:09:20.923 "supported_io_types": { 00:09:20.923 "read": true, 00:09:20.923 "write": true, 00:09:20.923 "unmap": true, 00:09:20.923 "flush": false, 00:09:20.923 "reset": true, 00:09:20.923 "nvme_admin": false, 00:09:20.923 "nvme_io": false, 00:09:20.923 "nvme_io_md": false, 00:09:20.923 "write_zeroes": true, 00:09:20.923 "zcopy": false, 00:09:20.923 "get_zone_info": false, 00:09:20.923 "zone_management": false, 00:09:20.923 "zone_append": false, 00:09:20.923 "compare": false, 00:09:20.923 "compare_and_write": false, 00:09:20.923 "abort": false, 00:09:20.923 "seek_hole": true, 00:09:20.923 "seek_data": true, 00:09:20.923 "copy": false, 00:09:20.923 "nvme_iov_md": false 00:09:20.923 }, 00:09:20.923 "driver_specific": { 00:09:20.923 "lvol": { 00:09:20.923 "lvol_store_uuid": "740cc747-66af-4afe-a174-97a0badfc60c", 00:09:20.923 "base_bdev": "aio_bdev", 00:09:20.923 "thin_provision": false, 00:09:20.923 "num_allocated_clusters": 38, 00:09:20.923 "snapshot": false, 00:09:20.923 "clone": false, 00:09:20.923 "esnap_clone": false 00:09:20.923 } 00:09:20.923 } 00:09:20.923 } 00:09:20.923 ] 00:09:20.923 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@907 -- # return 0 00:09:20.923 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:20.923 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:09:21.181 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:09:21.181 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:21.181 13:20:16 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:09:21.439 13:20:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:09:21.439 13:20:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c4744581-bae1-440b-a51a-278ee2589a7b 00:09:21.697 13:20:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 740cc747-66af-4afe-a174-97a0badfc60c 00:09:21.965 13:20:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@94 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@95 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:22.223 00:09:22.223 real 0m17.875s 00:09:22.223 user 0m17.375s 00:09:22.223 sys 0m1.923s 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:09:22.223 ************************************ 00:09:22.223 END TEST lvs_grow_clean 00:09:22.223 ************************************ 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@103 -- # run_test lvs_grow_dirty lvs_grow dirty 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:09:22.223 ************************************ 00:09:22.223 START TEST lvs_grow_dirty 00:09:22.223 ************************************ 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1125 -- # lvs_grow dirty 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:22.223 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:09:22.482 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:09:22.482 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:09:22.740 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # lvs=cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:22.740 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:22.740 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:09:22.998 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:09:22.998 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:09:22.998 13:20:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u cb881f9e-6468-4940-a7dc-724cdd3548f1 lvol 150 00:09:23.565 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # lvol=764b08ce-390c-436a-8683-dd35abebf3b2 00:09:23.565 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:23.565 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:09:23.565 [2024-10-07 13:20:19.455901] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:09:23.565 [2024-10-07 13:20:19.455991] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:09:23.565 true 00:09:23.565 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:23.565 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:09:23.823 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:09:23.823 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:09:24.081 13:20:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 764b08ce-390c-436a-8683-dd35abebf3b2 00:09:24.646 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:09:24.646 [2024-10-07 13:20:20.551323] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:24.646 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=548116 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 548116 /var/tmp/bdevperf.sock 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 548116 ']' 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:09:24.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:24.904 13:20:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:09:25.162 [2024-10-07 13:20:20.881779] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:25.162 [2024-10-07 13:20:20.881857] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid548116 ] 00:09:25.162 [2024-10-07 13:20:20.944115] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:25.162 [2024-10-07 13:20:21.062701] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:25.420 13:20:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:25.420 13:20:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:09:25.420 13:20:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:09:25.985 Nvme0n1 00:09:25.985 13:20:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:09:26.254 [ 00:09:26.254 { 00:09:26.254 "name": "Nvme0n1", 00:09:26.254 "aliases": [ 00:09:26.254 "764b08ce-390c-436a-8683-dd35abebf3b2" 00:09:26.254 ], 00:09:26.254 "product_name": "NVMe disk", 00:09:26.254 "block_size": 4096, 00:09:26.254 "num_blocks": 38912, 00:09:26.254 "uuid": "764b08ce-390c-436a-8683-dd35abebf3b2", 00:09:26.254 "numa_id": 1, 00:09:26.254 "assigned_rate_limits": { 00:09:26.254 "rw_ios_per_sec": 0, 00:09:26.254 "rw_mbytes_per_sec": 0, 00:09:26.254 "r_mbytes_per_sec": 0, 00:09:26.254 "w_mbytes_per_sec": 0 00:09:26.254 }, 00:09:26.254 "claimed": false, 00:09:26.254 "zoned": false, 00:09:26.254 "supported_io_types": { 00:09:26.254 "read": true, 00:09:26.254 "write": true, 00:09:26.254 "unmap": true, 00:09:26.254 "flush": true, 00:09:26.254 "reset": true, 00:09:26.254 "nvme_admin": true, 00:09:26.254 "nvme_io": true, 00:09:26.254 "nvme_io_md": false, 00:09:26.254 "write_zeroes": true, 00:09:26.254 "zcopy": false, 00:09:26.254 "get_zone_info": false, 00:09:26.254 "zone_management": false, 00:09:26.254 "zone_append": false, 00:09:26.254 "compare": true, 00:09:26.254 "compare_and_write": true, 00:09:26.254 "abort": true, 00:09:26.254 "seek_hole": false, 00:09:26.254 "seek_data": false, 00:09:26.254 "copy": true, 00:09:26.254 "nvme_iov_md": false 00:09:26.254 }, 00:09:26.254 "memory_domains": [ 00:09:26.254 { 00:09:26.254 "dma_device_id": "system", 00:09:26.254 "dma_device_type": 1 00:09:26.254 } 00:09:26.254 ], 00:09:26.254 "driver_specific": { 00:09:26.254 "nvme": [ 00:09:26.254 { 00:09:26.254 "trid": { 00:09:26.254 "trtype": "TCP", 00:09:26.254 "adrfam": "IPv4", 00:09:26.254 "traddr": "10.0.0.2", 00:09:26.254 "trsvcid": "4420", 00:09:26.254 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:09:26.254 }, 00:09:26.254 "ctrlr_data": { 00:09:26.254 "cntlid": 1, 00:09:26.254 "vendor_id": "0x8086", 00:09:26.254 "model_number": "SPDK bdev Controller", 00:09:26.254 "serial_number": "SPDK0", 00:09:26.254 "firmware_revision": "25.01", 00:09:26.254 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:09:26.254 "oacs": { 00:09:26.254 "security": 0, 00:09:26.255 "format": 0, 00:09:26.255 "firmware": 0, 00:09:26.255 "ns_manage": 0 00:09:26.255 }, 00:09:26.255 "multi_ctrlr": true, 00:09:26.255 "ana_reporting": false 00:09:26.255 }, 00:09:26.255 "vs": { 00:09:26.255 "nvme_version": "1.3" 00:09:26.255 }, 00:09:26.255 "ns_data": { 00:09:26.255 "id": 1, 00:09:26.255 "can_share": true 00:09:26.255 } 00:09:26.255 } 00:09:26.255 ], 00:09:26.255 "mp_policy": "active_passive" 00:09:26.255 } 00:09:26.255 } 00:09:26.255 ] 00:09:26.255 13:20:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=548254 00:09:26.255 13:20:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:09:26.255 13:20:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:09:26.255 Running I/O for 10 seconds... 00:09:27.188 Latency(us) 00:09:27.188 [2024-10-07T11:20:23.121Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:27.188 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:27.188 Nvme0n1 : 1.00 16390.00 64.02 0.00 0.00 0.00 0.00 0.00 00:09:27.188 [2024-10-07T11:20:23.121Z] =================================================================================================================== 00:09:27.188 [2024-10-07T11:20:23.121Z] Total : 16390.00 64.02 0.00 0.00 0.00 0.00 0.00 00:09:27.188 00:09:28.123 13:20:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:28.381 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:28.381 Nvme0n1 : 2.00 16518.00 64.52 0.00 0.00 0.00 0.00 0.00 00:09:28.381 [2024-10-07T11:20:24.314Z] =================================================================================================================== 00:09:28.381 [2024-10-07T11:20:24.314Z] Total : 16518.00 64.52 0.00 0.00 0.00 0.00 0.00 00:09:28.381 00:09:28.381 true 00:09:28.381 13:20:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:28.381 13:20:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:09:28.639 13:20:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:09:28.639 13:20:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:09:28.639 13:20:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@65 -- # wait 548254 00:09:29.205 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:29.205 Nvme0n1 : 3.00 16604.00 64.86 0.00 0.00 0.00 0.00 0.00 00:09:29.205 [2024-10-07T11:20:25.138Z] =================================================================================================================== 00:09:29.205 [2024-10-07T11:20:25.138Z] Total : 16604.00 64.86 0.00 0.00 0.00 0.00 0.00 00:09:29.205 00:09:30.139 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:30.139 Nvme0n1 : 4.00 16723.75 65.33 0.00 0.00 0.00 0.00 0.00 00:09:30.139 [2024-10-07T11:20:26.072Z] =================================================================================================================== 00:09:30.139 [2024-10-07T11:20:26.072Z] Total : 16723.75 65.33 0.00 0.00 0.00 0.00 0.00 00:09:30.139 00:09:31.154 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:31.154 Nvme0n1 : 5.00 16789.20 65.58 0.00 0.00 0.00 0.00 0.00 00:09:31.154 [2024-10-07T11:20:27.087Z] =================================================================================================================== 00:09:31.154 [2024-10-07T11:20:27.087Z] Total : 16789.20 65.58 0.00 0.00 0.00 0.00 0.00 00:09:31.154 00:09:32.529 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:32.529 Nvme0n1 : 6.00 16880.83 65.94 0.00 0.00 0.00 0.00 0.00 00:09:32.529 [2024-10-07T11:20:28.462Z] =================================================================================================================== 00:09:32.529 [2024-10-07T11:20:28.462Z] Total : 16880.83 65.94 0.00 0.00 0.00 0.00 0.00 00:09:32.529 00:09:33.464 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:33.464 Nvme0n1 : 7.00 16956.57 66.24 0.00 0.00 0.00 0.00 0.00 00:09:33.464 [2024-10-07T11:20:29.397Z] =================================================================================================================== 00:09:33.464 [2024-10-07T11:20:29.397Z] Total : 16956.57 66.24 0.00 0.00 0.00 0.00 0.00 00:09:33.464 00:09:34.398 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:34.398 Nvme0n1 : 8.00 16996.38 66.39 0.00 0.00 0.00 0.00 0.00 00:09:34.398 [2024-10-07T11:20:30.331Z] =================================================================================================================== 00:09:34.398 [2024-10-07T11:20:30.331Z] Total : 16996.38 66.39 0.00 0.00 0.00 0.00 0.00 00:09:34.398 00:09:35.332 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:35.332 Nvme0n1 : 9.00 17006.44 66.43 0.00 0.00 0.00 0.00 0.00 00:09:35.332 [2024-10-07T11:20:31.265Z] =================================================================================================================== 00:09:35.332 [2024-10-07T11:20:31.265Z] Total : 17006.44 66.43 0.00 0.00 0.00 0.00 0.00 00:09:35.332 00:09:36.266 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:36.266 Nvme0n1 : 10.00 17053.10 66.61 0.00 0.00 0.00 0.00 0.00 00:09:36.266 [2024-10-07T11:20:32.199Z] =================================================================================================================== 00:09:36.266 [2024-10-07T11:20:32.199Z] Total : 17053.10 66.61 0.00 0.00 0.00 0.00 0.00 00:09:36.266 00:09:36.266 00:09:36.266 Latency(us) 00:09:36.266 [2024-10-07T11:20:32.199Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:36.266 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:09:36.266 Nvme0n1 : 10.01 17057.07 66.63 0.00 0.00 7500.52 4393.34 15922.82 00:09:36.266 [2024-10-07T11:20:32.199Z] =================================================================================================================== 00:09:36.266 [2024-10-07T11:20:32.199Z] Total : 17057.07 66.63 0.00 0.00 7500.52 4393.34 15922.82 00:09:36.266 { 00:09:36.266 "results": [ 00:09:36.266 { 00:09:36.266 "job": "Nvme0n1", 00:09:36.266 "core_mask": "0x2", 00:09:36.266 "workload": "randwrite", 00:09:36.266 "status": "finished", 00:09:36.266 "queue_depth": 128, 00:09:36.266 "io_size": 4096, 00:09:36.266 "runtime": 10.005175, 00:09:36.266 "iops": 17057.072964740746, 00:09:36.266 "mibps": 66.62919126851854, 00:09:36.266 "io_failed": 0, 00:09:36.266 "io_timeout": 0, 00:09:36.266 "avg_latency_us": 7500.515141648073, 00:09:36.266 "min_latency_us": 4393.339259259259, 00:09:36.266 "max_latency_us": 15922.82074074074 00:09:36.266 } 00:09:36.266 ], 00:09:36.266 "core_count": 1 00:09:36.266 } 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@66 -- # killprocess 548116 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@950 -- # '[' -z 548116 ']' 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@954 -- # kill -0 548116 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # uname 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 548116 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@968 -- # echo 'killing process with pid 548116' 00:09:36.266 killing process with pid 548116 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@969 -- # kill 548116 00:09:36.266 Received shutdown signal, test time was about 10.000000 seconds 00:09:36.266 00:09:36.266 Latency(us) 00:09:36.266 [2024-10-07T11:20:32.199Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:36.266 [2024-10-07T11:20:32.199Z] =================================================================================================================== 00:09:36.266 [2024-10-07T11:20:32.199Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:09:36.266 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@974 -- # wait 548116 00:09:36.524 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:09:36.781 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:09:37.348 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:37.348 13:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@72 -- # [[ dirty == \d\i\r\t\y ]] 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@74 -- # kill -9 545482 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # wait 545482 00:09:37.348 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 75: 545482 Killed "${NVMF_APP[@]}" "$@" 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # true 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@76 -- # nvmfappstart -m 0x1 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:37.348 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@507 -- # nvmfpid=549604 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@508 -- # waitforlisten 549604 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 549604 ']' 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:37.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:37.607 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:09:37.607 [2024-10-07 13:20:33.334240] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:37.607 [2024-10-07 13:20:33.334349] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:37.607 [2024-10-07 13:20:33.398498] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:37.607 [2024-10-07 13:20:33.508567] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:37.607 [2024-10-07 13:20:33.508641] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:37.607 [2024-10-07 13:20:33.508672] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:37.607 [2024-10-07 13:20:33.508683] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:37.607 [2024-10-07 13:20:33.508693] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:37.607 [2024-10-07 13:20:33.509376] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:37.865 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:37.865 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:09:37.865 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:37.865 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:37.865 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:09:37.865 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:37.865 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:09:38.123 [2024-10-07 13:20:33.909135] blobstore.c:4875:bs_recover: *NOTICE*: Performing recovery on blobstore 00:09:38.123 [2024-10-07 13:20:33.909278] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:09:38.123 [2024-10-07 13:20:33.909324] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # aio_bdev=aio_bdev 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@78 -- # waitforbdev 764b08ce-390c-436a-8683-dd35abebf3b2 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=764b08ce-390c-436a-8683-dd35abebf3b2 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:09:38.123 13:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:09:38.382 13:20:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 764b08ce-390c-436a-8683-dd35abebf3b2 -t 2000 00:09:38.641 [ 00:09:38.641 { 00:09:38.641 "name": "764b08ce-390c-436a-8683-dd35abebf3b2", 00:09:38.641 "aliases": [ 00:09:38.641 "lvs/lvol" 00:09:38.641 ], 00:09:38.641 "product_name": "Logical Volume", 00:09:38.641 "block_size": 4096, 00:09:38.641 "num_blocks": 38912, 00:09:38.641 "uuid": "764b08ce-390c-436a-8683-dd35abebf3b2", 00:09:38.641 "assigned_rate_limits": { 00:09:38.641 "rw_ios_per_sec": 0, 00:09:38.641 "rw_mbytes_per_sec": 0, 00:09:38.641 "r_mbytes_per_sec": 0, 00:09:38.641 "w_mbytes_per_sec": 0 00:09:38.641 }, 00:09:38.641 "claimed": false, 00:09:38.641 "zoned": false, 00:09:38.641 "supported_io_types": { 00:09:38.641 "read": true, 00:09:38.641 "write": true, 00:09:38.641 "unmap": true, 00:09:38.641 "flush": false, 00:09:38.641 "reset": true, 00:09:38.641 "nvme_admin": false, 00:09:38.641 "nvme_io": false, 00:09:38.641 "nvme_io_md": false, 00:09:38.641 "write_zeroes": true, 00:09:38.641 "zcopy": false, 00:09:38.641 "get_zone_info": false, 00:09:38.641 "zone_management": false, 00:09:38.641 "zone_append": false, 00:09:38.641 "compare": false, 00:09:38.641 "compare_and_write": false, 00:09:38.641 "abort": false, 00:09:38.641 "seek_hole": true, 00:09:38.641 "seek_data": true, 00:09:38.641 "copy": false, 00:09:38.641 "nvme_iov_md": false 00:09:38.641 }, 00:09:38.641 "driver_specific": { 00:09:38.641 "lvol": { 00:09:38.641 "lvol_store_uuid": "cb881f9e-6468-4940-a7dc-724cdd3548f1", 00:09:38.641 "base_bdev": "aio_bdev", 00:09:38.641 "thin_provision": false, 00:09:38.641 "num_allocated_clusters": 38, 00:09:38.641 "snapshot": false, 00:09:38.641 "clone": false, 00:09:38.641 "esnap_clone": false 00:09:38.641 } 00:09:38.641 } 00:09:38.641 } 00:09:38.641 ] 00:09:38.641 13:20:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:09:38.641 13:20:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:38.641 13:20:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].free_clusters' 00:09:38.899 13:20:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # (( free_clusters == 61 )) 00:09:38.899 13:20:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:38.899 13:20:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # jq -r '.[0].total_data_clusters' 00:09:39.157 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # (( data_clusters == 99 )) 00:09:39.157 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:09:39.415 [2024-10-07 13:20:35.254707] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:09:39.415 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@85 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:39.415 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@650 -- # local es=0 00:09:39.415 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:39.415 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:39.415 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:39.416 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:39.416 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:39.416 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:39.416 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:39.416 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:09:39.416 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:09:39.416 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:39.675 request: 00:09:39.675 { 00:09:39.675 "uuid": "cb881f9e-6468-4940-a7dc-724cdd3548f1", 00:09:39.675 "method": "bdev_lvol_get_lvstores", 00:09:39.675 "req_id": 1 00:09:39.675 } 00:09:39.675 Got JSON-RPC error response 00:09:39.675 response: 00:09:39.675 { 00:09:39.675 "code": -19, 00:09:39.675 "message": "No such device" 00:09:39.675 } 00:09:39.675 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # es=1 00:09:39.675 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:39.675 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:39.675 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:39.675 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:09:39.933 aio_bdev 00:09:39.933 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev 764b08ce-390c-436a-8683-dd35abebf3b2 00:09:39.933 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=764b08ce-390c-436a-8683-dd35abebf3b2 00:09:39.933 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:09:39.933 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:09:39.933 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:09:39.933 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:09:39.933 13:20:35 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:09:40.191 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 764b08ce-390c-436a-8683-dd35abebf3b2 -t 2000 00:09:40.449 [ 00:09:40.449 { 00:09:40.449 "name": "764b08ce-390c-436a-8683-dd35abebf3b2", 00:09:40.449 "aliases": [ 00:09:40.449 "lvs/lvol" 00:09:40.449 ], 00:09:40.449 "product_name": "Logical Volume", 00:09:40.449 "block_size": 4096, 00:09:40.449 "num_blocks": 38912, 00:09:40.449 "uuid": "764b08ce-390c-436a-8683-dd35abebf3b2", 00:09:40.449 "assigned_rate_limits": { 00:09:40.449 "rw_ios_per_sec": 0, 00:09:40.449 "rw_mbytes_per_sec": 0, 00:09:40.449 "r_mbytes_per_sec": 0, 00:09:40.449 "w_mbytes_per_sec": 0 00:09:40.449 }, 00:09:40.449 "claimed": false, 00:09:40.449 "zoned": false, 00:09:40.449 "supported_io_types": { 00:09:40.449 "read": true, 00:09:40.449 "write": true, 00:09:40.449 "unmap": true, 00:09:40.449 "flush": false, 00:09:40.449 "reset": true, 00:09:40.449 "nvme_admin": false, 00:09:40.449 "nvme_io": false, 00:09:40.449 "nvme_io_md": false, 00:09:40.449 "write_zeroes": true, 00:09:40.449 "zcopy": false, 00:09:40.449 "get_zone_info": false, 00:09:40.449 "zone_management": false, 00:09:40.449 "zone_append": false, 00:09:40.449 "compare": false, 00:09:40.449 "compare_and_write": false, 00:09:40.449 "abort": false, 00:09:40.449 "seek_hole": true, 00:09:40.449 "seek_data": true, 00:09:40.449 "copy": false, 00:09:40.449 "nvme_iov_md": false 00:09:40.449 }, 00:09:40.449 "driver_specific": { 00:09:40.449 "lvol": { 00:09:40.449 "lvol_store_uuid": "cb881f9e-6468-4940-a7dc-724cdd3548f1", 00:09:40.449 "base_bdev": "aio_bdev", 00:09:40.449 "thin_provision": false, 00:09:40.449 "num_allocated_clusters": 38, 00:09:40.449 "snapshot": false, 00:09:40.449 "clone": false, 00:09:40.449 "esnap_clone": false 00:09:40.449 } 00:09:40.449 } 00:09:40.449 } 00:09:40.449 ] 00:09:40.450 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:09:40.450 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:40.450 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:09:41.017 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:09:41.017 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:41.017 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:09:41.017 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:09:41.017 13:20:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 764b08ce-390c-436a-8683-dd35abebf3b2 00:09:41.277 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u cb881f9e-6468-4940-a7dc-724cdd3548f1 00:09:41.844 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@94 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:09:41.844 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@95 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:09:41.844 00:09:41.844 real 0m19.661s 00:09:41.844 user 0m49.521s 00:09:41.844 sys 0m4.988s 00:09:41.844 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:41.844 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:09:41.844 ************************************ 00:09:41.844 END TEST lvs_grow_dirty 00:09:41.844 ************************************ 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@808 -- # type=--id 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@809 -- # id=0 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@820 -- # for n in $shm_files 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:09:42.103 nvmf_trace.0 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@823 -- # return 0 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@121 -- # sync 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@124 -- # set +e 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:42.103 rmmod nvme_tcp 00:09:42.103 rmmod nvme_fabrics 00:09:42.103 rmmod nvme_keyring 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@128 -- # set -e 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@129 -- # return 0 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@515 -- # '[' -n 549604 ']' 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@516 -- # killprocess 549604 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@950 -- # '[' -z 549604 ']' 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@954 -- # kill -0 549604 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # uname 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 549604 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@968 -- # echo 'killing process with pid 549604' 00:09:42.103 killing process with pid 549604 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@969 -- # kill 549604 00:09:42.103 13:20:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@974 -- # wait 549604 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@297 -- # iptr 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-save 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-restore 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@302 -- # remove_spdk_ns 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:42.362 13:20:38 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:09:44.896 00:09:44.896 real 0m43.142s 00:09:44.896 user 1m12.984s 00:09:44.896 sys 0m8.920s 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:09:44.896 ************************************ 00:09:44.896 END TEST nvmf_lvs_grow 00:09:44.896 ************************************ 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@29 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:44.896 ************************************ 00:09:44.896 START TEST nvmf_bdev_io_wait 00:09:44.896 ************************************ 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:09:44.896 * Looking for test storage... 00:09:44.896 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lcov --version 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # IFS=.-: 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # read -ra ver1 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # IFS=.-: 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # read -ra ver2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@338 -- # local 'op=<' 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@340 -- # ver1_l=2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@341 -- # ver2_l=1 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@344 -- # case "$op" in 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@345 -- # : 1 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # decimal 1 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=1 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 1 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # ver1[v]=1 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # decimal 2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # ver2[v]=2 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # return 0 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:44.896 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:44.896 --rc genhtml_branch_coverage=1 00:09:44.896 --rc genhtml_function_coverage=1 00:09:44.896 --rc genhtml_legend=1 00:09:44.896 --rc geninfo_all_blocks=1 00:09:44.896 --rc geninfo_unexecuted_blocks=1 00:09:44.896 00:09:44.896 ' 00:09:44.896 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:44.896 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:44.896 --rc genhtml_branch_coverage=1 00:09:44.896 --rc genhtml_function_coverage=1 00:09:44.896 --rc genhtml_legend=1 00:09:44.896 --rc geninfo_all_blocks=1 00:09:44.896 --rc geninfo_unexecuted_blocks=1 00:09:44.896 00:09:44.897 ' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:44.897 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:44.897 --rc genhtml_branch_coverage=1 00:09:44.897 --rc genhtml_function_coverage=1 00:09:44.897 --rc genhtml_legend=1 00:09:44.897 --rc geninfo_all_blocks=1 00:09:44.897 --rc geninfo_unexecuted_blocks=1 00:09:44.897 00:09:44.897 ' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:44.897 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:44.897 --rc genhtml_branch_coverage=1 00:09:44.897 --rc genhtml_function_coverage=1 00:09:44.897 --rc genhtml_legend=1 00:09:44.897 --rc geninfo_all_blocks=1 00:09:44.897 --rc geninfo_unexecuted_blocks=1 00:09:44.897 00:09:44.897 ' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # uname -s 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@15 -- # shopt -s extglob 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@5 -- # export PATH 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@51 -- # : 0 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:44.897 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@309 -- # xtrace_disable 00:09:44.897 13:20:40 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@315 -- # pci_devs=() 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@315 -- # local -a pci_devs 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@316 -- # pci_net_devs=() 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@317 -- # pci_drivers=() 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@317 -- # local -A pci_drivers 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@319 -- # net_devs=() 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@319 -- # local -ga net_devs 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@320 -- # e810=() 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@320 -- # local -ga e810 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@321 -- # x722=() 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@321 -- # local -ga x722 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@322 -- # mlx=() 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@322 -- # local -ga mlx 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:09:46.797 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:09:46.798 Found 0000:84:00.0 (0x8086 - 0x159b) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:09:46.798 Found 0000:84:00.1 (0x8086 - 0x159b) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@416 -- # [[ up == up ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:09:46.798 Found net devices under 0000:84:00.0: cvl_0_0 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@416 -- # [[ up == up ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:09:46.798 Found net devices under 0000:84:00.1: cvl_0_1 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@440 -- # is_hw=yes 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:09:46.798 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:09:47.057 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:47.057 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:09:47.057 00:09:47.057 --- 10.0.0.2 ping statistics --- 00:09:47.057 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:47.057 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:47.057 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:47.057 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:09:47.057 00:09:47.057 --- 10.0.0.1 ping statistics --- 00:09:47.057 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:47.057 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@448 -- # return 0 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@507 -- # nvmfpid=552214 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@508 -- # waitforlisten 552214 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@831 -- # '[' -z 552214 ']' 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:47.057 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:47.057 13:20:42 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.057 [2024-10-07 13:20:42.887723] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:47.057 [2024-10-07 13:20:42.887800] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:47.057 [2024-10-07 13:20:42.951168] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:47.316 [2024-10-07 13:20:43.058316] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:47.316 [2024-10-07 13:20:43.058375] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:47.316 [2024-10-07 13:20:43.058402] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:47.316 [2024-10-07 13:20:43.058414] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:47.316 [2024-10-07 13:20:43.058423] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:47.316 [2024-10-07 13:20:43.060221] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:47.316 [2024-10-07 13:20:43.060329] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:47.316 [2024-10-07 13:20:43.060417] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:47.316 [2024-10-07 13:20:43.060420] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@864 -- # return 0 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.316 [2024-10-07 13:20:43.225491] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:47.316 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.575 Malloc0 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:47.575 [2024-10-07 13:20:43.289721] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@28 -- # WRITE_PID=552318 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@30 -- # READ_PID=552321 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:09:47.575 { 00:09:47.575 "params": { 00:09:47.575 "name": "Nvme$subsystem", 00:09:47.575 "trtype": "$TEST_TRANSPORT", 00:09:47.575 "traddr": "$NVMF_FIRST_TARGET_IP", 00:09:47.575 "adrfam": "ipv4", 00:09:47.575 "trsvcid": "$NVMF_PORT", 00:09:47.575 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:09:47.575 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:09:47.575 "hdgst": ${hdgst:-false}, 00:09:47.575 "ddgst": ${ddgst:-false} 00:09:47.575 }, 00:09:47.575 "method": "bdev_nvme_attach_controller" 00:09:47.575 } 00:09:47.575 EOF 00:09:47.575 )") 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=552325 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:09:47.575 { 00:09:47.575 "params": { 00:09:47.575 "name": "Nvme$subsystem", 00:09:47.575 "trtype": "$TEST_TRANSPORT", 00:09:47.575 "traddr": "$NVMF_FIRST_TARGET_IP", 00:09:47.575 "adrfam": "ipv4", 00:09:47.575 "trsvcid": "$NVMF_PORT", 00:09:47.575 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:09:47.575 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:09:47.575 "hdgst": ${hdgst:-false}, 00:09:47.575 "ddgst": ${ddgst:-false} 00:09:47.575 }, 00:09:47.575 "method": "bdev_nvme_attach_controller" 00:09:47.575 } 00:09:47.575 EOF 00:09:47.575 )") 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=552328 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@35 -- # sync 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:09:47.575 { 00:09:47.575 "params": { 00:09:47.575 "name": "Nvme$subsystem", 00:09:47.575 "trtype": "$TEST_TRANSPORT", 00:09:47.575 "traddr": "$NVMF_FIRST_TARGET_IP", 00:09:47.575 "adrfam": "ipv4", 00:09:47.575 "trsvcid": "$NVMF_PORT", 00:09:47.575 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:09:47.575 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:09:47.575 "hdgst": ${hdgst:-false}, 00:09:47.575 "ddgst": ${ddgst:-false} 00:09:47.575 }, 00:09:47.575 "method": "bdev_nvme_attach_controller" 00:09:47.575 } 00:09:47.575 EOF 00:09:47.575 )") 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:09:47.575 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:09:47.575 { 00:09:47.575 "params": { 00:09:47.575 "name": "Nvme$subsystem", 00:09:47.575 "trtype": "$TEST_TRANSPORT", 00:09:47.575 "traddr": "$NVMF_FIRST_TARGET_IP", 00:09:47.575 "adrfam": "ipv4", 00:09:47.575 "trsvcid": "$NVMF_PORT", 00:09:47.575 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:09:47.575 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:09:47.575 "hdgst": ${hdgst:-false}, 00:09:47.575 "ddgst": ${ddgst:-false} 00:09:47.575 }, 00:09:47.575 "method": "bdev_nvme_attach_controller" 00:09:47.575 } 00:09:47.575 EOF 00:09:47.576 )") 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@37 -- # wait 552318 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:09:47.576 "params": { 00:09:47.576 "name": "Nvme1", 00:09:47.576 "trtype": "tcp", 00:09:47.576 "traddr": "10.0.0.2", 00:09:47.576 "adrfam": "ipv4", 00:09:47.576 "trsvcid": "4420", 00:09:47.576 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:09:47.576 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:09:47.576 "hdgst": false, 00:09:47.576 "ddgst": false 00:09:47.576 }, 00:09:47.576 "method": "bdev_nvme_attach_controller" 00:09:47.576 }' 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:09:47.576 "params": { 00:09:47.576 "name": "Nvme1", 00:09:47.576 "trtype": "tcp", 00:09:47.576 "traddr": "10.0.0.2", 00:09:47.576 "adrfam": "ipv4", 00:09:47.576 "trsvcid": "4420", 00:09:47.576 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:09:47.576 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:09:47.576 "hdgst": false, 00:09:47.576 "ddgst": false 00:09:47.576 }, 00:09:47.576 "method": "bdev_nvme_attach_controller" 00:09:47.576 }' 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:09:47.576 "params": { 00:09:47.576 "name": "Nvme1", 00:09:47.576 "trtype": "tcp", 00:09:47.576 "traddr": "10.0.0.2", 00:09:47.576 "adrfam": "ipv4", 00:09:47.576 "trsvcid": "4420", 00:09:47.576 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:09:47.576 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:09:47.576 "hdgst": false, 00:09:47.576 "ddgst": false 00:09:47.576 }, 00:09:47.576 "method": "bdev_nvme_attach_controller" 00:09:47.576 }' 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:09:47.576 13:20:43 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:09:47.576 "params": { 00:09:47.576 "name": "Nvme1", 00:09:47.576 "trtype": "tcp", 00:09:47.576 "traddr": "10.0.0.2", 00:09:47.576 "adrfam": "ipv4", 00:09:47.576 "trsvcid": "4420", 00:09:47.576 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:09:47.576 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:09:47.576 "hdgst": false, 00:09:47.576 "ddgst": false 00:09:47.576 }, 00:09:47.576 "method": "bdev_nvme_attach_controller" 00:09:47.576 }' 00:09:47.576 [2024-10-07 13:20:43.339349] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:47.576 [2024-10-07 13:20:43.339349] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:47.576 [2024-10-07 13:20:43.339349] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:47.576 [2024-10-07 13:20:43.339430] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-07 13:20:43.339431] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-07 13:20:43.339431] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 .cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 .cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:09:47.576 --proc-type=auto ] 00:09:47.576 --proc-type=auto ] 00:09:47.576 [2024-10-07 13:20:43.340313] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:47.576 [2024-10-07 13:20:43.340380] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:09:47.834 [2024-10-07 13:20:43.513742] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:47.834 [2024-10-07 13:20:43.612914] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:09:47.834 [2024-10-07 13:20:43.615616] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:47.834 [2024-10-07 13:20:43.715627] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 7 00:09:47.834 [2024-10-07 13:20:43.717196] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:48.092 [2024-10-07 13:20:43.784250] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:48.092 [2024-10-07 13:20:43.812869] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:09:48.092 [2024-10-07 13:20:43.876474] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:09:48.351 Running I/O for 1 seconds... 00:09:48.351 Running I/O for 1 seconds... 00:09:48.351 Running I/O for 1 seconds... 00:09:48.609 Running I/O for 1 seconds... 00:09:49.433 10107.00 IOPS, 39.48 MiB/s 00:09:49.433 Latency(us) 00:09:49.433 [2024-10-07T11:20:45.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:49.433 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:09:49.433 Nvme1n1 : 1.01 10152.17 39.66 0.00 0.00 12552.57 7184.69 18835.53 00:09:49.433 [2024-10-07T11:20:45.366Z] =================================================================================================================== 00:09:49.433 [2024-10-07T11:20:45.366Z] Total : 10152.17 39.66 0.00 0.00 12552.57 7184.69 18835.53 00:09:49.433 9415.00 IOPS, 36.78 MiB/s 00:09:49.433 Latency(us) 00:09:49.433 [2024-10-07T11:20:45.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:49.433 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:09:49.433 Nvme1n1 : 1.01 9481.68 37.04 0.00 0.00 13445.22 5631.24 23690.05 00:09:49.433 [2024-10-07T11:20:45.366Z] =================================================================================================================== 00:09:49.433 [2024-10-07T11:20:45.366Z] Total : 9481.68 37.04 0.00 0.00 13445.22 5631.24 23690.05 00:09:49.433 8371.00 IOPS, 32.70 MiB/s 00:09:49.433 Latency(us) 00:09:49.433 [2024-10-07T11:20:45.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:49.433 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:09:49.433 Nvme1n1 : 1.01 8441.72 32.98 0.00 0.00 15099.48 4199.16 24078.41 00:09:49.433 [2024-10-07T11:20:45.366Z] =================================================================================================================== 00:09:49.433 [2024-10-07T11:20:45.366Z] Total : 8441.72 32.98 0.00 0.00 15099.48 4199.16 24078.41 00:09:49.433 196352.00 IOPS, 767.00 MiB/s 00:09:49.433 Latency(us) 00:09:49.433 [2024-10-07T11:20:45.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:49.433 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:09:49.433 Nvme1n1 : 1.00 195978.23 765.54 0.00 0.00 649.61 304.92 1868.99 00:09:49.433 [2024-10-07T11:20:45.366Z] =================================================================================================================== 00:09:49.433 [2024-10-07T11:20:45.366Z] Total : 195978.23 765.54 0.00 0.00 649.61 304.92 1868.99 00:09:49.691 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@38 -- # wait 552321 00:09:49.691 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@39 -- # wait 552325 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@40 -- # wait 552328 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@121 -- # sync 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@124 -- # set +e 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:49.949 rmmod nvme_tcp 00:09:49.949 rmmod nvme_fabrics 00:09:49.949 rmmod nvme_keyring 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@128 -- # set -e 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@129 -- # return 0 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@515 -- # '[' -n 552214 ']' 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@516 -- # killprocess 552214 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@950 -- # '[' -z 552214 ']' 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@954 -- # kill -0 552214 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # uname 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 552214 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@968 -- # echo 'killing process with pid 552214' 00:09:49.949 killing process with pid 552214 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@969 -- # kill 552214 00:09:49.949 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@974 -- # wait 552214 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@297 -- # iptr 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-save 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-restore 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@302 -- # remove_spdk_ns 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:50.208 13:20:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:52.114 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:09:52.114 00:09:52.114 real 0m7.777s 00:09:52.114 user 0m17.999s 00:09:52.114 sys 0m3.900s 00:09:52.114 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:52.114 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:09:52.114 ************************************ 00:09:52.114 END TEST nvmf_bdev_io_wait 00:09:52.114 ************************************ 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@30 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:52.373 ************************************ 00:09:52.373 START TEST nvmf_queue_depth 00:09:52.373 ************************************ 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:09:52.373 * Looking for test storage... 00:09:52.373 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lcov --version 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # IFS=.-: 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # read -ra ver1 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # IFS=.-: 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # read -ra ver2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@338 -- # local 'op=<' 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@340 -- # ver1_l=2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@341 -- # ver2_l=1 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@344 -- # case "$op" in 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@345 -- # : 1 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # decimal 1 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=1 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 1 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # ver1[v]=1 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # decimal 2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # ver2[v]=2 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # return 0 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:52.373 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:52.373 --rc genhtml_branch_coverage=1 00:09:52.373 --rc genhtml_function_coverage=1 00:09:52.373 --rc genhtml_legend=1 00:09:52.373 --rc geninfo_all_blocks=1 00:09:52.373 --rc geninfo_unexecuted_blocks=1 00:09:52.373 00:09:52.373 ' 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:52.373 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:52.373 --rc genhtml_branch_coverage=1 00:09:52.373 --rc genhtml_function_coverage=1 00:09:52.373 --rc genhtml_legend=1 00:09:52.373 --rc geninfo_all_blocks=1 00:09:52.373 --rc geninfo_unexecuted_blocks=1 00:09:52.373 00:09:52.373 ' 00:09:52.373 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:52.373 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:52.373 --rc genhtml_branch_coverage=1 00:09:52.373 --rc genhtml_function_coverage=1 00:09:52.373 --rc genhtml_legend=1 00:09:52.374 --rc geninfo_all_blocks=1 00:09:52.374 --rc geninfo_unexecuted_blocks=1 00:09:52.374 00:09:52.374 ' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:52.374 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:52.374 --rc genhtml_branch_coverage=1 00:09:52.374 --rc genhtml_function_coverage=1 00:09:52.374 --rc genhtml_legend=1 00:09:52.374 --rc geninfo_all_blocks=1 00:09:52.374 --rc geninfo_unexecuted_blocks=1 00:09:52.374 00:09:52.374 ' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # uname -s 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@15 -- # shopt -s extglob 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@5 -- # export PATH 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@51 -- # : 0 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:52.374 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@19 -- # nvmftestinit 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@309 -- # xtrace_disable 00:09:52.374 13:20:48 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@315 -- # pci_devs=() 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@315 -- # local -a pci_devs 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@316 -- # pci_net_devs=() 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@317 -- # pci_drivers=() 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@317 -- # local -A pci_drivers 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@319 -- # net_devs=() 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@319 -- # local -ga net_devs 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@320 -- # e810=() 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@320 -- # local -ga e810 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@321 -- # x722=() 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@321 -- # local -ga x722 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@322 -- # mlx=() 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@322 -- # local -ga mlx 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:54.912 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:09:54.913 Found 0000:84:00.0 (0x8086 - 0x159b) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:09:54.913 Found 0000:84:00.1 (0x8086 - 0x159b) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@416 -- # [[ up == up ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:09:54.913 Found net devices under 0000:84:00.0: cvl_0_0 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@416 -- # [[ up == up ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:09:54.913 Found net devices under 0000:84:00.1: cvl_0_1 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@440 -- # is_hw=yes 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:09:54.913 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:54.913 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:09:54.913 00:09:54.913 --- 10.0.0.2 ping statistics --- 00:09:54.913 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:54.913 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:54.913 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:54.913 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:09:54.913 00:09:54.913 --- 10.0.0.1 ping statistics --- 00:09:54.913 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:54.913 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@448 -- # return 0 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@507 -- # nvmfpid=554577 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@508 -- # waitforlisten 554577 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 554577 ']' 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:54.913 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:54.913 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:54.913 [2024-10-07 13:20:50.647457] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:54.913 [2024-10-07 13:20:50.647586] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:54.913 [2024-10-07 13:20:50.716232] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:54.914 [2024-10-07 13:20:50.826125] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:54.914 [2024-10-07 13:20:50.826187] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:54.914 [2024-10-07 13:20:50.826217] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:54.914 [2024-10-07 13:20:50.826229] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:54.914 [2024-10-07 13:20:50.826239] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:54.914 [2024-10-07 13:20:50.826925] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.172 [2024-10-07 13:20:50.975887] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:55.172 13:20:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.172 Malloc0 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.172 [2024-10-07 13:20:51.036753] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@30 -- # bdevperf_pid=554719 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@33 -- # waitforlisten 554719 /var/tmp/bdevperf.sock 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 554719 ']' 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:09:55.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:55.172 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.172 [2024-10-07 13:20:51.084634] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:55.172 [2024-10-07 13:20:51.084713] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid554719 ] 00:09:55.431 [2024-10-07 13:20:51.144105] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:55.431 [2024-10-07 13:20:51.249464] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:55.431 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:55.431 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:09:55.431 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:09:55.431 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:55.431 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:09:55.689 NVMe0n1 00:09:55.689 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:55.689 13:20:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:09:55.947 Running I/O for 10 seconds... 00:09:57.816 8888.00 IOPS, 34.72 MiB/s [2024-10-07T11:20:54.755Z] 9066.50 IOPS, 35.42 MiB/s [2024-10-07T11:20:56.130Z] 9200.33 IOPS, 35.94 MiB/s [2024-10-07T11:20:57.064Z] 9221.75 IOPS, 36.02 MiB/s [2024-10-07T11:20:57.998Z] 9336.20 IOPS, 36.47 MiB/s [2024-10-07T11:20:58.931Z] 9380.67 IOPS, 36.64 MiB/s [2024-10-07T11:20:59.866Z] 9459.29 IOPS, 36.95 MiB/s [2024-10-07T11:21:00.800Z] 9461.38 IOPS, 36.96 MiB/s [2024-10-07T11:21:02.175Z] 9434.89 IOPS, 36.86 MiB/s [2024-10-07T11:21:02.175Z] 9476.90 IOPS, 37.02 MiB/s 00:10:06.242 Latency(us) 00:10:06.242 [2024-10-07T11:21:02.175Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:06.242 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:10:06.242 Verification LBA range: start 0x0 length 0x4000 00:10:06.242 NVMe0n1 : 10.07 9496.63 37.10 0.00 0.00 107353.58 20291.89 71846.87 00:10:06.242 [2024-10-07T11:21:02.175Z] =================================================================================================================== 00:10:06.242 [2024-10-07T11:21:02.175Z] Total : 9496.63 37.10 0.00 0.00 107353.58 20291.89 71846.87 00:10:06.242 { 00:10:06.242 "results": [ 00:10:06.242 { 00:10:06.242 "job": "NVMe0n1", 00:10:06.242 "core_mask": "0x1", 00:10:06.242 "workload": "verify", 00:10:06.242 "status": "finished", 00:10:06.242 "verify_range": { 00:10:06.242 "start": 0, 00:10:06.242 "length": 16384 00:10:06.242 }, 00:10:06.242 "queue_depth": 1024, 00:10:06.242 "io_size": 4096, 00:10:06.242 "runtime": 10.073676, 00:10:06.242 "iops": 9496.632609585617, 00:10:06.242 "mibps": 37.096221131193815, 00:10:06.242 "io_failed": 0, 00:10:06.242 "io_timeout": 0, 00:10:06.242 "avg_latency_us": 107353.57637806227, 00:10:06.242 "min_latency_us": 20291.88740740741, 00:10:06.243 "max_latency_us": 71846.87407407408 00:10:06.243 } 00:10:06.243 ], 00:10:06.243 "core_count": 1 00:10:06.243 } 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@39 -- # killprocess 554719 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 554719 ']' 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 554719 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 554719 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 554719' 00:10:06.243 killing process with pid 554719 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 554719 00:10:06.243 Received shutdown signal, test time was about 10.000000 seconds 00:10:06.243 00:10:06.243 Latency(us) 00:10:06.243 [2024-10-07T11:21:02.176Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:06.243 [2024-10-07T11:21:02.176Z] =================================================================================================================== 00:10:06.243 [2024-10-07T11:21:02.176Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:10:06.243 13:21:01 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 554719 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@43 -- # nvmftestfini 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@121 -- # sync 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@124 -- # set +e 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:06.243 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:06.243 rmmod nvme_tcp 00:10:06.243 rmmod nvme_fabrics 00:10:06.243 rmmod nvme_keyring 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@128 -- # set -e 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@129 -- # return 0 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@515 -- # '[' -n 554577 ']' 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@516 -- # killprocess 554577 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 554577 ']' 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 554577 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 554577 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 554577' 00:10:06.501 killing process with pid 554577 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 554577 00:10:06.501 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 554577 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@297 -- # iptr 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-save 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-restore 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@302 -- # remove_spdk_ns 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:06.759 13:21:02 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:08.665 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:10:08.665 00:10:08.665 real 0m16.490s 00:10:08.665 user 0m22.795s 00:10:08.665 sys 0m3.459s 00:10:08.665 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:08.665 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:08.665 ************************************ 00:10:08.665 END TEST nvmf_queue_depth 00:10:08.665 ************************************ 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@31 -- # run_test nvmf_target_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:08.924 ************************************ 00:10:08.924 START TEST nvmf_target_multipath 00:10:08.924 ************************************ 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:10:08.924 * Looking for test storage... 00:10:08.924 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lcov --version 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # IFS=.-: 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # read -ra ver1 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # IFS=.-: 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # read -ra ver2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@338 -- # local 'op=<' 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@340 -- # ver1_l=2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@341 -- # ver2_l=1 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@344 -- # case "$op" in 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@345 -- # : 1 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # decimal 1 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=1 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 1 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # ver1[v]=1 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # decimal 2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # ver2[v]=2 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # return 0 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:08.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:08.924 --rc genhtml_branch_coverage=1 00:10:08.924 --rc genhtml_function_coverage=1 00:10:08.924 --rc genhtml_legend=1 00:10:08.924 --rc geninfo_all_blocks=1 00:10:08.924 --rc geninfo_unexecuted_blocks=1 00:10:08.924 00:10:08.924 ' 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:08.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:08.924 --rc genhtml_branch_coverage=1 00:10:08.924 --rc genhtml_function_coverage=1 00:10:08.924 --rc genhtml_legend=1 00:10:08.924 --rc geninfo_all_blocks=1 00:10:08.924 --rc geninfo_unexecuted_blocks=1 00:10:08.924 00:10:08.924 ' 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:08.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:08.924 --rc genhtml_branch_coverage=1 00:10:08.924 --rc genhtml_function_coverage=1 00:10:08.924 --rc genhtml_legend=1 00:10:08.924 --rc geninfo_all_blocks=1 00:10:08.924 --rc geninfo_unexecuted_blocks=1 00:10:08.924 00:10:08.924 ' 00:10:08.924 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:08.924 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:08.924 --rc genhtml_branch_coverage=1 00:10:08.924 --rc genhtml_function_coverage=1 00:10:08.925 --rc genhtml_legend=1 00:10:08.925 --rc geninfo_all_blocks=1 00:10:08.925 --rc geninfo_unexecuted_blocks=1 00:10:08.925 00:10:08.925 ' 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # uname -s 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@15 -- # shopt -s extglob 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@5 -- # export PATH 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@51 -- # : 0 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:08.925 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@43 -- # nvmftestinit 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@309 -- # xtrace_disable 00:10:08.925 13:21:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@315 -- # pci_devs=() 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@315 -- # local -a pci_devs 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@316 -- # pci_net_devs=() 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@317 -- # pci_drivers=() 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@317 -- # local -A pci_drivers 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@319 -- # net_devs=() 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@319 -- # local -ga net_devs 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@320 -- # e810=() 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@320 -- # local -ga e810 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@321 -- # x722=() 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@321 -- # local -ga x722 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@322 -- # mlx=() 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@322 -- # local -ga mlx 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:10:11.458 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:10:11.459 Found 0000:84:00.0 (0x8086 - 0x159b) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:10:11.459 Found 0000:84:00.1 (0x8086 - 0x159b) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:10:11.459 Found net devices under 0000:84:00.0: cvl_0_0 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:10:11.459 Found net devices under 0000:84:00.1: cvl_0_1 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@440 -- # is_hw=yes 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:10:11.459 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:11.459 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:10:11.459 00:10:11.459 --- 10.0.0.2 ping statistics --- 00:10:11.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:11.459 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:10:11.459 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:11.459 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:10:11.459 00:10:11.459 --- 10.0.0.1 ping statistics --- 00:10:11.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:11.459 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@448 -- # return 0 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@45 -- # '[' -z ']' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:10:11.459 only one NIC for nvmf test 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@47 -- # nvmftestfini 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@121 -- # sync 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@124 -- # set +e 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:11.459 rmmod nvme_tcp 00:10:11.459 rmmod nvme_fabrics 00:10:11.459 rmmod nvme_keyring 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@128 -- # set -e 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@129 -- # return 0 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@515 -- # '[' -n '' ']' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@297 -- # iptr 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-save 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-restore 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@302 -- # remove_spdk_ns 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:11.459 13:21:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@48 -- # exit 0 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@1 -- # nvmftestfini 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@121 -- # sync 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@124 -- # set +e 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@128 -- # set -e 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@129 -- # return 0 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@515 -- # '[' -n '' ']' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@297 -- # iptr 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-save 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-restore 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@302 -- # remove_spdk_ns 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:10:13.994 00:10:13.994 real 0m4.705s 00:10:13.994 user 0m0.977s 00:10:13.994 sys 0m1.746s 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:10:13.994 ************************************ 00:10:13.994 END TEST nvmf_target_multipath 00:10:13.994 ************************************ 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@32 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:13.994 ************************************ 00:10:13.994 START TEST nvmf_zcopy 00:10:13.994 ************************************ 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:10:13.994 * Looking for test storage... 00:10:13.994 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lcov --version 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # IFS=.-: 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # read -ra ver1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # IFS=.-: 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # read -ra ver2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@338 -- # local 'op=<' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@340 -- # ver1_l=2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@341 -- # ver2_l=1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@344 -- # case "$op" in 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@345 -- # : 1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # decimal 1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # ver1[v]=1 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # decimal 2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # ver2[v]=2 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # return 0 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:13.994 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:13.994 --rc genhtml_branch_coverage=1 00:10:13.994 --rc genhtml_function_coverage=1 00:10:13.994 --rc genhtml_legend=1 00:10:13.994 --rc geninfo_all_blocks=1 00:10:13.994 --rc geninfo_unexecuted_blocks=1 00:10:13.994 00:10:13.994 ' 00:10:13.994 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:13.994 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:13.995 --rc genhtml_branch_coverage=1 00:10:13.995 --rc genhtml_function_coverage=1 00:10:13.995 --rc genhtml_legend=1 00:10:13.995 --rc geninfo_all_blocks=1 00:10:13.995 --rc geninfo_unexecuted_blocks=1 00:10:13.995 00:10:13.995 ' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:13.995 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:13.995 --rc genhtml_branch_coverage=1 00:10:13.995 --rc genhtml_function_coverage=1 00:10:13.995 --rc genhtml_legend=1 00:10:13.995 --rc geninfo_all_blocks=1 00:10:13.995 --rc geninfo_unexecuted_blocks=1 00:10:13.995 00:10:13.995 ' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:13.995 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:13.995 --rc genhtml_branch_coverage=1 00:10:13.995 --rc genhtml_function_coverage=1 00:10:13.995 --rc genhtml_legend=1 00:10:13.995 --rc geninfo_all_blocks=1 00:10:13.995 --rc geninfo_unexecuted_blocks=1 00:10:13.995 00:10:13.995 ' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # uname -s 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@15 -- # shopt -s extglob 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@5 -- # export PATH 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@51 -- # : 0 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:13.995 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@12 -- # nvmftestinit 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@309 -- # xtrace_disable 00:10:13.995 13:21:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:15.898 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@315 -- # pci_devs=() 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@315 -- # local -a pci_devs 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@316 -- # pci_net_devs=() 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@317 -- # pci_drivers=() 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@317 -- # local -A pci_drivers 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@319 -- # net_devs=() 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@319 -- # local -ga net_devs 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@320 -- # e810=() 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@320 -- # local -ga e810 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@321 -- # x722=() 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@321 -- # local -ga x722 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@322 -- # mlx=() 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@322 -- # local -ga mlx 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:10:15.899 Found 0000:84:00.0 (0x8086 - 0x159b) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:10:15.899 Found 0000:84:00.1 (0x8086 - 0x159b) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:10:15.899 Found net devices under 0000:84:00.0: cvl_0_0 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:10:15.899 Found net devices under 0000:84:00.1: cvl_0_1 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@440 -- # is_hw=yes 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:10:15.899 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:15.899 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:10:15.899 00:10:15.899 --- 10.0.0.2 ping statistics --- 00:10:15.899 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:15.899 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:10:15.899 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:15.899 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:10:15.899 00:10:15.899 --- 10.0.0.1 ping statistics --- 00:10:15.899 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:15.899 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@448 -- # return 0 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:15.899 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@507 -- # nvmfpid=560581 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@508 -- # waitforlisten 560581 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@831 -- # '[' -z 560581 ']' 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:16.158 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:16.158 13:21:11 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.158 [2024-10-07 13:21:11.901059] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:16.158 [2024-10-07 13:21:11.901156] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:16.158 [2024-10-07 13:21:11.964863] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:16.158 [2024-10-07 13:21:12.070145] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:16.158 [2024-10-07 13:21:12.070206] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:16.158 [2024-10-07 13:21:12.070235] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:16.159 [2024-10-07 13:21:12.070254] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:16.159 [2024-10-07 13:21:12.070265] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:16.159 [2024-10-07 13:21:12.070967] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@864 -- # return 0 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.417 [2024-10-07 13:21:12.208801] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.417 [2024-10-07 13:21:12.225060] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.417 malloc0 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:10:16.417 { 00:10:16.417 "params": { 00:10:16.417 "name": "Nvme$subsystem", 00:10:16.417 "trtype": "$TEST_TRANSPORT", 00:10:16.417 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:16.417 "adrfam": "ipv4", 00:10:16.417 "trsvcid": "$NVMF_PORT", 00:10:16.417 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:16.417 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:16.417 "hdgst": ${hdgst:-false}, 00:10:16.417 "ddgst": ${ddgst:-false} 00:10:16.417 }, 00:10:16.417 "method": "bdev_nvme_attach_controller" 00:10:16.417 } 00:10:16.417 EOF 00:10:16.417 )") 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:10:16.417 13:21:12 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:10:16.417 "params": { 00:10:16.417 "name": "Nvme1", 00:10:16.417 "trtype": "tcp", 00:10:16.417 "traddr": "10.0.0.2", 00:10:16.417 "adrfam": "ipv4", 00:10:16.417 "trsvcid": "4420", 00:10:16.417 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:10:16.417 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:10:16.417 "hdgst": false, 00:10:16.417 "ddgst": false 00:10:16.417 }, 00:10:16.417 "method": "bdev_nvme_attach_controller" 00:10:16.417 }' 00:10:16.417 [2024-10-07 13:21:12.319586] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:16.417 [2024-10-07 13:21:12.319666] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid560614 ] 00:10:16.676 [2024-10-07 13:21:12.385073] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:16.676 [2024-10-07 13:21:12.495893] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:16.934 Running I/O for 10 seconds... 00:10:19.241 6314.00 IOPS, 49.33 MiB/s [2024-10-07T11:21:16.107Z] 6344.50 IOPS, 49.57 MiB/s [2024-10-07T11:21:17.041Z] 6356.00 IOPS, 49.66 MiB/s [2024-10-07T11:21:17.975Z] 6376.75 IOPS, 49.82 MiB/s [2024-10-07T11:21:18.908Z] 6388.00 IOPS, 49.91 MiB/s [2024-10-07T11:21:20.282Z] 6397.83 IOPS, 49.98 MiB/s [2024-10-07T11:21:21.217Z] 6409.43 IOPS, 50.07 MiB/s [2024-10-07T11:21:22.152Z] 6394.88 IOPS, 49.96 MiB/s [2024-10-07T11:21:23.086Z] 6403.78 IOPS, 50.03 MiB/s [2024-10-07T11:21:23.086Z] 6408.40 IOPS, 50.07 MiB/s 00:10:27.153 Latency(us) 00:10:27.153 [2024-10-07T11:21:23.086Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:27.153 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:10:27.153 Verification LBA range: start 0x0 length 0x1000 00:10:27.153 Nvme1n1 : 10.01 6406.42 50.05 0.00 0.00 19929.52 2063.17 26020.22 00:10:27.153 [2024-10-07T11:21:23.086Z] =================================================================================================================== 00:10:27.153 [2024-10-07T11:21:23.086Z] Total : 6406.42 50.05 0.00 0.00 19929.52 2063.17 26020.22 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@39 -- # perfpid=561931 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@41 -- # xtrace_disable 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:10:27.411 { 00:10:27.411 "params": { 00:10:27.411 "name": "Nvme$subsystem", 00:10:27.411 "trtype": "$TEST_TRANSPORT", 00:10:27.411 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:27.411 "adrfam": "ipv4", 00:10:27.411 "trsvcid": "$NVMF_PORT", 00:10:27.411 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:27.411 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:27.411 "hdgst": ${hdgst:-false}, 00:10:27.411 "ddgst": ${ddgst:-false} 00:10:27.411 }, 00:10:27.411 "method": "bdev_nvme_attach_controller" 00:10:27.411 } 00:10:27.411 EOF 00:10:27.411 )") 00:10:27.411 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:10:27.411 [2024-10-07 13:21:23.150664] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.150707] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:10:27.412 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:10:27.412 13:21:23 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:10:27.412 "params": { 00:10:27.412 "name": "Nvme1", 00:10:27.412 "trtype": "tcp", 00:10:27.412 "traddr": "10.0.0.2", 00:10:27.412 "adrfam": "ipv4", 00:10:27.412 "trsvcid": "4420", 00:10:27.412 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:10:27.412 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:10:27.412 "hdgst": false, 00:10:27.412 "ddgst": false 00:10:27.412 }, 00:10:27.412 "method": "bdev_nvme_attach_controller" 00:10:27.412 }' 00:10:27.412 [2024-10-07 13:21:23.158624] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.158649] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.166643] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.166665] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.174664] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.174686] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.182683] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.182704] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.190707] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.190730] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.194937] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:27.412 [2024-10-07 13:21:23.195006] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid561931 ] 00:10:27.412 [2024-10-07 13:21:23.198729] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.198751] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.206749] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.206784] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.214794] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.214814] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.222806] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.222826] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.230844] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.230864] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.238863] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.238883] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.246882] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.246903] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.253684] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:27.412 [2024-10-07 13:21:23.254903] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.254922] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.262944] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.262981] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.270943] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.270968] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.278953] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.278973] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.286976] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.286996] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.294997] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.295016] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.303018] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.303037] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.311041] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.311061] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.319086] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.319117] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.327094] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.327116] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.335105] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.335125] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.412 [2024-10-07 13:21:23.343128] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.412 [2024-10-07 13:21:23.343147] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.351150] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.351170] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.359174] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.359194] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.367194] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.367214] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.369368] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:27.670 [2024-10-07 13:21:23.375215] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.375234] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.383243] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.383264] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.391284] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.391315] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.399306] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.399339] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.407330] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.407364] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.415359] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.415395] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.423378] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.423414] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.431398] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.431433] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.439393] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.439413] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.447440] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.447497] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.455476] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.455519] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.463509] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.463560] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.471501] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.471522] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.479523] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.479559] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.487559] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.487579] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.495587] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.495612] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.503609] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.503632] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.511619] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.511641] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.519639] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.519662] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.527657] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.527679] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.535677] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.535698] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.543698] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.543719] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.551720] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.551740] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.559767] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.559804] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.567789] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.567812] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.575805] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.575839] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.583843] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.583862] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.591858] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.591878] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.670 [2024-10-07 13:21:23.599868] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.670 [2024-10-07 13:21:23.599888] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.607904] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.607924] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.615920] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.615942] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.623939] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.623960] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.631959] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.631978] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.639981] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.640000] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.648003] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.648022] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.656030] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.656052] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.664050] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.664070] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.672072] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.672092] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.680093] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.680112] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.688115] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.688135] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.696139] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.696159] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.704158] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.704178] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.712188] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.712212] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.720202] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.720222] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 Running I/O for 5 seconds... 00:10:27.935 [2024-10-07 13:21:23.728222] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.728242] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.742322] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.742348] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.752330] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.752354] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.762788] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.762813] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.775134] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.775159] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.785048] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.785072] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.795789] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.795815] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.806115] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.806141] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.816514] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.816556] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.826763] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.826802] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.837755] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.837796] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.850110] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.850134] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:27.935 [2024-10-07 13:21:23.861905] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:27.935 [2024-10-07 13:21:23.861949] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.871235] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.871263] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.882318] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.882353] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.894513] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.894540] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.904164] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.904190] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.914863] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.914904] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.925618] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.925646] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.937816] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.937857] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.947656] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.947683] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.957416] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.957440] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.968057] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.968082] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.261 [2024-10-07 13:21:23.978424] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.261 [2024-10-07 13:21:23.978448] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:23.988495] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:23.988521] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:23.998342] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:23.998366] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.008663] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.008690] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.019064] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.019088] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.029569] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.029595] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.042138] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.042162] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.053664] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.053690] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.062880] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.062905] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.073570] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.073597] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.084053] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.084091] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.094522] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.094548] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.107008] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.107032] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.117235] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.117260] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.127900] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.127925] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.138633] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.138659] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.150888] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.150915] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.160747] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.160775] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.262 [2024-10-07 13:21:24.171458] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.262 [2024-10-07 13:21:24.171510] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.182861] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.182888] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.195288] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.195312] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.205381] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.205405] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.216214] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.216239] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.229040] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.229064] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.239195] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.239220] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.249673] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.249702] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.259810] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.259850] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.270306] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.270330] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.282272] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.282296] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.291962] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.291996] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.303001] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.303026] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.312847] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.312872] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.322991] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.323015] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.333755] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.333795] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.344185] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.344209] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.356599] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.356625] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.366086] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.366109] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.376618] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.376645] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.387258] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.387282] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.397730] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.397757] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.409693] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.409719] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.419652] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.419679] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.429857] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.429881] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.440283] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.440307] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.450882] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.450906] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.461595] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.461620] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.547 [2024-10-07 13:21:24.472293] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.547 [2024-10-07 13:21:24.472317] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.482878] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.482906] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.493453] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.493509] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.506164] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.506188] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.516042] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.516066] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.526148] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.526173] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.536366] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.536390] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.546633] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.546659] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.557280] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.557304] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.567922] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.567946] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.578525] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.578551] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.588940] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.588964] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.599332] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.599357] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.609647] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.609674] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.620156] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.620180] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.630580] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.630606] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.641662] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.641689] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.806 [2024-10-07 13:21:24.652451] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.806 [2024-10-07 13:21:24.652499] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 [2024-10-07 13:21:24.662963] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.662988] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 [2024-10-07 13:21:24.673906] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.673931] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 [2024-10-07 13:21:24.684966] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.684991] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 [2024-10-07 13:21:24.695561] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.695589] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 [2024-10-07 13:21:24.706431] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.706455] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 [2024-10-07 13:21:24.718668] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.718693] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 12051.00 IOPS, 94.15 MiB/s [2024-10-07T11:21:24.740Z] [2024-10-07 13:21:24.728764] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.728792] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:28.807 [2024-10-07 13:21:24.739975] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:28.807 [2024-10-07 13:21:24.740002] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.750979] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.751004] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.761576] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.761602] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.775158] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.775183] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.787284] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.787308] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.797442] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.797481] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.807733] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.807778] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.818135] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.818159] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.828795] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.828821] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.841615] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.841641] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.851125] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.851149] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.861738] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.861779] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.872036] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.872060] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.882245] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.065 [2024-10-07 13:21:24.882269] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.065 [2024-10-07 13:21:24.892278] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.892302] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.902601] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.902628] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.913086] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.913110] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.925333] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.925359] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.935668] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.935695] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.946045] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.946070] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.956343] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.956368] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.966542] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.966570] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.977788] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.977813] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.988144] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.988169] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.066 [2024-10-07 13:21:24.999276] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.066 [2024-10-07 13:21:24.999303] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.012273] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.012298] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.023839] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.023864] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.032783] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.032808] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.043496] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.043523] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.053712] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.053739] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.064100] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.064125] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.074546] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.074573] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.085056] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.085080] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.095740] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.095787] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.105950] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.105975] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.116241] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.116265] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.126404] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.126428] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.136427] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.136455] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.146955] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.146980] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.157187] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.157212] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.167800] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.167827] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.180866] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.180891] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.190900] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.190924] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.201887] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.201912] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.214039] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.214064] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.223548] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.223574] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.233679] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.233706] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.243696] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.243723] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.253908] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.253933] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.337 [2024-10-07 13:21:25.264608] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.337 [2024-10-07 13:21:25.264635] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.275496] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.275521] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.286108] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.286133] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.297055] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.297087] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.307569] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.307596] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.320084] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.320108] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.331541] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.331568] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.340192] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.340216] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.351641] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.351669] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.362249] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.362273] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.372560] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.372587] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.383005] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.383030] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.395664] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.395690] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.405973] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.405997] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.416570] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.416597] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.427624] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.427650] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.438543] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.438569] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.448939] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.448963] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.460128] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.460151] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.471053] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.471077] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.483591] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.483617] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.493712] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.493741] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.504114] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.504147] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.514641] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.514669] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.595 [2024-10-07 13:21:25.525585] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.595 [2024-10-07 13:21:25.525613] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.536733] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.536760] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.549572] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.549598] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.559972] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.559997] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.570713] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.570740] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.583903] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.583928] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.594306] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.594331] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.605106] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.605130] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.617060] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.617085] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.626961] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.626987] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.637552] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.637579] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.648041] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.648066] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.658669] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.658697] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.671148] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.671173] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.681354] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.681378] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.692145] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.692171] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.704917] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.704943] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.715756] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.715804] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.726642] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.726669] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 12034.50 IOPS, 94.02 MiB/s [2024-10-07T11:21:25.789Z] [2024-10-07 13:21:25.739418] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.739442] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.749284] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.749308] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.759730] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.759757] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.770292] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.770316] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:29.856 [2024-10-07 13:21:25.781134] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:29.856 [2024-10-07 13:21:25.781158] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.792480] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.792530] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.803067] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.803092] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.815691] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.815717] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.825010] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.825035] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.835962] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.835986] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.846682] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.846708] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.857255] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.857279] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.869930] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.869954] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.879735] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.879776] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.890137] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.890161] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.900871] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.900895] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.911367] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.911391] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.922043] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.922067] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.933973] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.933998] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.943870] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.943896] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.954375] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.954400] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.964419] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.964443] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.974894] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.974919] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.986201] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.986225] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:25.996339] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:25.996363] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:26.006327] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:26.006352] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:26.016787] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:26.016812] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:26.027223] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:26.027247] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:26.037598] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:26.037624] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.116 [2024-10-07 13:21:26.048186] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.116 [2024-10-07 13:21:26.048213] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.059137] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.374 [2024-10-07 13:21:26.059171] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.071186] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.374 [2024-10-07 13:21:26.071211] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.080691] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.374 [2024-10-07 13:21:26.080718] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.091164] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.374 [2024-10-07 13:21:26.091189] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.101646] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.374 [2024-10-07 13:21:26.101673] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.112168] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.374 [2024-10-07 13:21:26.112208] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.124480] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.374 [2024-10-07 13:21:26.124515] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.374 [2024-10-07 13:21:26.134377] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.134401] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.144440] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.144465] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.154380] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.154405] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.164626] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.164653] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.175503] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.175552] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.188362] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.188387] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.198558] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.198593] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.209092] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.209116] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.221155] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.221179] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.231426] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.231450] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.241914] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.241939] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.254383] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.254408] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.264172] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.264196] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.274743] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.274784] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.285236] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.285260] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.297176] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.297199] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.375 [2024-10-07 13:21:26.306918] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.375 [2024-10-07 13:21:26.306945] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.318136] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.318160] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.328161] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.328185] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.338867] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.338892] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.351118] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.351142] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.360575] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.360613] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.371113] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.371137] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.383268] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.383292] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.393769] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.393808] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.404440] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.404478] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.416857] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.416882] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.427013] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.427038] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.437997] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.438022] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.450355] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.450379] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.460383] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.460407] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.470863] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.470888] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.481576] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.481603] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.492563] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.492590] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.503424] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.503448] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.516050] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.516074] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.526211] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.526245] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.536799] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.536839] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.547383] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.547407] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.633 [2024-10-07 13:21:26.558075] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.633 [2024-10-07 13:21:26.558099] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.571400] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.571424] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.581952] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.581977] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.592639] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.592665] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.605156] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.605180] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.615152] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.615176] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.625290] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.625314] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.635753] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.635793] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.648390] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.648415] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.659859] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.659883] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.668695] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.668721] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.680085] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.680110] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.691022] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.691060] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.701600] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.701627] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.714011] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.714036] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.723128] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.723151] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 12063.67 IOPS, 94.25 MiB/s [2024-10-07T11:21:26.824Z] [2024-10-07 13:21:26.735563] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.735600] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.746076] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.746103] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.756213] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.891 [2024-10-07 13:21:26.756237] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.891 [2024-10-07 13:21:26.766583] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.892 [2024-10-07 13:21:26.766611] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.892 [2024-10-07 13:21:26.776904] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.892 [2024-10-07 13:21:26.776928] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.892 [2024-10-07 13:21:26.787160] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.892 [2024-10-07 13:21:26.787184] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.892 [2024-10-07 13:21:26.798426] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.892 [2024-10-07 13:21:26.798451] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.892 [2024-10-07 13:21:26.808457] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.892 [2024-10-07 13:21:26.808504] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:30.892 [2024-10-07 13:21:26.818459] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:30.892 [2024-10-07 13:21:26.818507] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.829229] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.829254] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.839261] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.839286] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.849039] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.849063] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.858996] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.859019] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.869599] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.869625] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.882601] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.882628] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.892602] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.892630] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.903127] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.903151] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.913658] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.913684] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.923695] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.923722] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.934212] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.934245] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.944569] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.944598] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.955164] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.955190] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.965958] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.965983] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.976857] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.976881] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:26.987435] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:26.987459] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.000317] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.000342] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.010248] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.010272] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.020918] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.020942] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.033282] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.033307] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.041686] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.041713] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.054404] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.054429] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.064699] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.064725] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.150 [2024-10-07 13:21:27.075257] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.150 [2024-10-07 13:21:27.075280] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.088155] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.088180] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.098018] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.098042] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.107814] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.107854] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.118561] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.118587] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.130890] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.130915] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.140909] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.140933] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.151343] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.151368] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.161848] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.161882] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.172748] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.172788] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.185183] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.185207] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.196628] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.196655] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.205904] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.205929] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.217116] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.217142] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.229050] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.229075] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.239088] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.239115] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.249872] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.249912] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.260332] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.260357] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.270894] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.270919] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.281697] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.281723] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.291977] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.292016] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.302553] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.302580] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.312891] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.312917] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.323799] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.323824] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.409 [2024-10-07 13:21:27.335969] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.409 [2024-10-07 13:21:27.335994] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.346325] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.346351] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.357382] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.357407] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.368002] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.368026] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.379164] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.379188] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.389299] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.389323] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.400119] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.400143] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.412684] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.412710] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.422873] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.422898] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.433523] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.433563] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.445977] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.446001] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.455566] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.455592] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.466844] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.466868] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.479175] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.479200] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.489194] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.489218] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.499956] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.499981] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.510430] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.510454] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.522922] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.522946] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.533291] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.533315] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.543752] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.543793] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.554449] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.554496] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.565263] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.565287] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.577685] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.577712] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.587008] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.587032] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.668 [2024-10-07 13:21:27.598636] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.668 [2024-10-07 13:21:27.598664] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.610182] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.610206] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.622279] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.622303] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.632191] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.632215] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.642666] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.642692] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.653413] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.653437] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.663946] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.663971] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.674412] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.674436] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.686671] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.686698] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.696430] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.696455] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.707784] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.707808] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.720070] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.720094] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.729963] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.729988] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 12064.75 IOPS, 94.26 MiB/s [2024-10-07T11:21:27.860Z] [2024-10-07 13:21:27.740867] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.740891] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.751413] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.751447] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.762171] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.762195] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.774345] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.774369] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.784649] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.784674] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.795003] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.795027] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.807324] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.807349] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.816458] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.816505] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.827484] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.827533] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.839416] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.839440] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.849353] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.849378] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:31.927 [2024-10-07 13:21:27.859979] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:31.927 [2024-10-07 13:21:27.860004] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.185 [2024-10-07 13:21:27.871185] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.185 [2024-10-07 13:21:27.871209] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.185 [2024-10-07 13:21:27.882295] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.185 [2024-10-07 13:21:27.882320] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.185 [2024-10-07 13:21:27.893354] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.893378] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.903886] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.903910] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.914915] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.914939] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.925546] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.925573] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.936368] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.936393] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.948983] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.949008] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.960544] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.960581] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.969681] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.969709] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.980860] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.980885] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:27.993086] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:27.993111] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.002680] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.002708] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.013952] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.013978] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.025725] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.025751] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.035222] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.035246] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.045905] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.045929] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.057546] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.057572] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.067357] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.067382] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.077371] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.077395] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.087616] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.087642] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.097868] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.097893] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.186 [2024-10-07 13:21:28.108138] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.186 [2024-10-07 13:21:28.108162] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.120792] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.120816] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.130817] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.130857] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.141124] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.141148] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.151843] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.151868] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.163922] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.163953] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.173854] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.173878] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.184146] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.184171] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.194704] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.194731] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.207274] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.207298] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.216704] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.216728] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.227091] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.227115] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.237718] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.237745] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.254265] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.254291] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.264627] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.264654] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.274976] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.275001] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.285018] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.285042] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.295255] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.295279] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.305713] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.305748] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.316082] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.316107] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.326571] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.326597] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.338560] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.338586] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.348673] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.348699] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.359274] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.359299] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.444 [2024-10-07 13:21:28.369980] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.444 [2024-10-07 13:21:28.370014] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.381007] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.381051] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.391231] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.391257] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.401449] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.401498] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.411729] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.411755] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.422329] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.422353] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.432803] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.432829] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.443067] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.443093] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.453147] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.453171] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.463081] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.463105] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.472908] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.702 [2024-10-07 13:21:28.472933] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.702 [2024-10-07 13:21:28.483035] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.483060] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.493336] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.493361] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.503658] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.503684] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.514429] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.514454] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.524950] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.524974] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.535531] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.535558] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.546293] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.546317] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.559042] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.559066] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.570461] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.570510] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.579256] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.579280] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.590572] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.590598] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.601621] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.601649] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.611907] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.611931] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.622135] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.622160] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.703 [2024-10-07 13:21:28.632547] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.703 [2024-10-07 13:21:28.632574] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.643115] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.643139] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.653947] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.653972] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.663974] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.663998] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.674740] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.674781] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.687453] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.687501] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.697549] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.697574] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.708401] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.708425] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.721299] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.721323] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.731447] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.731493] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 12090.20 IOPS, 94.45 MiB/s [2024-10-07T11:21:28.894Z] [2024-10-07 13:21:28.741935] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.741960] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.746567] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.746593] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 00:10:32.961 Latency(us) 00:10:32.961 [2024-10-07T11:21:28.894Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:32.961 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:10:32.961 Nvme1n1 : 5.01 12090.86 94.46 0.00 0.00 10572.97 4514.70 20874.43 00:10:32.961 [2024-10-07T11:21:28.894Z] =================================================================================================================== 00:10:32.961 [2024-10-07T11:21:28.894Z] Total : 12090.86 94.46 0.00 0.00 10572.97 4514.70 20874.43 00:10:32.961 [2024-10-07 13:21:28.754088] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.754110] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.762092] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.762115] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.770115] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.770138] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.778192] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.778243] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.786215] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.961 [2024-10-07 13:21:28.786267] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.961 [2024-10-07 13:21:28.794232] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.794279] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.802252] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.802303] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.810264] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.810314] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.818296] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.818347] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.826316] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.826367] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.834339] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.834387] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.842365] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.842415] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.850387] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.850437] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.858411] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.858463] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.866425] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.866475] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.874447] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.874503] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.882466] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.882539] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:32.962 [2024-10-07 13:21:28.890496] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:32.962 [2024-10-07 13:21:28.890542] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.898483] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.898513] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.906503] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.906524] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.914521] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.914557] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.922559] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.922579] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.930588] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.930624] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.938618] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.938665] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.946649] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.946698] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.954623] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.954645] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.962641] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.962662] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.970661] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.970682] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.978684] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.978706] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.986767] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.986810] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:28.994798] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.220 [2024-10-07 13:21:28.994846] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.220 [2024-10-07 13:21:29.002786] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.221 [2024-10-07 13:21:29.002819] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.221 [2024-10-07 13:21:29.010797] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.221 [2024-10-07 13:21:29.010820] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.221 [2024-10-07 13:21:29.018812] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.221 [2024-10-07 13:21:29.018832] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.221 [2024-10-07 13:21:29.026829] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:10:33.221 [2024-10-07 13:21:29.026863] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:33.221 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (561931) - No such process 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@49 -- # wait 561931 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:33.221 delay0 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:33.221 13:21:29 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:10:33.221 [2024-10-07 13:21:29.139935] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:10:39.779 Initializing NVMe Controllers 00:10:39.779 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:10:39.779 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:10:39.779 Initialization complete. Launching workers. 00:10:39.779 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 1099 00:10:39.779 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1368, failed to submit 51 00:10:39.779 success 1194, unsuccessful 174, failed 0 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@60 -- # nvmftestfini 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@121 -- # sync 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@124 -- # set +e 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:39.779 rmmod nvme_tcp 00:10:39.779 rmmod nvme_fabrics 00:10:39.779 rmmod nvme_keyring 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@128 -- # set -e 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@129 -- # return 0 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@515 -- # '[' -n 560581 ']' 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@516 -- # killprocess 560581 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@950 -- # '[' -z 560581 ']' 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@954 -- # kill -0 560581 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # uname 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 560581 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@968 -- # echo 'killing process with pid 560581' 00:10:39.779 killing process with pid 560581 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@969 -- # kill 560581 00:10:39.779 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@974 -- # wait 560581 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@297 -- # iptr 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-save 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-restore 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@302 -- # remove_spdk_ns 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:40.038 13:21:35 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:41.945 13:21:37 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:10:41.945 00:10:41.945 real 0m28.433s 00:10:41.945 user 0m40.975s 00:10:41.946 sys 0m9.420s 00:10:41.946 13:21:37 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:41.946 13:21:37 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:10:41.946 ************************************ 00:10:41.946 END TEST nvmf_zcopy 00:10:41.946 ************************************ 00:10:41.946 13:21:37 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@33 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:10:41.946 13:21:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:41.946 13:21:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:41.946 13:21:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:42.205 ************************************ 00:10:42.205 START TEST nvmf_nmic 00:10:42.205 ************************************ 00:10:42.205 13:21:37 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:10:42.205 * Looking for test storage... 00:10:42.205 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:10:42.205 13:21:37 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:42.205 13:21:37 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lcov --version 00:10:42.205 13:21:37 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # IFS=.-: 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # read -ra ver1 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # IFS=.-: 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # read -ra ver2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@338 -- # local 'op=<' 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@340 -- # ver1_l=2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@341 -- # ver2_l=1 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@344 -- # case "$op" in 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@345 -- # : 1 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # decimal 1 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=1 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 1 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # ver1[v]=1 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # decimal 2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # ver2[v]=2 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # return 0 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:42.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:42.205 --rc genhtml_branch_coverage=1 00:10:42.205 --rc genhtml_function_coverage=1 00:10:42.205 --rc genhtml_legend=1 00:10:42.205 --rc geninfo_all_blocks=1 00:10:42.205 --rc geninfo_unexecuted_blocks=1 00:10:42.205 00:10:42.205 ' 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:42.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:42.205 --rc genhtml_branch_coverage=1 00:10:42.205 --rc genhtml_function_coverage=1 00:10:42.205 --rc genhtml_legend=1 00:10:42.205 --rc geninfo_all_blocks=1 00:10:42.205 --rc geninfo_unexecuted_blocks=1 00:10:42.205 00:10:42.205 ' 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:42.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:42.205 --rc genhtml_branch_coverage=1 00:10:42.205 --rc genhtml_function_coverage=1 00:10:42.205 --rc genhtml_legend=1 00:10:42.205 --rc geninfo_all_blocks=1 00:10:42.205 --rc geninfo_unexecuted_blocks=1 00:10:42.205 00:10:42.205 ' 00:10:42.205 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:42.205 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:42.205 --rc genhtml_branch_coverage=1 00:10:42.205 --rc genhtml_function_coverage=1 00:10:42.205 --rc genhtml_legend=1 00:10:42.205 --rc geninfo_all_blocks=1 00:10:42.205 --rc geninfo_unexecuted_blocks=1 00:10:42.206 00:10:42.206 ' 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # uname -s 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@15 -- # shopt -s extglob 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@5 -- # export PATH 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@51 -- # : 0 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:42.206 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@14 -- # nvmftestinit 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@309 -- # xtrace_disable 00:10:42.206 13:21:38 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@315 -- # pci_devs=() 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@315 -- # local -a pci_devs 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@316 -- # pci_net_devs=() 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@317 -- # pci_drivers=() 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@317 -- # local -A pci_drivers 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@319 -- # net_devs=() 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@319 -- # local -ga net_devs 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@320 -- # e810=() 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@320 -- # local -ga e810 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@321 -- # x722=() 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@321 -- # local -ga x722 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@322 -- # mlx=() 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@322 -- # local -ga mlx 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:10:44.741 Found 0000:84:00.0 (0x8086 - 0x159b) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:10:44.741 Found 0000:84:00.1 (0x8086 - 0x159b) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:10:44.741 Found net devices under 0000:84:00.0: cvl_0_0 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:10:44.741 Found net devices under 0000:84:00.1: cvl_0_1 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@440 -- # is_hw=yes 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:10:44.741 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:10:44.742 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:44.742 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:10:44.742 00:10:44.742 --- 10.0.0.2 ping statistics --- 00:10:44.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:44.742 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:10:44.742 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:44.742 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:10:44.742 00:10:44.742 --- 10.0.0.1 ping statistics --- 00:10:44.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:44.742 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@448 -- # return 0 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@507 -- # nvmfpid=565355 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@508 -- # waitforlisten 565355 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@831 -- # '[' -z 565355 ']' 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:44.742 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:44.742 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:44.742 [2024-10-07 13:21:40.521329] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:44.742 [2024-10-07 13:21:40.521408] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:44.742 [2024-10-07 13:21:40.587228] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:45.001 [2024-10-07 13:21:40.694575] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:45.001 [2024-10-07 13:21:40.694646] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:45.001 [2024-10-07 13:21:40.694674] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:45.001 [2024-10-07 13:21:40.694686] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:45.001 [2024-10-07 13:21:40.694695] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:45.001 [2024-10-07 13:21:40.696367] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:45.001 [2024-10-07 13:21:40.696477] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:45.001 [2024-10-07 13:21:40.696567] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:45.001 [2024-10-07 13:21:40.696572] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@864 -- # return 0 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.001 [2024-10-07 13:21:40.855268] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.001 Malloc0 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.001 [2024-10-07 13:21:40.907747] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:10:45.001 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:10:45.002 test case1: single bdev can't be used in multiple subsystems 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@28 -- # nmic_status=0 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.002 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.002 [2024-10-07 13:21:40.931543] bdev.c:8202:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:10:45.002 [2024-10-07 13:21:40.931575] subsystem.c:2157:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:10:45.002 [2024-10-07 13:21:40.931590] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:10:45.259 request: 00:10:45.259 { 00:10:45.259 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:10:45.259 "namespace": { 00:10:45.259 "bdev_name": "Malloc0", 00:10:45.259 "no_auto_visible": false 00:10:45.259 }, 00:10:45.259 "method": "nvmf_subsystem_add_ns", 00:10:45.259 "req_id": 1 00:10:45.259 } 00:10:45.259 Got JSON-RPC error response 00:10:45.259 response: 00:10:45.259 { 00:10:45.259 "code": -32602, 00:10:45.259 "message": "Invalid parameters" 00:10:45.259 } 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # nmic_status=1 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:10:45.259 Adding namespace failed - expected result. 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:10:45.259 test case2: host connect to nvmf target in multiple paths 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:45.259 [2024-10-07 13:21:40.939672] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:45.259 13:21:40 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:10:45.825 13:21:41 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:10:46.391 13:21:42 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:10:46.391 13:21:42 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1198 -- # local i=0 00:10:46.391 13:21:42 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:10:46.391 13:21:42 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:10:46.391 13:21:42 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1205 -- # sleep 2 00:10:48.916 13:21:44 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:10:48.916 13:21:44 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:10:48.916 13:21:44 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:10:48.916 13:21:44 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:10:48.916 13:21:44 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:10:48.916 13:21:44 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # return 0 00:10:48.916 13:21:44 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:10:48.916 [global] 00:10:48.916 thread=1 00:10:48.916 invalidate=1 00:10:48.916 rw=write 00:10:48.916 time_based=1 00:10:48.916 runtime=1 00:10:48.916 ioengine=libaio 00:10:48.916 direct=1 00:10:48.916 bs=4096 00:10:48.916 iodepth=1 00:10:48.916 norandommap=0 00:10:48.916 numjobs=1 00:10:48.916 00:10:48.916 verify_dump=1 00:10:48.916 verify_backlog=512 00:10:48.916 verify_state_save=0 00:10:48.916 do_verify=1 00:10:48.916 verify=crc32c-intel 00:10:48.916 [job0] 00:10:48.916 filename=/dev/nvme0n1 00:10:48.916 Could not set queue depth (nvme0n1) 00:10:48.916 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:10:48.916 fio-3.35 00:10:48.916 Starting 1 thread 00:10:49.849 00:10:49.849 job0: (groupid=0, jobs=1): err= 0: pid=565997: Mon Oct 7 13:21:45 2024 00:10:49.849 read: IOPS=22, BW=90.1KiB/s (92.3kB/s)(92.0KiB/1021msec) 00:10:49.849 slat (nsec): min=17909, max=52516, avg=35025.09, stdev=12088.38 00:10:49.849 clat (usec): min=280, max=41455, avg=39202.08, stdev=8485.43 00:10:49.849 lat (usec): min=301, max=41475, avg=39237.11, stdev=8488.36 00:10:49.849 clat percentiles (usec): 00:10:49.849 | 1.00th=[ 281], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:10:49.849 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:10:49.849 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:10:49.849 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:10:49.849 | 99.99th=[41681] 00:10:49.849 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:10:49.849 slat (nsec): min=8681, max=65957, avg=21159.63, stdev=7305.00 00:10:49.849 clat (usec): min=136, max=271, avg=203.07, stdev=31.47 00:10:49.849 lat (usec): min=146, max=296, avg=224.23, stdev=36.90 00:10:49.849 clat percentiles (usec): 00:10:49.849 | 1.00th=[ 143], 5.00th=[ 147], 10.00th=[ 151], 20.00th=[ 174], 00:10:49.849 | 30.00th=[ 196], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 212], 00:10:49.849 | 70.00th=[ 221], 80.00th=[ 231], 90.00th=[ 241], 95.00th=[ 249], 00:10:49.849 | 99.00th=[ 265], 99.50th=[ 269], 99.90th=[ 273], 99.95th=[ 273], 00:10:49.849 | 99.99th=[ 273] 00:10:49.849 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:10:49.849 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:10:49.849 lat (usec) : 250=91.40%, 500=4.49% 00:10:49.849 lat (msec) : 50=4.11% 00:10:49.849 cpu : usr=0.78%, sys=1.37%, ctx=535, majf=0, minf=1 00:10:49.849 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:10:49.849 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:10:49.849 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:10:49.849 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:10:49.849 latency : target=0, window=0, percentile=100.00%, depth=1 00:10:49.849 00:10:49.849 Run status group 0 (all jobs): 00:10:49.849 READ: bw=90.1KiB/s (92.3kB/s), 90.1KiB/s-90.1KiB/s (92.3kB/s-92.3kB/s), io=92.0KiB (94.2kB), run=1021-1021msec 00:10:49.849 WRITE: bw=2006KiB/s (2054kB/s), 2006KiB/s-2006KiB/s (2054kB/s-2054kB/s), io=2048KiB (2097kB), run=1021-1021msec 00:10:49.849 00:10:49.849 Disk stats (read/write): 00:10:49.849 nvme0n1: ios=70/512, merge=0/0, ticks=802/102, in_queue=904, util=91.48% 00:10:49.849 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:50.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1219 -- # local i=0 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1231 -- # return 0 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@53 -- # nvmftestfini 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@121 -- # sync 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@124 -- # set +e 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:50.107 rmmod nvme_tcp 00:10:50.107 rmmod nvme_fabrics 00:10:50.107 rmmod nvme_keyring 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@128 -- # set -e 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@129 -- # return 0 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@515 -- # '[' -n 565355 ']' 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@516 -- # killprocess 565355 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@950 -- # '[' -z 565355 ']' 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@954 -- # kill -0 565355 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # uname 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 565355 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@968 -- # echo 'killing process with pid 565355' 00:10:50.107 killing process with pid 565355 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@969 -- # kill 565355 00:10:50.107 13:21:45 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@974 -- # wait 565355 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@297 -- # iptr 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-save 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-restore 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@302 -- # remove_spdk_ns 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:50.367 13:21:46 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:10:52.933 00:10:52.933 real 0m10.392s 00:10:52.933 user 0m22.957s 00:10:52.933 sys 0m2.590s 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:10:52.933 ************************************ 00:10:52.933 END TEST nvmf_nmic 00:10:52.933 ************************************ 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@34 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:52.933 ************************************ 00:10:52.933 START TEST nvmf_fio_target 00:10:52.933 ************************************ 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:10:52.933 * Looking for test storage... 00:10:52.933 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lcov --version 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # IFS=.-: 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # read -ra ver1 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # IFS=.-: 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # read -ra ver2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@338 -- # local 'op=<' 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@340 -- # ver1_l=2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@341 -- # ver2_l=1 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@344 -- # case "$op" in 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@345 -- # : 1 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # decimal 1 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=1 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 1 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # ver1[v]=1 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # decimal 2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # ver2[v]=2 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # return 0 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:52.933 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:52.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:52.933 --rc genhtml_branch_coverage=1 00:10:52.933 --rc genhtml_function_coverage=1 00:10:52.933 --rc genhtml_legend=1 00:10:52.933 --rc geninfo_all_blocks=1 00:10:52.933 --rc geninfo_unexecuted_blocks=1 00:10:52.934 00:10:52.934 ' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:52.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:52.934 --rc genhtml_branch_coverage=1 00:10:52.934 --rc genhtml_function_coverage=1 00:10:52.934 --rc genhtml_legend=1 00:10:52.934 --rc geninfo_all_blocks=1 00:10:52.934 --rc geninfo_unexecuted_blocks=1 00:10:52.934 00:10:52.934 ' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:52.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:52.934 --rc genhtml_branch_coverage=1 00:10:52.934 --rc genhtml_function_coverage=1 00:10:52.934 --rc genhtml_legend=1 00:10:52.934 --rc geninfo_all_blocks=1 00:10:52.934 --rc geninfo_unexecuted_blocks=1 00:10:52.934 00:10:52.934 ' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:52.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:52.934 --rc genhtml_branch_coverage=1 00:10:52.934 --rc genhtml_function_coverage=1 00:10:52.934 --rc genhtml_legend=1 00:10:52.934 --rc geninfo_all_blocks=1 00:10:52.934 --rc geninfo_unexecuted_blocks=1 00:10:52.934 00:10:52.934 ' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # uname -s 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@15 -- # shopt -s extglob 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@5 -- # export PATH 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@51 -- # : 0 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:52.934 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@16 -- # nvmftestinit 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@309 -- # xtrace_disable 00:10:52.934 13:21:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@315 -- # pci_devs=() 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@315 -- # local -a pci_devs 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@316 -- # pci_net_devs=() 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@317 -- # pci_drivers=() 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@317 -- # local -A pci_drivers 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@319 -- # net_devs=() 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@319 -- # local -ga net_devs 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@320 -- # e810=() 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@320 -- # local -ga e810 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@321 -- # x722=() 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@321 -- # local -ga x722 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@322 -- # mlx=() 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@322 -- # local -ga mlx 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:10:54.839 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:10:54.840 Found 0000:84:00.0 (0x8086 - 0x159b) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:10:54.840 Found 0000:84:00.1 (0x8086 - 0x159b) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:10:54.840 Found net devices under 0000:84:00.0: cvl_0_0 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@416 -- # [[ up == up ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:10:54.840 Found net devices under 0000:84:00.1: cvl_0_1 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@440 -- # is_hw=yes 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:10:54.840 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:10:55.099 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:55.099 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:10:55.099 00:10:55.099 --- 10.0.0.2 ping statistics --- 00:10:55.099 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:55.099 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:10:55.099 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:55.099 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:10:55.099 00:10:55.099 --- 10.0.0.1 ping statistics --- 00:10:55.099 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:55.099 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@448 -- # return 0 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@507 -- # nvmfpid=568099 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@508 -- # waitforlisten 568099 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@831 -- # '[' -z 568099 ']' 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:55.099 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:55.099 13:21:50 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:10:55.099 [2024-10-07 13:21:50.940165] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:55.099 [2024-10-07 13:21:50.940269] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:55.099 [2024-10-07 13:21:51.005672] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:55.357 [2024-10-07 13:21:51.119774] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:55.358 [2024-10-07 13:21:51.119833] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:55.358 [2024-10-07 13:21:51.119862] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:55.358 [2024-10-07 13:21:51.119880] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:55.358 [2024-10-07 13:21:51.119891] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:55.358 [2024-10-07 13:21:51.121617] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:55.358 [2024-10-07 13:21:51.121678] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:55.358 [2024-10-07 13:21:51.121742] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:55.358 [2024-10-07 13:21:51.121746] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:55.358 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:55.358 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@864 -- # return 0 00:10:55.358 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:55.358 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:55.358 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:10:55.358 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:55.358 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:10:55.615 [2024-10-07 13:21:51.526285] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:55.873 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:10:56.130 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:10:56.130 13:21:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:10:56.387 13:21:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:10:56.387 13:21:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:10:56.645 13:21:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:10:56.645 13:21:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:10:56.904 13:21:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:10:56.904 13:21:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:10:57.161 13:21:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:10:57.419 13:21:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:10:57.419 13:21:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:10:57.677 13:21:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:10:57.677 13:21:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:10:57.935 13:21:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:10:57.935 13:21:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:10:58.192 13:21:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:58.450 13:21:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:10:58.450 13:21:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:10:59.073 13:21:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:10:59.073 13:21:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:59.073 13:21:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:10:59.356 [2024-10-07 13:21:55.153360] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:10:59.356 13:21:55 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:10:59.613 13:21:55 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:10:59.870 13:21:55 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:00.803 13:21:56 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:11:00.803 13:21:56 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1198 -- # local i=0 00:11:00.803 13:21:56 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:00.803 13:21:56 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1200 -- # [[ -n 4 ]] 00:11:00.803 13:21:56 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1201 -- # nvme_device_counter=4 00:11:00.803 13:21:56 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1205 -- # sleep 2 00:11:02.699 13:21:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:02.699 13:21:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:02.699 13:21:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:02.699 13:21:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # nvme_devices=4 00:11:02.699 13:21:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:02.699 13:21:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # return 0 00:11:02.700 13:21:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:11:02.700 [global] 00:11:02.700 thread=1 00:11:02.700 invalidate=1 00:11:02.700 rw=write 00:11:02.700 time_based=1 00:11:02.700 runtime=1 00:11:02.700 ioengine=libaio 00:11:02.700 direct=1 00:11:02.700 bs=4096 00:11:02.700 iodepth=1 00:11:02.700 norandommap=0 00:11:02.700 numjobs=1 00:11:02.700 00:11:02.700 verify_dump=1 00:11:02.700 verify_backlog=512 00:11:02.700 verify_state_save=0 00:11:02.700 do_verify=1 00:11:02.700 verify=crc32c-intel 00:11:02.700 [job0] 00:11:02.700 filename=/dev/nvme0n1 00:11:02.700 [job1] 00:11:02.700 filename=/dev/nvme0n2 00:11:02.700 [job2] 00:11:02.700 filename=/dev/nvme0n3 00:11:02.700 [job3] 00:11:02.700 filename=/dev/nvme0n4 00:11:02.700 Could not set queue depth (nvme0n1) 00:11:02.700 Could not set queue depth (nvme0n2) 00:11:02.700 Could not set queue depth (nvme0n3) 00:11:02.700 Could not set queue depth (nvme0n4) 00:11:02.957 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:02.957 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:02.957 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:02.957 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:02.957 fio-3.35 00:11:02.957 Starting 4 threads 00:11:04.331 00:11:04.331 job0: (groupid=0, jobs=1): err= 0: pid=569187: Mon Oct 7 13:21:59 2024 00:11:04.331 read: IOPS=515, BW=2061KiB/s (2111kB/s)(2080KiB/1009msec) 00:11:04.331 slat (nsec): min=6705, max=45817, avg=10174.83, stdev=5580.02 00:11:04.331 clat (usec): min=178, max=41102, avg=1450.96, stdev=6610.76 00:11:04.331 lat (usec): min=186, max=41132, avg=1461.14, stdev=6611.54 00:11:04.331 clat percentiles (usec): 00:11:04.331 | 1.00th=[ 186], 5.00th=[ 196], 10.00th=[ 204], 20.00th=[ 219], 00:11:04.331 | 30.00th=[ 243], 40.00th=[ 277], 50.00th=[ 310], 60.00th=[ 359], 00:11:04.331 | 70.00th=[ 416], 80.00th=[ 461], 90.00th=[ 506], 95.00th=[ 553], 00:11:04.331 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:11:04.331 | 99.99th=[41157] 00:11:04.331 write: IOPS=1014, BW=4059KiB/s (4157kB/s)(4096KiB/1009msec); 0 zone resets 00:11:04.331 slat (nsec): min=7813, max=62317, avg=11559.74, stdev=5493.51 00:11:04.331 clat (usec): min=131, max=1220, avg=226.07, stdev=70.46 00:11:04.331 lat (usec): min=142, max=1247, avg=237.63, stdev=71.77 00:11:04.331 clat percentiles (usec): 00:11:04.331 | 1.00th=[ 143], 5.00th=[ 155], 10.00th=[ 165], 20.00th=[ 184], 00:11:04.331 | 30.00th=[ 200], 40.00th=[ 208], 50.00th=[ 219], 60.00th=[ 229], 00:11:04.331 | 70.00th=[ 239], 80.00th=[ 253], 90.00th=[ 269], 95.00th=[ 318], 00:11:04.331 | 99.00th=[ 437], 99.50th=[ 523], 99.90th=[ 955], 99.95th=[ 1221], 00:11:04.331 | 99.99th=[ 1221] 00:11:04.331 bw ( KiB/s): min= 4096, max= 4096, per=14.12%, avg=4096.00, stdev= 0.00, samples=2 00:11:04.331 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:11:04.331 lat (usec) : 250=63.21%, 500=32.58%, 750=2.98%, 1000=0.19% 00:11:04.331 lat (msec) : 2=0.06%, 20=0.06%, 50=0.91% 00:11:04.331 cpu : usr=1.09%, sys=2.08%, ctx=1547, majf=0, minf=1 00:11:04.331 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:04.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.331 issued rwts: total=520,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:04.331 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:04.331 job1: (groupid=0, jobs=1): err= 0: pid=569188: Mon Oct 7 13:21:59 2024 00:11:04.331 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:11:04.331 slat (nsec): min=6146, max=34902, avg=8272.39, stdev=2728.64 00:11:04.331 clat (usec): min=177, max=41260, avg=258.01, stdev=907.57 00:11:04.331 lat (usec): min=183, max=41269, avg=266.28, stdev=907.61 00:11:04.331 clat percentiles (usec): 00:11:04.331 | 1.00th=[ 186], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 208], 00:11:04.331 | 30.00th=[ 215], 40.00th=[ 221], 50.00th=[ 229], 60.00th=[ 237], 00:11:04.331 | 70.00th=[ 245], 80.00th=[ 260], 90.00th=[ 285], 95.00th=[ 318], 00:11:04.331 | 99.00th=[ 412], 99.50th=[ 461], 99.90th=[ 635], 99.95th=[ 644], 00:11:04.331 | 99.99th=[41157] 00:11:04.331 write: IOPS=2352, BW=9411KiB/s (9636kB/s)(9420KiB/1001msec); 0 zone resets 00:11:04.331 slat (nsec): min=8060, max=50243, avg=11082.32, stdev=3830.96 00:11:04.331 clat (usec): min=135, max=298, avg=176.69, stdev=26.60 00:11:04.331 lat (usec): min=145, max=307, avg=187.77, stdev=27.09 00:11:04.331 clat percentiles (usec): 00:11:04.331 | 1.00th=[ 141], 5.00th=[ 147], 10.00th=[ 151], 20.00th=[ 157], 00:11:04.331 | 30.00th=[ 161], 40.00th=[ 165], 50.00th=[ 172], 60.00th=[ 178], 00:11:04.331 | 70.00th=[ 184], 80.00th=[ 192], 90.00th=[ 208], 95.00th=[ 227], 00:11:04.331 | 99.00th=[ 273], 99.50th=[ 285], 99.90th=[ 293], 99.95th=[ 297], 00:11:04.331 | 99.99th=[ 297] 00:11:04.331 bw ( KiB/s): min= 8432, max= 8432, per=29.07%, avg=8432.00, stdev= 0.00, samples=1 00:11:04.331 iops : min= 2108, max= 2108, avg=2108.00, stdev= 0.00, samples=1 00:11:04.331 lat (usec) : 250=86.19%, 500=13.67%, 750=0.11% 00:11:04.331 lat (msec) : 50=0.02% 00:11:04.331 cpu : usr=3.30%, sys=5.60%, ctx=4404, majf=0, minf=1 00:11:04.331 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:04.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.331 issued rwts: total=2048,2355,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:04.331 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:04.331 job2: (groupid=0, jobs=1): err= 0: pid=569189: Mon Oct 7 13:21:59 2024 00:11:04.331 read: IOPS=2112, BW=8452KiB/s (8654kB/s)(8460KiB/1001msec) 00:11:04.331 slat (nsec): min=6606, max=44672, avg=8912.62, stdev=2961.62 00:11:04.331 clat (usec): min=173, max=465, avg=222.73, stdev=25.57 00:11:04.331 lat (usec): min=180, max=495, avg=231.65, stdev=26.84 00:11:04.331 clat percentiles (usec): 00:11:04.331 | 1.00th=[ 184], 5.00th=[ 192], 10.00th=[ 196], 20.00th=[ 202], 00:11:04.331 | 30.00th=[ 208], 40.00th=[ 215], 50.00th=[ 219], 60.00th=[ 225], 00:11:04.331 | 70.00th=[ 233], 80.00th=[ 239], 90.00th=[ 251], 95.00th=[ 265], 00:11:04.331 | 99.00th=[ 310], 99.50th=[ 355], 99.90th=[ 416], 99.95th=[ 433], 00:11:04.331 | 99.99th=[ 465] 00:11:04.331 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:11:04.331 slat (nsec): min=7498, max=59565, avg=11403.01, stdev=3635.57 00:11:04.331 clat (usec): min=138, max=4434, avg=182.68, stdev=88.36 00:11:04.331 lat (usec): min=147, max=4446, avg=194.08, stdev=88.77 00:11:04.331 clat percentiles (usec): 00:11:04.331 | 1.00th=[ 145], 5.00th=[ 151], 10.00th=[ 155], 20.00th=[ 161], 00:11:04.331 | 30.00th=[ 165], 40.00th=[ 172], 50.00th=[ 178], 60.00th=[ 184], 00:11:04.331 | 70.00th=[ 190], 80.00th=[ 198], 90.00th=[ 210], 95.00th=[ 223], 00:11:04.331 | 99.00th=[ 273], 99.50th=[ 306], 99.90th=[ 469], 99.95th=[ 635], 00:11:04.331 | 99.99th=[ 4424] 00:11:04.331 bw ( KiB/s): min=10160, max=10160, per=35.03%, avg=10160.00, stdev= 0.00, samples=1 00:11:04.331 iops : min= 2540, max= 2540, avg=2540.00, stdev= 0.00, samples=1 00:11:04.331 lat (usec) : 250=94.33%, 500=5.63%, 750=0.02% 00:11:04.331 lat (msec) : 10=0.02% 00:11:04.331 cpu : usr=2.50%, sys=7.10%, ctx=4676, majf=0, minf=1 00:11:04.331 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:04.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.331 issued rwts: total=2115,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:04.331 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:04.331 job3: (groupid=0, jobs=1): err= 0: pid=569190: Mon Oct 7 13:21:59 2024 00:11:04.331 read: IOPS=1420, BW=5684KiB/s (5820kB/s)(5860KiB/1031msec) 00:11:04.331 slat (nsec): min=6392, max=44071, avg=8729.99, stdev=3201.98 00:11:04.331 clat (usec): min=203, max=41009, avg=452.05, stdev=2593.05 00:11:04.331 lat (usec): min=210, max=41021, avg=460.78, stdev=2593.20 00:11:04.331 clat percentiles (usec): 00:11:04.331 | 1.00th=[ 208], 5.00th=[ 219], 10.00th=[ 225], 20.00th=[ 233], 00:11:04.331 | 30.00th=[ 241], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 265], 00:11:04.331 | 70.00th=[ 281], 80.00th=[ 314], 90.00th=[ 445], 95.00th=[ 498], 00:11:04.331 | 99.00th=[ 611], 99.50th=[ 635], 99.90th=[41157], 99.95th=[41157], 00:11:04.331 | 99.99th=[41157] 00:11:04.331 write: IOPS=1489, BW=5959KiB/s (6102kB/s)(6144KiB/1031msec); 0 zone resets 00:11:04.331 slat (nsec): min=8377, max=55920, avg=11379.93, stdev=3707.69 00:11:04.331 clat (usec): min=143, max=1260, avg=214.32, stdev=60.05 00:11:04.332 lat (usec): min=152, max=1272, avg=225.70, stdev=60.41 00:11:04.332 clat percentiles (usec): 00:11:04.332 | 1.00th=[ 153], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 174], 00:11:04.332 | 30.00th=[ 186], 40.00th=[ 196], 50.00th=[ 206], 60.00th=[ 217], 00:11:04.332 | 70.00th=[ 227], 80.00th=[ 243], 90.00th=[ 260], 95.00th=[ 277], 00:11:04.332 | 99.00th=[ 412], 99.50th=[ 441], 99.90th=[ 930], 99.95th=[ 1254], 00:11:04.332 | 99.99th=[ 1254] 00:11:04.332 bw ( KiB/s): min= 4096, max= 8192, per=21.19%, avg=6144.00, stdev=2896.31, samples=2 00:11:04.332 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:11:04.332 lat (usec) : 250=64.75%, 500=32.82%, 750=2.13%, 1000=0.07% 00:11:04.332 lat (msec) : 2=0.03%, 50=0.20% 00:11:04.332 cpu : usr=1.94%, sys=4.08%, ctx=3002, majf=0, minf=2 00:11:04.332 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:04.332 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.332 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:04.332 issued rwts: total=1465,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:04.332 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:04.332 00:11:04.332 Run status group 0 (all jobs): 00:11:04.332 READ: bw=23.3MiB/s (24.4MB/s), 2061KiB/s-8452KiB/s (2111kB/s-8654kB/s), io=24.0MiB (25.2MB), run=1001-1031msec 00:11:04.332 WRITE: bw=28.3MiB/s (29.7MB/s), 4059KiB/s-9.99MiB/s (4157kB/s-10.5MB/s), io=29.2MiB (30.6MB), run=1001-1031msec 00:11:04.332 00:11:04.332 Disk stats (read/write): 00:11:04.332 nvme0n1: ios=566/1024, merge=0/0, ticks=610/226, in_queue=836, util=86.87% 00:11:04.332 nvme0n2: ios=1663/2048, merge=0/0, ticks=1306/356, in_queue=1662, util=89.74% 00:11:04.332 nvme0n3: ios=1996/2048, merge=0/0, ticks=560/374, in_queue=934, util=93.44% 00:11:04.332 nvme0n4: ios=1485/1536, merge=0/0, ticks=1329/326, in_queue=1655, util=94.12% 00:11:04.332 13:21:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:11:04.332 [global] 00:11:04.332 thread=1 00:11:04.332 invalidate=1 00:11:04.332 rw=randwrite 00:11:04.332 time_based=1 00:11:04.332 runtime=1 00:11:04.332 ioengine=libaio 00:11:04.332 direct=1 00:11:04.332 bs=4096 00:11:04.332 iodepth=1 00:11:04.332 norandommap=0 00:11:04.332 numjobs=1 00:11:04.332 00:11:04.332 verify_dump=1 00:11:04.332 verify_backlog=512 00:11:04.332 verify_state_save=0 00:11:04.332 do_verify=1 00:11:04.332 verify=crc32c-intel 00:11:04.332 [job0] 00:11:04.332 filename=/dev/nvme0n1 00:11:04.332 [job1] 00:11:04.332 filename=/dev/nvme0n2 00:11:04.332 [job2] 00:11:04.332 filename=/dev/nvme0n3 00:11:04.332 [job3] 00:11:04.332 filename=/dev/nvme0n4 00:11:04.332 Could not set queue depth (nvme0n1) 00:11:04.332 Could not set queue depth (nvme0n2) 00:11:04.332 Could not set queue depth (nvme0n3) 00:11:04.332 Could not set queue depth (nvme0n4) 00:11:04.332 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:04.332 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:04.332 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:04.332 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:04.332 fio-3.35 00:11:04.332 Starting 4 threads 00:11:05.710 00:11:05.711 job0: (groupid=0, jobs=1): err= 0: pid=569512: Mon Oct 7 13:22:01 2024 00:11:05.711 read: IOPS=1864, BW=7457KiB/s (7636kB/s)(7464KiB/1001msec) 00:11:05.711 slat (nsec): min=4895, max=62937, avg=11908.96, stdev=7697.55 00:11:05.711 clat (usec): min=169, max=579, avg=274.62, stdev=73.47 00:11:05.711 lat (usec): min=175, max=586, avg=286.53, stdev=76.69 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 182], 5.00th=[ 192], 10.00th=[ 200], 20.00th=[ 212], 00:11:05.711 | 30.00th=[ 227], 40.00th=[ 241], 50.00th=[ 255], 60.00th=[ 273], 00:11:05.711 | 70.00th=[ 289], 80.00th=[ 334], 90.00th=[ 396], 95.00th=[ 416], 00:11:05.711 | 99.00th=[ 494], 99.50th=[ 515], 99.90th=[ 570], 99.95th=[ 578], 00:11:05.711 | 99.99th=[ 578] 00:11:05.711 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:11:05.711 slat (nsec): min=7141, max=52395, avg=13645.66, stdev=5952.19 00:11:05.711 clat (usec): min=127, max=582, avg=206.21, stdev=49.53 00:11:05.711 lat (usec): min=135, max=605, avg=219.86, stdev=50.11 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 137], 5.00th=[ 143], 10.00th=[ 149], 20.00th=[ 165], 00:11:05.711 | 30.00th=[ 176], 40.00th=[ 186], 50.00th=[ 196], 60.00th=[ 215], 00:11:05.711 | 70.00th=[ 237], 80.00th=[ 245], 90.00th=[ 265], 95.00th=[ 293], 00:11:05.711 | 99.00th=[ 371], 99.50th=[ 408], 99.90th=[ 478], 99.95th=[ 490], 00:11:05.711 | 99.99th=[ 586] 00:11:05.711 bw ( KiB/s): min= 8192, max= 8192, per=59.37%, avg=8192.00, stdev= 0.00, samples=1 00:11:05.711 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:11:05.711 lat (usec) : 250=65.89%, 500=33.65%, 750=0.46% 00:11:05.711 cpu : usr=3.80%, sys=5.70%, ctx=3914, majf=0, minf=2 00:11:05.711 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:05.711 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 issued rwts: total=1866,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:05.711 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:05.711 job1: (groupid=0, jobs=1): err= 0: pid=569531: Mon Oct 7 13:22:01 2024 00:11:05.711 read: IOPS=21, BW=87.1KiB/s (89.2kB/s)(88.0KiB/1010msec) 00:11:05.711 slat (nsec): min=7514, max=15323, avg=13608.14, stdev=1882.36 00:11:05.711 clat (usec): min=225, max=41956, avg=39143.53, stdev=8695.85 00:11:05.711 lat (usec): min=239, max=41970, avg=39157.14, stdev=8695.73 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 225], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:11:05.711 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:11:05.711 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:11:05.711 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:11:05.711 | 99.99th=[42206] 00:11:05.711 write: IOPS=506, BW=2028KiB/s (2076kB/s)(2048KiB/1010msec); 0 zone resets 00:11:05.711 slat (usec): min=7, max=35076, avg=78.24, stdev=1549.74 00:11:05.711 clat (usec): min=129, max=472, avg=207.59, stdev=44.96 00:11:05.711 lat (usec): min=137, max=35263, avg=285.83, stdev=1549.50 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 141], 5.00th=[ 151], 10.00th=[ 163], 20.00th=[ 176], 00:11:05.711 | 30.00th=[ 188], 40.00th=[ 196], 50.00th=[ 204], 60.00th=[ 212], 00:11:05.711 | 70.00th=[ 219], 80.00th=[ 233], 90.00th=[ 245], 95.00th=[ 262], 00:11:05.711 | 99.00th=[ 400], 99.50th=[ 420], 99.90th=[ 474], 99.95th=[ 474], 00:11:05.711 | 99.99th=[ 474] 00:11:05.711 bw ( KiB/s): min= 4096, max= 4096, per=29.69%, avg=4096.00, stdev= 0.00, samples=1 00:11:05.711 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:11:05.711 lat (usec) : 250=89.14%, 500=6.93% 00:11:05.711 lat (msec) : 50=3.93% 00:11:05.711 cpu : usr=0.69%, sys=0.30%, ctx=536, majf=0, minf=1 00:11:05.711 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:05.711 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:05.711 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:05.711 job2: (groupid=0, jobs=1): err= 0: pid=569536: Mon Oct 7 13:22:01 2024 00:11:05.711 read: IOPS=23, BW=92.4KiB/s (94.6kB/s)(96.0KiB/1039msec) 00:11:05.711 slat (nsec): min=15350, max=34106, avg=21538.54, stdev=8090.71 00:11:05.711 clat (usec): min=303, max=42088, avg=37666.72, stdev=11510.15 00:11:05.711 lat (usec): min=322, max=42106, avg=37688.26, stdev=11511.16 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 306], 5.00th=[ 334], 10.00th=[40633], 20.00th=[40633], 00:11:05.711 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:11:05.711 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:11:05.711 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:11:05.711 | 99.99th=[42206] 00:11:05.711 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:11:05.711 slat (nsec): min=7362, max=45309, avg=13570.75, stdev=6131.10 00:11:05.711 clat (usec): min=147, max=693, avg=244.71, stdev=45.49 00:11:05.711 lat (usec): min=157, max=713, avg=258.28, stdev=45.76 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 167], 5.00th=[ 188], 10.00th=[ 206], 20.00th=[ 217], 00:11:05.711 | 30.00th=[ 225], 40.00th=[ 233], 50.00th=[ 239], 60.00th=[ 245], 00:11:05.711 | 70.00th=[ 255], 80.00th=[ 269], 90.00th=[ 289], 95.00th=[ 310], 00:11:05.711 | 99.00th=[ 416], 99.50th=[ 478], 99.90th=[ 693], 99.95th=[ 693], 00:11:05.711 | 99.99th=[ 693] 00:11:05.711 bw ( KiB/s): min= 4096, max= 4096, per=29.69%, avg=4096.00, stdev= 0.00, samples=1 00:11:05.711 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:11:05.711 lat (usec) : 250=62.13%, 500=33.40%, 750=0.37% 00:11:05.711 lat (msec) : 50=4.10% 00:11:05.711 cpu : usr=0.48%, sys=0.48%, ctx=536, majf=0, minf=1 00:11:05.711 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:05.711 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:05.711 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:05.711 job3: (groupid=0, jobs=1): err= 0: pid=569537: Mon Oct 7 13:22:01 2024 00:11:05.711 read: IOPS=242, BW=971KiB/s (994kB/s)(972KiB/1001msec) 00:11:05.711 slat (nsec): min=7714, max=42604, avg=10051.59, stdev=5004.52 00:11:05.711 clat (usec): min=237, max=41118, avg=3648.87, stdev=11192.44 00:11:05.711 lat (usec): min=246, max=41133, avg=3658.92, stdev=11195.60 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 253], 5.00th=[ 265], 10.00th=[ 273], 20.00th=[ 281], 00:11:05.711 | 30.00th=[ 289], 40.00th=[ 293], 50.00th=[ 302], 60.00th=[ 306], 00:11:05.711 | 70.00th=[ 314], 80.00th=[ 326], 90.00th=[ 412], 95.00th=[41157], 00:11:05.711 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:11:05.711 | 99.99th=[41157] 00:11:05.711 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:11:05.711 slat (nsec): min=8722, max=42194, avg=15353.35, stdev=7536.28 00:11:05.711 clat (usec): min=142, max=374, avg=195.88, stdev=28.99 00:11:05.711 lat (usec): min=151, max=394, avg=211.24, stdev=33.32 00:11:05.711 clat percentiles (usec): 00:11:05.711 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 169], 00:11:05.711 | 30.00th=[ 178], 40.00th=[ 184], 50.00th=[ 190], 60.00th=[ 200], 00:11:05.711 | 70.00th=[ 212], 80.00th=[ 223], 90.00th=[ 235], 95.00th=[ 247], 00:11:05.711 | 99.00th=[ 269], 99.50th=[ 277], 99.90th=[ 375], 99.95th=[ 375], 00:11:05.711 | 99.99th=[ 375] 00:11:05.711 bw ( KiB/s): min= 4096, max= 4096, per=29.69%, avg=4096.00, stdev= 0.00, samples=1 00:11:05.711 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:11:05.711 lat (usec) : 250=65.43%, 500=31.79%, 1000=0.13% 00:11:05.711 lat (msec) : 50=2.65% 00:11:05.711 cpu : usr=0.80%, sys=1.20%, ctx=755, majf=0, minf=2 00:11:05.711 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:05.711 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:05.711 issued rwts: total=243,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:05.711 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:05.711 00:11:05.711 Run status group 0 (all jobs): 00:11:05.711 READ: bw=8296KiB/s (8496kB/s), 87.1KiB/s-7457KiB/s (89.2kB/s-7636kB/s), io=8620KiB (8827kB), run=1001-1039msec 00:11:05.711 WRITE: bw=13.5MiB/s (14.1MB/s), 1971KiB/s-8184KiB/s (2018kB/s-8380kB/s), io=14.0MiB (14.7MB), run=1001-1039msec 00:11:05.711 00:11:05.711 Disk stats (read/write): 00:11:05.711 nvme0n1: ios=1586/1755, merge=0/0, ticks=436/374, in_queue=810, util=86.77% 00:11:05.711 nvme0n2: ios=59/512, merge=0/0, ticks=1129/95, in_queue=1224, util=94.51% 00:11:05.711 nvme0n3: ios=65/512, merge=0/0, ticks=811/126, in_queue=937, util=95.52% 00:11:05.711 nvme0n4: ios=75/512, merge=0/0, ticks=818/100, in_queue=918, util=95.16% 00:11:05.711 13:22:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:11:05.711 [global] 00:11:05.711 thread=1 00:11:05.711 invalidate=1 00:11:05.711 rw=write 00:11:05.711 time_based=1 00:11:05.711 runtime=1 00:11:05.711 ioengine=libaio 00:11:05.711 direct=1 00:11:05.711 bs=4096 00:11:05.711 iodepth=128 00:11:05.711 norandommap=0 00:11:05.711 numjobs=1 00:11:05.711 00:11:05.711 verify_dump=1 00:11:05.711 verify_backlog=512 00:11:05.711 verify_state_save=0 00:11:05.711 do_verify=1 00:11:05.711 verify=crc32c-intel 00:11:05.711 [job0] 00:11:05.711 filename=/dev/nvme0n1 00:11:05.711 [job1] 00:11:05.711 filename=/dev/nvme0n2 00:11:05.711 [job2] 00:11:05.711 filename=/dev/nvme0n3 00:11:05.711 [job3] 00:11:05.711 filename=/dev/nvme0n4 00:11:05.711 Could not set queue depth (nvme0n1) 00:11:05.711 Could not set queue depth (nvme0n2) 00:11:05.711 Could not set queue depth (nvme0n3) 00:11:05.711 Could not set queue depth (nvme0n4) 00:11:05.969 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:05.969 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:05.969 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:05.969 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:05.969 fio-3.35 00:11:05.969 Starting 4 threads 00:11:07.342 00:11:07.342 job0: (groupid=0, jobs=1): err= 0: pid=569771: Mon Oct 7 13:22:02 2024 00:11:07.342 read: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec) 00:11:07.342 slat (usec): min=3, max=18053, avg=126.27, stdev=832.31 00:11:07.342 clat (usec): min=6592, max=61643, avg=15736.81, stdev=8727.45 00:11:07.342 lat (usec): min=7111, max=61651, avg=15863.08, stdev=8795.20 00:11:07.342 clat percentiles (usec): 00:11:07.342 | 1.00th=[ 7373], 5.00th=[ 9241], 10.00th=[ 9896], 20.00th=[10421], 00:11:07.342 | 30.00th=[10683], 40.00th=[10945], 50.00th=[11338], 60.00th=[12911], 00:11:07.342 | 70.00th=[18482], 80.00th=[21365], 90.00th=[22676], 95.00th=[31589], 00:11:07.342 | 99.00th=[50070], 99.50th=[55313], 99.90th=[61604], 99.95th=[61604], 00:11:07.342 | 99.99th=[61604] 00:11:07.342 write: IOPS=4172, BW=16.3MiB/s (17.1MB/s)(16.4MiB/1005msec); 0 zone resets 00:11:07.342 slat (usec): min=4, max=13053, avg=106.58, stdev=630.97 00:11:07.342 clat (usec): min=756, max=60355, avg=14868.20, stdev=8302.83 00:11:07.342 lat (usec): min=5179, max=60363, avg=14974.78, stdev=8322.51 00:11:07.342 clat percentiles (usec): 00:11:07.342 | 1.00th=[ 5800], 5.00th=[ 8848], 10.00th=[10159], 20.00th=[10814], 00:11:07.342 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11600], 60.00th=[13435], 00:11:07.342 | 70.00th=[15926], 80.00th=[16581], 90.00th=[18744], 95.00th=[32637], 00:11:07.342 | 99.00th=[56361], 99.50th=[56886], 99.90th=[60556], 99.95th=[60556], 00:11:07.342 | 99.99th=[60556] 00:11:07.342 bw ( KiB/s): min=12288, max=20496, per=25.31%, avg=16392.00, stdev=5803.93, samples=2 00:11:07.342 iops : min= 3072, max= 5124, avg=4098.00, stdev=1450.98, samples=2 00:11:07.342 lat (usec) : 1000=0.01% 00:11:07.342 lat (msec) : 10=9.82%, 20=73.13%, 50=15.53%, 100=1.51% 00:11:07.342 cpu : usr=4.28%, sys=8.17%, ctx=330, majf=0, minf=1 00:11:07.342 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:11:07.342 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:07.342 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:07.342 issued rwts: total=4096,4193,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:07.342 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:07.342 job1: (groupid=0, jobs=1): err= 0: pid=569772: Mon Oct 7 13:22:02 2024 00:11:07.342 read: IOPS=3548, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1010msec) 00:11:07.342 slat (usec): min=3, max=13705, avg=119.94, stdev=814.67 00:11:07.342 clat (usec): min=4778, max=42811, avg=14266.13, stdev=5838.07 00:11:07.342 lat (usec): min=4799, max=42817, avg=14386.07, stdev=5897.80 00:11:07.342 clat percentiles (usec): 00:11:07.342 | 1.00th=[ 7111], 5.00th=[10159], 10.00th=[10290], 20.00th=[10683], 00:11:07.342 | 30.00th=[11469], 40.00th=[11731], 50.00th=[12387], 60.00th=[13304], 00:11:07.342 | 70.00th=[13698], 80.00th=[15926], 90.00th=[20579], 95.00th=[29754], 00:11:07.342 | 99.00th=[37487], 99.50th=[38536], 99.90th=[42730], 99.95th=[42730], 00:11:07.342 | 99.99th=[42730] 00:11:07.342 write: IOPS=3982, BW=15.6MiB/s (16.3MB/s)(15.7MiB/1010msec); 0 zone resets 00:11:07.342 slat (usec): min=4, max=10063, avg=133.13, stdev=617.51 00:11:07.342 clat (usec): min=3081, max=42807, avg=19109.70, stdev=8689.51 00:11:07.342 lat (usec): min=3089, max=42821, avg=19242.83, stdev=8751.10 00:11:07.342 clat percentiles (usec): 00:11:07.342 | 1.00th=[ 5997], 5.00th=[ 9110], 10.00th=[ 9634], 20.00th=[10683], 00:11:07.342 | 30.00th=[11207], 40.00th=[12256], 50.00th=[18744], 60.00th=[22414], 00:11:07.342 | 70.00th=[23462], 80.00th=[27657], 90.00th=[32375], 95.00th=[34866], 00:11:07.342 | 99.00th=[35390], 99.50th=[35390], 99.90th=[38011], 99.95th=[38536], 00:11:07.342 | 99.99th=[42730] 00:11:07.342 bw ( KiB/s): min=15246, max=15944, per=24.08%, avg=15595.00, stdev=493.56, samples=2 00:11:07.342 iops : min= 3811, max= 3986, avg=3898.50, stdev=123.74, samples=2 00:11:07.342 lat (msec) : 4=0.24%, 10=7.80%, 20=61.39%, 50=30.58% 00:11:07.342 cpu : usr=4.06%, sys=7.43%, ctx=428, majf=0, minf=2 00:11:07.342 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:11:07.342 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:07.342 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:07.342 issued rwts: total=3584,4022,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:07.342 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:07.342 job2: (groupid=0, jobs=1): err= 0: pid=569774: Mon Oct 7 13:22:02 2024 00:11:07.342 read: IOPS=3062, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1003msec) 00:11:07.342 slat (usec): min=2, max=67152, avg=185.93, stdev=1898.06 00:11:07.342 clat (msec): min=9, max=174, avg=24.10, stdev=29.51 00:11:07.342 lat (msec): min=10, max=174, avg=24.29, stdev=29.66 00:11:07.342 clat percentiles (msec): 00:11:07.342 | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 13], 00:11:07.342 | 30.00th=[ 14], 40.00th=[ 14], 50.00th=[ 14], 60.00th=[ 14], 00:11:07.342 | 70.00th=[ 15], 80.00th=[ 24], 90.00th=[ 45], 95.00th=[ 77], 00:11:07.342 | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], 00:11:07.342 | 99.99th=[ 176] 00:11:07.342 write: IOPS=3095, BW=12.1MiB/s (12.7MB/s)(12.1MiB/1003msec); 0 zone resets 00:11:07.342 slat (usec): min=3, max=20682, avg=131.12, stdev=831.59 00:11:07.342 clat (usec): min=1666, max=62890, avg=16132.84, stdev=9250.09 00:11:07.342 lat (usec): min=5274, max=62906, avg=16263.96, stdev=9299.53 00:11:07.342 clat percentiles (usec): 00:11:07.342 | 1.00th=[ 5932], 5.00th=[10552], 10.00th=[11207], 20.00th=[12780], 00:11:07.342 | 30.00th=[13042], 40.00th=[13173], 50.00th=[13304], 60.00th=[13698], 00:11:07.342 | 70.00th=[14091], 80.00th=[17433], 90.00th=[18482], 95.00th=[39584], 00:11:07.342 | 99.00th=[62653], 99.50th=[62653], 99.90th=[62653], 99.95th=[62653], 00:11:07.342 | 99.99th=[62653] 00:11:07.342 bw ( KiB/s): min= 8192, max=16384, per=18.97%, avg=12288.00, stdev=5792.62, samples=2 00:11:07.343 iops : min= 2048, max= 4096, avg=3072.00, stdev=1448.15, samples=2 00:11:07.343 lat (msec) : 2=0.02%, 10=0.83%, 20=81.74%, 50=11.24%, 100=4.13% 00:11:07.343 lat (msec) : 250=2.06% 00:11:07.343 cpu : usr=1.70%, sys=5.39%, ctx=322, majf=0, minf=1 00:11:07.343 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:11:07.343 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:07.343 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:07.343 issued rwts: total=3072,3105,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:07.343 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:07.343 job3: (groupid=0, jobs=1): err= 0: pid=569775: Mon Oct 7 13:22:02 2024 00:11:07.343 read: IOPS=4585, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1005msec) 00:11:07.343 slat (usec): min=3, max=5751, avg=98.99, stdev=516.84 00:11:07.343 clat (usec): min=7933, max=20749, avg=12473.81, stdev=1752.19 00:11:07.343 lat (usec): min=7973, max=20765, avg=12572.80, stdev=1796.87 00:11:07.343 clat percentiles (usec): 00:11:07.343 | 1.00th=[ 8717], 5.00th=[ 9765], 10.00th=[10552], 20.00th=[11469], 00:11:07.343 | 30.00th=[11994], 40.00th=[12125], 50.00th=[12256], 60.00th=[12387], 00:11:07.343 | 70.00th=[12518], 80.00th=[13042], 90.00th=[14877], 95.00th=[15926], 00:11:07.343 | 99.00th=[17957], 99.50th=[19530], 99.90th=[20317], 99.95th=[20841], 00:11:07.343 | 99.99th=[20841] 00:11:07.343 write: IOPS=5008, BW=19.6MiB/s (20.5MB/s)(19.7MiB/1005msec); 0 zone resets 00:11:07.343 slat (usec): min=4, max=5714, avg=99.96, stdev=427.72 00:11:07.343 clat (usec): min=579, max=36631, avg=13833.88, stdev=4829.30 00:11:07.343 lat (usec): min=6293, max=36641, avg=13933.84, stdev=4863.28 00:11:07.343 clat percentiles (usec): 00:11:07.343 | 1.00th=[ 7046], 5.00th=[10159], 10.00th=[11207], 20.00th=[11863], 00:11:07.343 | 30.00th=[12125], 40.00th=[12518], 50.00th=[12780], 60.00th=[13042], 00:11:07.343 | 70.00th=[13173], 80.00th=[13566], 90.00th=[17171], 95.00th=[25560], 00:11:07.343 | 99.00th=[36439], 99.50th=[36439], 99.90th=[36439], 99.95th=[36439], 00:11:07.343 | 99.99th=[36439] 00:11:07.343 bw ( KiB/s): min=18808, max=20440, per=30.30%, avg=19624.00, stdev=1154.00, samples=2 00:11:07.343 iops : min= 4702, max= 5110, avg=4906.00, stdev=288.50, samples=2 00:11:07.343 lat (usec) : 750=0.01% 00:11:07.343 lat (msec) : 10=5.39%, 20=91.25%, 50=3.35% 00:11:07.343 cpu : usr=4.68%, sys=10.56%, ctx=614, majf=0, minf=2 00:11:07.343 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:11:07.343 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:07.343 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:07.343 issued rwts: total=4608,5034,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:07.343 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:07.343 00:11:07.343 Run status group 0 (all jobs): 00:11:07.343 READ: bw=59.4MiB/s (62.3MB/s), 12.0MiB/s-17.9MiB/s (12.5MB/s-18.8MB/s), io=60.0MiB (62.9MB), run=1003-1010msec 00:11:07.343 WRITE: bw=63.2MiB/s (66.3MB/s), 12.1MiB/s-19.6MiB/s (12.7MB/s-20.5MB/s), io=63.9MiB (67.0MB), run=1003-1010msec 00:11:07.343 00:11:07.343 Disk stats (read/write): 00:11:07.343 nvme0n1: ios=3098/3381, merge=0/0, ticks=19679/15952, in_queue=35631, util=98.00% 00:11:07.343 nvme0n2: ios=3122/3391, merge=0/0, ticks=42595/60908, in_queue=103503, util=97.97% 00:11:07.343 nvme0n3: ios=2587/2944, merge=0/0, ticks=15407/11986, in_queue=27393, util=97.39% 00:11:07.343 nvme0n4: ios=3917/4096, merge=0/0, ticks=24587/27408, in_queue=51995, util=89.70% 00:11:07.343 13:22:02 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:11:07.343 [global] 00:11:07.343 thread=1 00:11:07.343 invalidate=1 00:11:07.343 rw=randwrite 00:11:07.343 time_based=1 00:11:07.343 runtime=1 00:11:07.343 ioengine=libaio 00:11:07.343 direct=1 00:11:07.343 bs=4096 00:11:07.343 iodepth=128 00:11:07.343 norandommap=0 00:11:07.343 numjobs=1 00:11:07.343 00:11:07.343 verify_dump=1 00:11:07.343 verify_backlog=512 00:11:07.343 verify_state_save=0 00:11:07.343 do_verify=1 00:11:07.343 verify=crc32c-intel 00:11:07.343 [job0] 00:11:07.343 filename=/dev/nvme0n1 00:11:07.343 [job1] 00:11:07.343 filename=/dev/nvme0n2 00:11:07.343 [job2] 00:11:07.343 filename=/dev/nvme0n3 00:11:07.343 [job3] 00:11:07.343 filename=/dev/nvme0n4 00:11:07.343 Could not set queue depth (nvme0n1) 00:11:07.343 Could not set queue depth (nvme0n2) 00:11:07.343 Could not set queue depth (nvme0n3) 00:11:07.343 Could not set queue depth (nvme0n4) 00:11:07.343 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:07.343 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:07.343 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:07.343 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:07.343 fio-3.35 00:11:07.343 Starting 4 threads 00:11:08.717 00:11:08.717 job0: (groupid=0, jobs=1): err= 0: pid=570001: Mon Oct 7 13:22:04 2024 00:11:08.717 read: IOPS=3326, BW=13.0MiB/s (13.6MB/s)(13.1MiB/1007msec) 00:11:08.717 slat (usec): min=3, max=5472, avg=93.36, stdev=493.19 00:11:08.717 clat (usec): min=6222, max=20136, avg=11877.90, stdev=1951.79 00:11:08.717 lat (usec): min=6236, max=20155, avg=11971.26, stdev=1992.76 00:11:08.717 clat percentiles (usec): 00:11:08.717 | 1.00th=[ 6783], 5.00th=[ 8455], 10.00th=[ 9765], 20.00th=[10945], 00:11:08.717 | 30.00th=[11207], 40.00th=[11600], 50.00th=[11994], 60.00th=[12125], 00:11:08.717 | 70.00th=[12518], 80.00th=[12911], 90.00th=[13698], 95.00th=[14877], 00:11:08.717 | 99.00th=[18482], 99.50th=[19268], 99.90th=[20055], 99.95th=[20055], 00:11:08.717 | 99.99th=[20055] 00:11:08.717 write: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1007msec); 0 zone resets 00:11:08.717 slat (usec): min=4, max=11517, avg=179.37, stdev=891.67 00:11:08.717 clat (msec): min=6, max=107, avg=24.42, stdev=22.55 00:11:08.717 lat (msec): min=6, max=107, avg=24.60, stdev=22.68 00:11:08.717 clat percentiles (msec): 00:11:08.717 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 11], 20.00th=[ 12], 00:11:08.717 | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 18], 00:11:08.717 | 70.00th=[ 20], 80.00th=[ 37], 90.00th=[ 59], 95.00th=[ 84], 00:11:08.717 | 99.00th=[ 100], 99.50th=[ 103], 99.90th=[ 108], 99.95th=[ 108], 00:11:08.717 | 99.99th=[ 108] 00:11:08.717 bw ( KiB/s): min=11920, max=16504, per=23.32%, avg=14212.00, stdev=3241.38, samples=2 00:11:08.717 iops : min= 2980, max= 4126, avg=3553.00, stdev=810.34, samples=2 00:11:08.717 lat (msec) : 10=10.11%, 20=75.08%, 50=8.21%, 100=6.17%, 250=0.43% 00:11:08.717 cpu : usr=4.47%, sys=8.15%, ctx=352, majf=0, minf=1 00:11:08.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:11:08.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:08.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:08.717 issued rwts: total=3350,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:08.717 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:08.717 job1: (groupid=0, jobs=1): err= 0: pid=570002: Mon Oct 7 13:22:04 2024 00:11:08.717 read: IOPS=4312, BW=16.8MiB/s (17.7MB/s)(17.0MiB/1008msec) 00:11:08.717 slat (usec): min=2, max=20662, avg=96.95, stdev=762.90 00:11:08.717 clat (usec): min=1399, max=44120, avg=13160.10, stdev=4604.30 00:11:08.717 lat (usec): min=3938, max=44135, avg=13257.05, stdev=4659.70 00:11:08.717 clat percentiles (usec): 00:11:08.717 | 1.00th=[ 5538], 5.00th=[ 7439], 10.00th=[ 9241], 20.00th=[10028], 00:11:08.717 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11994], 60.00th=[13566], 00:11:08.717 | 70.00th=[14222], 80.00th=[16188], 90.00th=[18482], 95.00th=[23462], 00:11:08.717 | 99.00th=[32637], 99.50th=[32637], 99.90th=[32637], 99.95th=[32637], 00:11:08.717 | 99.99th=[44303] 00:11:08.717 write: IOPS=4571, BW=17.9MiB/s (18.7MB/s)(18.0MiB/1008msec); 0 zone resets 00:11:08.717 slat (usec): min=3, max=20675, avg=108.80, stdev=713.75 00:11:08.717 clat (usec): min=1209, max=43079, avg=15317.01, stdev=8167.15 00:11:08.717 lat (usec): min=1216, max=43091, avg=15425.81, stdev=8237.22 00:11:08.717 clat percentiles (usec): 00:11:08.717 | 1.00th=[ 3097], 5.00th=[ 6259], 10.00th=[ 7898], 20.00th=[ 9503], 00:11:08.717 | 30.00th=[10159], 40.00th=[11207], 50.00th=[11863], 60.00th=[12518], 00:11:08.717 | 70.00th=[18744], 80.00th=[22414], 90.00th=[29230], 95.00th=[32637], 00:11:08.717 | 99.00th=[35914], 99.50th=[36439], 99.90th=[38011], 99.95th=[38011], 00:11:08.717 | 99.99th=[43254] 00:11:08.717 bw ( KiB/s): min=17688, max=19176, per=30.24%, avg=18432.00, stdev=1052.17, samples=2 00:11:08.717 iops : min= 4422, max= 4794, avg=4608.00, stdev=263.04, samples=2 00:11:08.717 lat (msec) : 2=0.22%, 4=0.86%, 10=21.73%, 20=60.29%, 50=16.90% 00:11:08.717 cpu : usr=4.67%, sys=8.54%, ctx=357, majf=0, minf=1 00:11:08.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:11:08.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:08.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:08.717 issued rwts: total=4347,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:08.717 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:08.717 job2: (groupid=0, jobs=1): err= 0: pid=570003: Mon Oct 7 13:22:04 2024 00:11:08.717 read: IOPS=2941, BW=11.5MiB/s (12.0MB/s)(11.5MiB/1004msec) 00:11:08.717 slat (usec): min=2, max=12651, avg=139.50, stdev=827.84 00:11:08.717 clat (usec): min=949, max=48256, avg=18128.34, stdev=7599.64 00:11:08.717 lat (usec): min=6061, max=52382, avg=18267.84, stdev=7641.94 00:11:08.717 clat percentiles (usec): 00:11:08.717 | 1.00th=[ 6783], 5.00th=[10290], 10.00th=[12125], 20.00th=[12649], 00:11:08.717 | 30.00th=[13435], 40.00th=[14222], 50.00th=[15139], 60.00th=[17957], 00:11:08.717 | 70.00th=[20055], 80.00th=[22676], 90.00th=[28967], 95.00th=[32900], 00:11:08.717 | 99.00th=[47973], 99.50th=[47973], 99.90th=[48497], 99.95th=[48497], 00:11:08.717 | 99.99th=[48497] 00:11:08.717 write: IOPS=3059, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1004msec); 0 zone resets 00:11:08.717 slat (usec): min=3, max=17723, avg=177.60, stdev=954.91 00:11:08.717 clat (usec): min=4640, max=62623, avg=24015.70, stdev=13330.04 00:11:08.717 lat (usec): min=4645, max=62632, avg=24193.31, stdev=13428.49 00:11:08.717 clat percentiles (usec): 00:11:08.717 | 1.00th=[ 7832], 5.00th=[ 9634], 10.00th=[11207], 20.00th=[12387], 00:11:08.717 | 30.00th=[13173], 40.00th=[16188], 50.00th=[21103], 60.00th=[22676], 00:11:08.717 | 70.00th=[28443], 80.00th=[38011], 90.00th=[45876], 95.00th=[49546], 00:11:08.717 | 99.00th=[56361], 99.50th=[57934], 99.90th=[62653], 99.95th=[62653], 00:11:08.717 | 99.99th=[62653] 00:11:08.717 bw ( KiB/s): min=12288, max=12288, per=20.16%, avg=12288.00, stdev= 0.00, samples=2 00:11:08.717 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:11:08.717 lat (usec) : 1000=0.02% 00:11:08.717 lat (msec) : 10=6.21%, 20=51.17%, 50=40.60%, 100=2.01% 00:11:08.718 cpu : usr=4.69%, sys=6.98%, ctx=319, majf=0, minf=1 00:11:08.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:11:08.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:08.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:08.718 issued rwts: total=2953,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:08.718 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:08.718 job3: (groupid=0, jobs=1): err= 0: pid=570004: Mon Oct 7 13:22:04 2024 00:11:08.718 read: IOPS=3995, BW=15.6MiB/s (16.4MB/s)(15.7MiB/1005msec) 00:11:08.718 slat (usec): min=2, max=9815, avg=110.60, stdev=642.59 00:11:08.718 clat (usec): min=1480, max=45598, avg=14951.76, stdev=4272.58 00:11:08.718 lat (usec): min=5669, max=51511, avg=15062.36, stdev=4304.67 00:11:08.718 clat percentiles (usec): 00:11:08.718 | 1.00th=[ 6915], 5.00th=[10028], 10.00th=[11600], 20.00th=[12649], 00:11:08.718 | 30.00th=[13042], 40.00th=[13698], 50.00th=[14091], 60.00th=[14353], 00:11:08.718 | 70.00th=[15008], 80.00th=[16909], 90.00th=[19530], 95.00th=[23200], 00:11:08.718 | 99.00th=[25297], 99.50th=[43254], 99.90th=[45351], 99.95th=[45351], 00:11:08.718 | 99.99th=[45351] 00:11:08.718 write: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec); 0 zone resets 00:11:08.718 slat (usec): min=3, max=19734, avg=128.03, stdev=755.96 00:11:08.718 clat (usec): min=7353, max=46877, avg=16296.45, stdev=6621.41 00:11:08.718 lat (usec): min=7364, max=46892, avg=16424.48, stdev=6666.05 00:11:08.718 clat percentiles (usec): 00:11:08.718 | 1.00th=[ 9765], 5.00th=[12256], 10.00th=[12387], 20.00th=[12649], 00:11:08.718 | 30.00th=[12911], 40.00th=[13173], 50.00th=[13566], 60.00th=[14484], 00:11:08.718 | 70.00th=[15795], 80.00th=[19006], 90.00th=[21365], 95.00th=[33817], 00:11:08.718 | 99.00th=[43254], 99.50th=[44303], 99.90th=[46924], 99.95th=[46924], 00:11:08.718 | 99.99th=[46924] 00:11:08.718 bw ( KiB/s): min=15160, max=17643, per=26.91%, avg=16401.50, stdev=1755.75, samples=2 00:11:08.718 iops : min= 3790, max= 4410, avg=4100.00, stdev=438.41, samples=2 00:11:08.718 lat (msec) : 2=0.01%, 10=2.93%, 20=83.97%, 50=13.08% 00:11:08.718 cpu : usr=4.38%, sys=6.57%, ctx=301, majf=0, minf=1 00:11:08.718 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:11:08.718 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:08.718 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:08.718 issued rwts: total=4015,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:08.718 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:08.718 00:11:08.718 Run status group 0 (all jobs): 00:11:08.718 READ: bw=56.8MiB/s (59.6MB/s), 11.5MiB/s-16.8MiB/s (12.0MB/s-17.7MB/s), io=57.3MiB (60.1MB), run=1004-1008msec 00:11:08.718 WRITE: bw=59.5MiB/s (62.4MB/s), 12.0MiB/s-17.9MiB/s (12.5MB/s-18.7MB/s), io=60.0MiB (62.9MB), run=1004-1008msec 00:11:08.718 00:11:08.718 Disk stats (read/write): 00:11:08.718 nvme0n1: ios=2984/3072, merge=0/0, ticks=18301/34322, in_queue=52623, util=98.20% 00:11:08.718 nvme0n2: ios=3621/3927, merge=0/0, ticks=42250/54899, in_queue=97149, util=97.97% 00:11:08.718 nvme0n3: ios=2091/2560, merge=0/0, ticks=22571/38407, in_queue=60978, util=96.77% 00:11:08.718 nvme0n4: ios=3462/3584, merge=0/0, ticks=20127/22442, in_queue=42569, util=97.06% 00:11:08.718 13:22:04 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@55 -- # sync 00:11:08.718 13:22:04 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@59 -- # fio_pid=570140 00:11:08.718 13:22:04 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:11:08.718 13:22:04 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@61 -- # sleep 3 00:11:08.718 [global] 00:11:08.718 thread=1 00:11:08.718 invalidate=1 00:11:08.718 rw=read 00:11:08.718 time_based=1 00:11:08.718 runtime=10 00:11:08.718 ioengine=libaio 00:11:08.718 direct=1 00:11:08.718 bs=4096 00:11:08.718 iodepth=1 00:11:08.718 norandommap=1 00:11:08.718 numjobs=1 00:11:08.718 00:11:08.718 [job0] 00:11:08.718 filename=/dev/nvme0n1 00:11:08.718 [job1] 00:11:08.718 filename=/dev/nvme0n2 00:11:08.718 [job2] 00:11:08.718 filename=/dev/nvme0n3 00:11:08.718 [job3] 00:11:08.718 filename=/dev/nvme0n4 00:11:08.718 Could not set queue depth (nvme0n1) 00:11:08.718 Could not set queue depth (nvme0n2) 00:11:08.718 Could not set queue depth (nvme0n3) 00:11:08.718 Could not set queue depth (nvme0n4) 00:11:08.718 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:08.718 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:08.718 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:08.718 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:08.718 fio-3.35 00:11:08.718 Starting 4 threads 00:11:12.003 13:22:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:11:12.003 13:22:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:11:12.003 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=28672000, buflen=4096 00:11:12.003 fio: pid=570244, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:11:12.260 13:22:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:11:12.260 13:22:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:11:12.260 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=43139072, buflen=4096 00:11:12.260 fio: pid=570240, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:11:12.518 13:22:08 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:11:12.518 13:22:08 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:11:12.518 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=23527424, buflen=4096 00:11:12.518 fio: pid=570238, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:11:12.776 13:22:08 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:11:12.776 13:22:08 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:11:12.776 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=43618304, buflen=4096 00:11:12.776 fio: pid=570239, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:11:12.776 00:11:12.776 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=570238: Mon Oct 7 13:22:08 2024 00:11:12.776 read: IOPS=1629, BW=6518KiB/s (6674kB/s)(22.4MiB/3525msec) 00:11:12.776 slat (usec): min=5, max=16952, avg=14.08, stdev=223.57 00:11:12.776 clat (usec): min=173, max=42103, avg=592.56, stdev=3752.55 00:11:12.776 lat (usec): min=180, max=58040, avg=606.63, stdev=3791.19 00:11:12.776 clat percentiles (usec): 00:11:12.776 | 1.00th=[ 182], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 204], 00:11:12.776 | 30.00th=[ 212], 40.00th=[ 223], 50.00th=[ 235], 60.00th=[ 251], 00:11:12.776 | 70.00th=[ 265], 80.00th=[ 277], 90.00th=[ 297], 95.00th=[ 338], 00:11:12.776 | 99.00th=[ 537], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:11:12.776 | 99.99th=[42206] 00:11:12.776 bw ( KiB/s): min= 96, max=15408, per=21.44%, avg=7642.67, stdev=6771.85, samples=6 00:11:12.776 iops : min= 24, max= 3852, avg=1910.67, stdev=1692.96, samples=6 00:11:12.776 lat (usec) : 250=59.91%, 500=38.57%, 750=0.64% 00:11:12.776 lat (msec) : 50=0.85% 00:11:12.776 cpu : usr=1.28%, sys=2.70%, ctx=5748, majf=0, minf=2 00:11:12.776 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:12.776 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.776 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.776 issued rwts: total=5745,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:12.776 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:12.776 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=570239: Mon Oct 7 13:22:08 2024 00:11:12.776 read: IOPS=2797, BW=10.9MiB/s (11.5MB/s)(41.6MiB/3807msec) 00:11:12.776 slat (usec): min=5, max=11008, avg=12.24, stdev=124.62 00:11:12.776 clat (usec): min=168, max=42004, avg=342.47, stdev=2026.88 00:11:12.776 lat (usec): min=174, max=51991, avg=354.09, stdev=2050.59 00:11:12.776 clat percentiles (usec): 00:11:12.776 | 1.00th=[ 180], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 198], 00:11:12.776 | 30.00th=[ 204], 40.00th=[ 212], 50.00th=[ 221], 60.00th=[ 231], 00:11:12.776 | 70.00th=[ 247], 80.00th=[ 285], 90.00th=[ 314], 95.00th=[ 347], 00:11:12.776 | 99.00th=[ 510], 99.50th=[ 553], 99.90th=[41157], 99.95th=[41157], 00:11:12.776 | 99.99th=[42206] 00:11:12.776 bw ( KiB/s): min= 100, max=18024, per=34.12%, avg=12161.71, stdev=5848.43, samples=7 00:11:12.776 iops : min= 25, max= 4506, avg=3040.43, stdev=1462.11, samples=7 00:11:12.776 lat (usec) : 250=70.71%, 500=28.04%, 750=0.93%, 1000=0.05% 00:11:12.776 lat (msec) : 2=0.01%, 50=0.25% 00:11:12.776 cpu : usr=2.21%, sys=4.39%, ctx=10653, majf=0, minf=1 00:11:12.776 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:12.776 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.776 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.776 issued rwts: total=10650,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:12.776 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:12.776 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=570240: Mon Oct 7 13:22:08 2024 00:11:12.776 read: IOPS=3278, BW=12.8MiB/s (13.4MB/s)(41.1MiB/3213msec) 00:11:12.776 slat (nsec): min=5736, max=52813, avg=10031.87, stdev=4819.76 00:11:12.776 clat (usec): min=170, max=41180, avg=290.26, stdev=1371.81 00:11:12.776 lat (usec): min=176, max=41189, avg=300.29, stdev=1372.01 00:11:12.776 clat percentiles (usec): 00:11:12.776 | 1.00th=[ 180], 5.00th=[ 188], 10.00th=[ 194], 20.00th=[ 206], 00:11:12.776 | 30.00th=[ 217], 40.00th=[ 229], 50.00th=[ 241], 60.00th=[ 249], 00:11:12.777 | 70.00th=[ 260], 80.00th=[ 277], 90.00th=[ 297], 95.00th=[ 318], 00:11:12.777 | 99.00th=[ 375], 99.50th=[ 400], 99.90th=[40633], 99.95th=[41157], 00:11:12.777 | 99.99th=[41157] 00:11:12.777 bw ( KiB/s): min= 6200, max=18384, per=36.01%, avg=12837.33, stdev=4174.40, samples=6 00:11:12.777 iops : min= 1550, max= 4596, avg=3209.33, stdev=1043.60, samples=6 00:11:12.777 lat (usec) : 250=61.02%, 500=38.77%, 750=0.06%, 1000=0.02% 00:11:12.777 lat (msec) : 10=0.01%, 50=0.11% 00:11:12.777 cpu : usr=2.33%, sys=4.86%, ctx=10533, majf=0, minf=1 00:11:12.777 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:12.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.777 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.777 issued rwts: total=10533,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:12.777 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:12.777 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=570244: Mon Oct 7 13:22:08 2024 00:11:12.777 read: IOPS=2392, BW=9569KiB/s (9799kB/s)(27.3MiB/2926msec) 00:11:12.777 slat (nsec): min=5442, max=79135, avg=14068.64, stdev=7293.67 00:11:12.777 clat (usec): min=196, max=42101, avg=397.23, stdev=2132.38 00:11:12.777 lat (usec): min=205, max=42112, avg=411.30, stdev=2132.48 00:11:12.777 clat percentiles (usec): 00:11:12.777 | 1.00th=[ 208], 5.00th=[ 217], 10.00th=[ 225], 20.00th=[ 235], 00:11:12.777 | 30.00th=[ 245], 40.00th=[ 255], 50.00th=[ 273], 60.00th=[ 289], 00:11:12.777 | 70.00th=[ 302], 80.00th=[ 322], 90.00th=[ 363], 95.00th=[ 445], 00:11:12.777 | 99.00th=[ 515], 99.50th=[ 570], 99.90th=[41157], 99.95th=[42206], 00:11:12.777 | 99.99th=[42206] 00:11:12.777 bw ( KiB/s): min= 4472, max=14368, per=30.16%, avg=10752.00, stdev=4000.40, samples=5 00:11:12.777 iops : min= 1118, max= 3592, avg=2688.00, stdev=1000.10, samples=5 00:11:12.777 lat (usec) : 250=35.92%, 500=62.52%, 750=1.19%, 1000=0.04% 00:11:12.777 lat (msec) : 2=0.04%, 50=0.27% 00:11:12.777 cpu : usr=1.61%, sys=4.44%, ctx=7003, majf=0, minf=2 00:11:12.777 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:12.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.777 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:12.777 issued rwts: total=7001,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:12.777 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:12.777 00:11:12.777 Run status group 0 (all jobs): 00:11:12.777 READ: bw=34.8MiB/s (36.5MB/s), 6518KiB/s-12.8MiB/s (6674kB/s-13.4MB/s), io=133MiB (139MB), run=2926-3807msec 00:11:12.777 00:11:12.777 Disk stats (read/write): 00:11:12.777 nvme0n1: ios=5740/0, merge=0/0, ticks=3208/0, in_queue=3208, util=95.48% 00:11:12.777 nvme0n2: ios=10685/0, merge=0/0, ticks=3531/0, in_queue=3531, util=98.77% 00:11:12.777 nvme0n3: ios=10117/0, merge=0/0, ticks=2907/0, in_queue=2907, util=96.76% 00:11:12.777 nvme0n4: ios=7043/0, merge=0/0, ticks=3608/0, in_queue=3608, util=99.86% 00:11:13.035 13:22:08 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:11:13.035 13:22:08 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:11:13.293 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:11:13.293 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:11:13.551 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:11:13.551 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:11:13.809 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:11:13.809 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:11:14.067 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@69 -- # fio_status=0 00:11:14.067 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # wait 570140 00:11:14.067 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # fio_status=4 00:11:14.067 13:22:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:14.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1219 -- # local i=0 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1231 -- # return 0 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:11:14.326 nvmf hotplug test: fio failed as expected 00:11:14.326 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@91 -- # nvmftestfini 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@121 -- # sync 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@124 -- # set +e 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:14.585 rmmod nvme_tcp 00:11:14.585 rmmod nvme_fabrics 00:11:14.585 rmmod nvme_keyring 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@128 -- # set -e 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@129 -- # return 0 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@515 -- # '[' -n 568099 ']' 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@516 -- # killprocess 568099 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@950 -- # '[' -z 568099 ']' 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@954 -- # kill -0 568099 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # uname 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 568099 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 568099' 00:11:14.585 killing process with pid 568099 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@969 -- # kill 568099 00:11:14.585 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@974 -- # wait 568099 00:11:14.843 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:14.843 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:14.843 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:14.843 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@297 -- # iptr 00:11:14.843 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-save 00:11:14.843 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:14.844 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-restore 00:11:14.844 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:14.844 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@302 -- # remove_spdk_ns 00:11:14.844 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:14.844 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:14.844 13:22:10 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:11:17.381 00:11:17.381 real 0m24.493s 00:11:17.381 user 1m25.647s 00:11:17.381 sys 0m7.783s 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:11:17.381 ************************************ 00:11:17.381 END TEST nvmf_fio_target 00:11:17.381 ************************************ 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@35 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:17.381 ************************************ 00:11:17.381 START TEST nvmf_bdevio 00:11:17.381 ************************************ 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:11:17.381 * Looking for test storage... 00:11:17.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lcov --version 00:11:17.381 13:22:12 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # IFS=.-: 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # read -ra ver1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # IFS=.-: 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # read -ra ver2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@338 -- # local 'op=<' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@340 -- # ver1_l=2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@341 -- # ver2_l=1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@344 -- # case "$op" in 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@345 -- # : 1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # decimal 1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # ver1[v]=1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # decimal 2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # ver2[v]=2 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # return 0 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:17.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:17.382 --rc genhtml_branch_coverage=1 00:11:17.382 --rc genhtml_function_coverage=1 00:11:17.382 --rc genhtml_legend=1 00:11:17.382 --rc geninfo_all_blocks=1 00:11:17.382 --rc geninfo_unexecuted_blocks=1 00:11:17.382 00:11:17.382 ' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:17.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:17.382 --rc genhtml_branch_coverage=1 00:11:17.382 --rc genhtml_function_coverage=1 00:11:17.382 --rc genhtml_legend=1 00:11:17.382 --rc geninfo_all_blocks=1 00:11:17.382 --rc geninfo_unexecuted_blocks=1 00:11:17.382 00:11:17.382 ' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:17.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:17.382 --rc genhtml_branch_coverage=1 00:11:17.382 --rc genhtml_function_coverage=1 00:11:17.382 --rc genhtml_legend=1 00:11:17.382 --rc geninfo_all_blocks=1 00:11:17.382 --rc geninfo_unexecuted_blocks=1 00:11:17.382 00:11:17.382 ' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:17.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:17.382 --rc genhtml_branch_coverage=1 00:11:17.382 --rc genhtml_function_coverage=1 00:11:17.382 --rc genhtml_legend=1 00:11:17.382 --rc geninfo_all_blocks=1 00:11:17.382 --rc geninfo_unexecuted_blocks=1 00:11:17.382 00:11:17.382 ' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # uname -s 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@15 -- # shopt -s extglob 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@5 -- # export PATH 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@51 -- # : 0 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:17.382 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@14 -- # nvmftestinit 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:11:17.382 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@309 -- # xtrace_disable 00:11:17.383 13:22:13 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@315 -- # pci_devs=() 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@315 -- # local -a pci_devs 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@316 -- # pci_net_devs=() 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@317 -- # pci_drivers=() 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@317 -- # local -A pci_drivers 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@319 -- # net_devs=() 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@319 -- # local -ga net_devs 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@320 -- # e810=() 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@320 -- # local -ga e810 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@321 -- # x722=() 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@321 -- # local -ga x722 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@322 -- # mlx=() 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@322 -- # local -ga mlx 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:11:19.914 Found 0000:84:00.0 (0x8086 - 0x159b) 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:11:19.914 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:11:19.914 Found 0000:84:00.1 (0x8086 - 0x159b) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@416 -- # [[ up == up ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:11:19.915 Found net devices under 0000:84:00.0: cvl_0_0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@416 -- # [[ up == up ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:11:19.915 Found net devices under 0000:84:00.1: cvl_0_1 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@440 -- # is_hw=yes 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:11:19.915 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:19.915 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:11:19.915 00:11:19.915 --- 10.0.0.2 ping statistics --- 00:11:19.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:19.915 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:19.915 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:19.915 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:11:19.915 00:11:19.915 --- 10.0.0.1 ping statistics --- 00:11:19.915 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:19.915 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@448 -- # return 0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@507 -- # nvmfpid=573012 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@508 -- # waitforlisten 573012 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@831 -- # '[' -z 573012 ']' 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:19.915 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:19.915 [2024-10-07 13:22:15.472386] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:19.915 [2024-10-07 13:22:15.472505] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:19.915 [2024-10-07 13:22:15.537019] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:19.915 [2024-10-07 13:22:15.649228] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:19.915 [2024-10-07 13:22:15.649302] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:19.915 [2024-10-07 13:22:15.649330] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:19.915 [2024-10-07 13:22:15.649343] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:19.915 [2024-10-07 13:22:15.649353] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:19.915 [2024-10-07 13:22:15.651241] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:11:19.915 [2024-10-07 13:22:15.651294] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:11:19.915 [2024-10-07 13:22:15.651351] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:11:19.915 [2024-10-07 13:22:15.651354] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@864 -- # return 0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:19.915 [2024-10-07 13:22:15.812262] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:19.915 Malloc0 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:19.915 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:11:19.916 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.916 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:20.174 [2024-10-07 13:22:15.866177] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # config=() 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # local subsystem config 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:11:20.174 { 00:11:20.174 "params": { 00:11:20.174 "name": "Nvme$subsystem", 00:11:20.174 "trtype": "$TEST_TRANSPORT", 00:11:20.174 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:20.174 "adrfam": "ipv4", 00:11:20.174 "trsvcid": "$NVMF_PORT", 00:11:20.174 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:20.174 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:20.174 "hdgst": ${hdgst:-false}, 00:11:20.174 "ddgst": ${ddgst:-false} 00:11:20.174 }, 00:11:20.174 "method": "bdev_nvme_attach_controller" 00:11:20.174 } 00:11:20.174 EOF 00:11:20.174 )") 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # cat 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@582 -- # jq . 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@583 -- # IFS=, 00:11:20.174 13:22:15 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:11:20.174 "params": { 00:11:20.174 "name": "Nvme1", 00:11:20.174 "trtype": "tcp", 00:11:20.174 "traddr": "10.0.0.2", 00:11:20.174 "adrfam": "ipv4", 00:11:20.174 "trsvcid": "4420", 00:11:20.174 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:11:20.174 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:11:20.174 "hdgst": false, 00:11:20.174 "ddgst": false 00:11:20.174 }, 00:11:20.174 "method": "bdev_nvme_attach_controller" 00:11:20.174 }' 00:11:20.174 [2024-10-07 13:22:15.917360] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:20.174 [2024-10-07 13:22:15.917429] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid573043 ] 00:11:20.174 [2024-10-07 13:22:15.981579] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:20.174 [2024-10-07 13:22:16.097902] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:20.174 [2024-10-07 13:22:16.097953] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:20.174 [2024-10-07 13:22:16.097957] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:20.740 I/O targets: 00:11:20.740 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:11:20.740 00:11:20.740 00:11:20.740 CUnit - A unit testing framework for C - Version 2.1-3 00:11:20.740 http://cunit.sourceforge.net/ 00:11:20.740 00:11:20.740 00:11:20.740 Suite: bdevio tests on: Nvme1n1 00:11:20.740 Test: blockdev write read block ...passed 00:11:20.740 Test: blockdev write zeroes read block ...passed 00:11:20.740 Test: blockdev write zeroes read no split ...passed 00:11:20.740 Test: blockdev write zeroes read split ...passed 00:11:20.740 Test: blockdev write zeroes read split partial ...passed 00:11:20.740 Test: blockdev reset ...[2024-10-07 13:22:16.544565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:11:20.740 [2024-10-07 13:22:16.544678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d1bf40 (9): Bad file descriptor 00:11:20.740 [2024-10-07 13:22:16.638648] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:11:20.740 passed 00:11:20.740 Test: blockdev write read 8 blocks ...passed 00:11:20.998 Test: blockdev write read size > 128k ...passed 00:11:20.998 Test: blockdev write read invalid size ...passed 00:11:20.998 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:11:20.998 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:11:20.998 Test: blockdev write read max offset ...passed 00:11:20.998 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:11:20.998 Test: blockdev writev readv 8 blocks ...passed 00:11:20.998 Test: blockdev writev readv 30 x 1block ...passed 00:11:20.998 Test: blockdev writev readv block ...passed 00:11:20.998 Test: blockdev writev readv size > 128k ...passed 00:11:20.998 Test: blockdev writev readv size > 128k in two iovs ...passed 00:11:20.998 Test: blockdev comparev and writev ...[2024-10-07 13:22:16.854781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.854818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:11:20.998 [2024-10-07 13:22:16.854844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.854861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:11:20.998 [2024-10-07 13:22:16.855286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.855311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:11:20.998 [2024-10-07 13:22:16.855344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.855362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:11:20.998 [2024-10-07 13:22:16.855829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.855854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:11:20.998 [2024-10-07 13:22:16.855876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.855892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:11:20.998 [2024-10-07 13:22:16.856325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.856348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:11:20.998 [2024-10-07 13:22:16.856370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:11:20.998 [2024-10-07 13:22:16.856387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:11:20.998 passed 00:11:21.257 Test: blockdev nvme passthru rw ...passed 00:11:21.257 Test: blockdev nvme passthru vendor specific ...[2024-10-07 13:22:16.939910] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:11:21.257 [2024-10-07 13:22:16.939939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:11:21.257 [2024-10-07 13:22:16.940199] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:11:21.257 [2024-10-07 13:22:16.940221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:11:21.257 [2024-10-07 13:22:16.940375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:11:21.257 [2024-10-07 13:22:16.940399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:11:21.257 [2024-10-07 13:22:16.940570] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:11:21.257 [2024-10-07 13:22:16.940594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:11:21.257 passed 00:11:21.257 Test: blockdev nvme admin passthru ...passed 00:11:21.257 Test: blockdev copy ...passed 00:11:21.257 00:11:21.257 Run Summary: Type Total Ran Passed Failed Inactive 00:11:21.257 suites 1 1 n/a 0 0 00:11:21.257 tests 23 23 23 0 0 00:11:21.257 asserts 152 152 152 0 n/a 00:11:21.257 00:11:21.257 Elapsed time = 1.136 seconds 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@30 -- # nvmftestfini 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@121 -- # sync 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@124 -- # set +e 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:21.515 rmmod nvme_tcp 00:11:21.515 rmmod nvme_fabrics 00:11:21.515 rmmod nvme_keyring 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@128 -- # set -e 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@129 -- # return 0 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@515 -- # '[' -n 573012 ']' 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@516 -- # killprocess 573012 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@950 -- # '[' -z 573012 ']' 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@954 -- # kill -0 573012 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # uname 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 573012 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@968 -- # echo 'killing process with pid 573012' 00:11:21.515 killing process with pid 573012 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@969 -- # kill 573012 00:11:21.515 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@974 -- # wait 573012 00:11:21.773 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:21.773 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:21.773 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@297 -- # iptr 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-save 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-restore 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@302 -- # remove_spdk_ns 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:21.774 13:22:17 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:11:24.310 00:11:24.310 real 0m6.813s 00:11:24.310 user 0m11.198s 00:11:24.310 sys 0m2.292s 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:11:24.310 ************************************ 00:11:24.310 END TEST nvmf_bdevio 00:11:24.310 ************************************ 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:11:24.310 00:11:24.310 real 3m59.562s 00:11:24.310 user 10m22.278s 00:11:24.310 sys 1m11.632s 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:24.310 ************************************ 00:11:24.310 END TEST nvmf_target_core 00:11:24.310 ************************************ 00:11:24.310 13:22:19 nvmf_tcp -- nvmf/nvmf.sh@15 -- # run_test nvmf_target_extra /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:11:24.310 13:22:19 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:24.310 13:22:19 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:24.310 13:22:19 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:11:24.310 ************************************ 00:11:24.310 START TEST nvmf_target_extra 00:11:24.310 ************************************ 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:11:24.310 * Looking for test storage... 00:11:24.310 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lcov --version 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # IFS=.-: 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # read -ra ver1 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # IFS=.-: 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # read -ra ver2 00:11:24.310 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@338 -- # local 'op=<' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@340 -- # ver1_l=2 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@341 -- # ver2_l=1 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@344 -- # case "$op" in 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@345 -- # : 1 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # decimal 1 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=1 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 1 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # ver1[v]=1 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # decimal 2 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=2 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 2 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # ver2[v]=2 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # return 0 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:24.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.311 --rc genhtml_branch_coverage=1 00:11:24.311 --rc genhtml_function_coverage=1 00:11:24.311 --rc genhtml_legend=1 00:11:24.311 --rc geninfo_all_blocks=1 00:11:24.311 --rc geninfo_unexecuted_blocks=1 00:11:24.311 00:11:24.311 ' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:24.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.311 --rc genhtml_branch_coverage=1 00:11:24.311 --rc genhtml_function_coverage=1 00:11:24.311 --rc genhtml_legend=1 00:11:24.311 --rc geninfo_all_blocks=1 00:11:24.311 --rc geninfo_unexecuted_blocks=1 00:11:24.311 00:11:24.311 ' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:24.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.311 --rc genhtml_branch_coverage=1 00:11:24.311 --rc genhtml_function_coverage=1 00:11:24.311 --rc genhtml_legend=1 00:11:24.311 --rc geninfo_all_blocks=1 00:11:24.311 --rc geninfo_unexecuted_blocks=1 00:11:24.311 00:11:24.311 ' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:24.311 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.311 --rc genhtml_branch_coverage=1 00:11:24.311 --rc genhtml_function_coverage=1 00:11:24.311 --rc genhtml_legend=1 00:11:24.311 --rc geninfo_all_blocks=1 00:11:24.311 --rc geninfo_unexecuted_blocks=1 00:11:24.311 00:11:24.311 ' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # uname -s 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@15 -- # shopt -s extglob 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- paths/export.sh@5 -- # export PATH 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@51 -- # : 0 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:24.311 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@13 -- # TEST_ARGS=("$@") 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@15 -- # [[ 0 -eq 0 ]] 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@16 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:11:24.311 ************************************ 00:11:24.311 START TEST nvmf_example 00:11:24.311 ************************************ 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:11:24.311 * Looking for test storage... 00:11:24.311 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # lcov --version 00:11:24.311 13:22:19 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@336 -- # IFS=.-: 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@336 -- # read -ra ver1 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@337 -- # IFS=.-: 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@337 -- # read -ra ver2 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@338 -- # local 'op=<' 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@340 -- # ver1_l=2 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@341 -- # ver2_l=1 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@344 -- # case "$op" in 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@345 -- # : 1 00:11:24.311 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@365 -- # decimal 1 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@353 -- # local d=1 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@355 -- # echo 1 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@365 -- # ver1[v]=1 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@366 -- # decimal 2 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@353 -- # local d=2 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@355 -- # echo 2 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@366 -- # ver2[v]=2 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@368 -- # return 0 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:24.312 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.312 --rc genhtml_branch_coverage=1 00:11:24.312 --rc genhtml_function_coverage=1 00:11:24.312 --rc genhtml_legend=1 00:11:24.312 --rc geninfo_all_blocks=1 00:11:24.312 --rc geninfo_unexecuted_blocks=1 00:11:24.312 00:11:24.312 ' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:24.312 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.312 --rc genhtml_branch_coverage=1 00:11:24.312 --rc genhtml_function_coverage=1 00:11:24.312 --rc genhtml_legend=1 00:11:24.312 --rc geninfo_all_blocks=1 00:11:24.312 --rc geninfo_unexecuted_blocks=1 00:11:24.312 00:11:24.312 ' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:24.312 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.312 --rc genhtml_branch_coverage=1 00:11:24.312 --rc genhtml_function_coverage=1 00:11:24.312 --rc genhtml_legend=1 00:11:24.312 --rc geninfo_all_blocks=1 00:11:24.312 --rc geninfo_unexecuted_blocks=1 00:11:24.312 00:11:24.312 ' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:24.312 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:24.312 --rc genhtml_branch_coverage=1 00:11:24.312 --rc genhtml_function_coverage=1 00:11:24.312 --rc genhtml_legend=1 00:11:24.312 --rc geninfo_all_blocks=1 00:11:24.312 --rc geninfo_unexecuted_blocks=1 00:11:24.312 00:11:24.312 ' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@7 -- # uname -s 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@15 -- # shopt -s extglob 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@5 -- # export PATH 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@51 -- # : 0 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:24.312 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@41 -- # nvmftestinit 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@309 -- # xtrace_disable 00:11:24.312 13:22:20 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@315 -- # pci_devs=() 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@315 -- # local -a pci_devs 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@316 -- # pci_net_devs=() 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@317 -- # pci_drivers=() 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@317 -- # local -A pci_drivers 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@319 -- # net_devs=() 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@319 -- # local -ga net_devs 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@320 -- # e810=() 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@320 -- # local -ga e810 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@321 -- # x722=() 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@321 -- # local -ga x722 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@322 -- # mlx=() 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@322 -- # local -ga mlx 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:26.848 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:11:26.849 Found 0000:84:00.0 (0x8086 - 0x159b) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:11:26.849 Found 0000:84:00.1 (0x8086 - 0x159b) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@416 -- # [[ up == up ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:11:26.849 Found net devices under 0000:84:00.0: cvl_0_0 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@416 -- # [[ up == up ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:11:26.849 Found net devices under 0000:84:00.1: cvl_0_1 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@440 -- # is_hw=yes 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:11:26.849 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:26.849 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.343 ms 00:11:26.849 00:11:26.849 --- 10.0.0.2 ping statistics --- 00:11:26.849 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:26.849 rtt min/avg/max/mdev = 0.343/0.343/0.343/0.000 ms 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:26.849 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:26.849 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:11:26.849 00:11:26.849 --- 10.0.0.1 ping statistics --- 00:11:26.849 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:26.849 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@448 -- # return 0 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@34 -- # nvmfpid=575321 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@36 -- # waitforlisten 575321 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@831 -- # '[' -z 575321 ']' 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:26.849 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:26.850 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:26.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:26.850 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:26.850 13:22:22 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@864 -- # return 0 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:11:27.784 13:22:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:11:37.810 Initializing NVMe Controllers 00:11:37.810 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:11:37.810 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:11:37.810 Initialization complete. Launching workers. 00:11:37.810 ======================================================== 00:11:37.810 Latency(us) 00:11:37.810 Device Information : IOPS MiB/s Average min max 00:11:37.810 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14697.70 57.41 4355.97 779.10 16442.17 00:11:37.810 ======================================================== 00:11:37.810 Total : 14697.70 57.41 4355.97 779.10 16442.17 00:11:37.810 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@66 -- # nvmftestfini 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@121 -- # sync 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@124 -- # set +e 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:38.068 rmmod nvme_tcp 00:11:38.068 rmmod nvme_fabrics 00:11:38.068 rmmod nvme_keyring 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@128 -- # set -e 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@129 -- # return 0 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@515 -- # '[' -n 575321 ']' 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@516 -- # killprocess 575321 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@950 -- # '[' -z 575321 ']' 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@954 -- # kill -0 575321 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@955 -- # uname 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 575321 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@956 -- # process_name=nvmf 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@960 -- # '[' nvmf = sudo ']' 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@968 -- # echo 'killing process with pid 575321' 00:11:38.068 killing process with pid 575321 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@969 -- # kill 575321 00:11:38.068 13:22:33 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@974 -- # wait 575321 00:11:38.327 nvmf threads initialize successfully 00:11:38.327 bdev subsystem init successfully 00:11:38.327 created a nvmf target service 00:11:38.327 create targets's poll groups done 00:11:38.327 all subsystems of target started 00:11:38.327 nvmf target is running 00:11:38.327 all subsystems of target stopped 00:11:38.327 destroy targets's poll groups done 00:11:38.327 destroyed the nvmf target service 00:11:38.327 bdev subsystem finish successfully 00:11:38.327 nvmf threads destroy successfully 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@297 -- # iptr 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # iptables-save 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # iptables-restore 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@302 -- # remove_spdk_ns 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:38.327 13:22:34 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:40.234 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:11:40.234 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:11:40.234 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:40.234 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:40.493 00:11:40.493 real 0m16.241s 00:11:40.493 user 0m45.373s 00:11:40.493 sys 0m3.619s 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:11:40.493 ************************************ 00:11:40.493 END TEST nvmf_example 00:11:40.493 ************************************ 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@17 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:11:40.493 ************************************ 00:11:40.493 START TEST nvmf_filesystem 00:11:40.493 ************************************ 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:11:40.493 * Looking for test storage... 00:11:40.493 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lcov --version 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # IFS=.-: 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # read -ra ver1 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # IFS=.-: 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # read -ra ver2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@338 -- # local 'op=<' 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@340 -- # ver1_l=2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@341 -- # ver2_l=1 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@344 -- # case "$op" in 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@345 -- # : 1 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # decimal 1 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=1 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 1 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # ver1[v]=1 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # decimal 2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # ver2[v]=2 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # return 0 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:40.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.493 --rc genhtml_branch_coverage=1 00:11:40.493 --rc genhtml_function_coverage=1 00:11:40.493 --rc genhtml_legend=1 00:11:40.493 --rc geninfo_all_blocks=1 00:11:40.493 --rc geninfo_unexecuted_blocks=1 00:11:40.493 00:11:40.493 ' 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:40.493 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.493 --rc genhtml_branch_coverage=1 00:11:40.493 --rc genhtml_function_coverage=1 00:11:40.493 --rc genhtml_legend=1 00:11:40.493 --rc geninfo_all_blocks=1 00:11:40.493 --rc geninfo_unexecuted_blocks=1 00:11:40.493 00:11:40.493 ' 00:11:40.493 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:40.494 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.494 --rc genhtml_branch_coverage=1 00:11:40.494 --rc genhtml_function_coverage=1 00:11:40.494 --rc genhtml_legend=1 00:11:40.494 --rc geninfo_all_blocks=1 00:11:40.494 --rc geninfo_unexecuted_blocks=1 00:11:40.494 00:11:40.494 ' 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:40.494 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.494 --rc genhtml_branch_coverage=1 00:11:40.494 --rc genhtml_function_coverage=1 00:11:40.494 --rc genhtml_legend=1 00:11:40.494 --rc geninfo_all_blocks=1 00:11:40.494 --rc geninfo_unexecuted_blocks=1 00:11:40.494 00:11:40.494 ' 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@34 -- # set -e 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@36 -- # shopt -s extglob 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@37 -- # shopt -s inherit_errexit 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@39 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@44 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@45 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@22 -- # CONFIG_CET=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@26 -- # CONFIG_AIO_FSDEV=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@27 -- # CONFIG_HAVE_ARC4RANDOM=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@28 -- # CONFIG_HAVE_LIBARCHIVE=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@29 -- # CONFIG_UBLK=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@30 -- # CONFIG_ISAL_CRYPTO=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@31 -- # CONFIG_OPENSSL_PATH= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@32 -- # CONFIG_OCF=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@33 -- # CONFIG_FUSE=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@34 -- # CONFIG_VTUNE_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@35 -- # CONFIG_FUZZER_LIB= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@36 -- # CONFIG_FUZZER=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@37 -- # CONFIG_FSDEV=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@38 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@39 -- # CONFIG_CRYPTO=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@40 -- # CONFIG_PGO_USE=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@41 -- # CONFIG_VHOST=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@42 -- # CONFIG_DAOS=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@43 -- # CONFIG_DPDK_INC_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@44 -- # CONFIG_DAOS_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@45 -- # CONFIG_UNIT_TESTS=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@46 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@47 -- # CONFIG_VIRTIO=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@48 -- # CONFIG_DPDK_UADK=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@49 -- # CONFIG_COVERAGE=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@50 -- # CONFIG_RDMA=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@51 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIM=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@52 -- # CONFIG_HAVE_LZ4=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@53 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@54 -- # CONFIG_URING_PATH= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@55 -- # CONFIG_XNVME=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@56 -- # CONFIG_VFIO_USER=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@57 -- # CONFIG_ARCH=native 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@58 -- # CONFIG_HAVE_EVP_MAC=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@59 -- # CONFIG_URING_ZNS=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@60 -- # CONFIG_WERROR=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@61 -- # CONFIG_HAVE_LIBBSD=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@62 -- # CONFIG_UBSAN=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@63 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIMESPEC=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@64 -- # CONFIG_IPSEC_MB_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@65 -- # CONFIG_GOLANG=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@66 -- # CONFIG_ISAL=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@67 -- # CONFIG_IDXD_KERNEL=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@68 -- # CONFIG_DPDK_LIB_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@69 -- # CONFIG_RDMA_PROV=verbs 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@70 -- # CONFIG_APPS=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@71 -- # CONFIG_SHARED=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@72 -- # CONFIG_HAVE_KEYUTILS=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@73 -- # CONFIG_FC_PATH= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@74 -- # CONFIG_DPDK_PKG_CONFIG=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@75 -- # CONFIG_FC=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@76 -- # CONFIG_AVAHI=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@77 -- # CONFIG_FIO_PLUGIN=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@78 -- # CONFIG_RAID5F=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@79 -- # CONFIG_EXAMPLES=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@80 -- # CONFIG_TESTS=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@81 -- # CONFIG_CRYPTO_MLX5=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@82 -- # CONFIG_MAX_LCORES=128 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@83 -- # CONFIG_IPSEC_MB=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@84 -- # CONFIG_PGO_DIR= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@85 -- # CONFIG_DEBUG=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@86 -- # CONFIG_DPDK_COMPRESSDEV=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@87 -- # CONFIG_CROSS_PREFIX= 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@88 -- # CONFIG_COPY_FILE_RANGE=y 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@89 -- # CONFIG_URING=n 00:11:40.494 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:11:40.495 #define SPDK_CONFIG_H 00:11:40.495 #define SPDK_CONFIG_AIO_FSDEV 1 00:11:40.495 #define SPDK_CONFIG_APPS 1 00:11:40.495 #define SPDK_CONFIG_ARCH native 00:11:40.495 #undef SPDK_CONFIG_ASAN 00:11:40.495 #undef SPDK_CONFIG_AVAHI 00:11:40.495 #undef SPDK_CONFIG_CET 00:11:40.495 #define SPDK_CONFIG_COPY_FILE_RANGE 1 00:11:40.495 #define SPDK_CONFIG_COVERAGE 1 00:11:40.495 #define SPDK_CONFIG_CROSS_PREFIX 00:11:40.495 #undef SPDK_CONFIG_CRYPTO 00:11:40.495 #undef SPDK_CONFIG_CRYPTO_MLX5 00:11:40.495 #undef SPDK_CONFIG_CUSTOMOCF 00:11:40.495 #undef SPDK_CONFIG_DAOS 00:11:40.495 #define SPDK_CONFIG_DAOS_DIR 00:11:40.495 #define SPDK_CONFIG_DEBUG 1 00:11:40.495 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:11:40.495 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:11:40.495 #define SPDK_CONFIG_DPDK_INC_DIR 00:11:40.495 #define SPDK_CONFIG_DPDK_LIB_DIR 00:11:40.495 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:11:40.495 #undef SPDK_CONFIG_DPDK_UADK 00:11:40.495 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:11:40.495 #define SPDK_CONFIG_EXAMPLES 1 00:11:40.495 #undef SPDK_CONFIG_FC 00:11:40.495 #define SPDK_CONFIG_FC_PATH 00:11:40.495 #define SPDK_CONFIG_FIO_PLUGIN 1 00:11:40.495 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:11:40.495 #define SPDK_CONFIG_FSDEV 1 00:11:40.495 #undef SPDK_CONFIG_FUSE 00:11:40.495 #undef SPDK_CONFIG_FUZZER 00:11:40.495 #define SPDK_CONFIG_FUZZER_LIB 00:11:40.495 #undef SPDK_CONFIG_GOLANG 00:11:40.495 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:11:40.495 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:11:40.495 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:11:40.495 #define SPDK_CONFIG_HAVE_KEYUTILS 1 00:11:40.495 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:11:40.495 #undef SPDK_CONFIG_HAVE_LIBBSD 00:11:40.495 #undef SPDK_CONFIG_HAVE_LZ4 00:11:40.495 #define SPDK_CONFIG_HAVE_STRUCT_STAT_ST_ATIM 1 00:11:40.495 #undef SPDK_CONFIG_HAVE_STRUCT_STAT_ST_ATIMESPEC 00:11:40.495 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:11:40.495 #define SPDK_CONFIG_IDXD 1 00:11:40.495 #define SPDK_CONFIG_IDXD_KERNEL 1 00:11:40.495 #undef SPDK_CONFIG_IPSEC_MB 00:11:40.495 #define SPDK_CONFIG_IPSEC_MB_DIR 00:11:40.495 #define SPDK_CONFIG_ISAL 1 00:11:40.495 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:11:40.495 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:11:40.495 #define SPDK_CONFIG_LIBDIR 00:11:40.495 #undef SPDK_CONFIG_LTO 00:11:40.495 #define SPDK_CONFIG_MAX_LCORES 128 00:11:40.495 #define SPDK_CONFIG_NVME_CUSE 1 00:11:40.495 #undef SPDK_CONFIG_OCF 00:11:40.495 #define SPDK_CONFIG_OCF_PATH 00:11:40.495 #define SPDK_CONFIG_OPENSSL_PATH 00:11:40.495 #undef SPDK_CONFIG_PGO_CAPTURE 00:11:40.495 #define SPDK_CONFIG_PGO_DIR 00:11:40.495 #undef SPDK_CONFIG_PGO_USE 00:11:40.495 #define SPDK_CONFIG_PREFIX /usr/local 00:11:40.495 #undef SPDK_CONFIG_RAID5F 00:11:40.495 #undef SPDK_CONFIG_RBD 00:11:40.495 #define SPDK_CONFIG_RDMA 1 00:11:40.495 #define SPDK_CONFIG_RDMA_PROV verbs 00:11:40.495 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:11:40.495 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:11:40.495 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:11:40.495 #define SPDK_CONFIG_SHARED 1 00:11:40.495 #undef SPDK_CONFIG_SMA 00:11:40.495 #define SPDK_CONFIG_TESTS 1 00:11:40.495 #undef SPDK_CONFIG_TSAN 00:11:40.495 #define SPDK_CONFIG_UBLK 1 00:11:40.495 #define SPDK_CONFIG_UBSAN 1 00:11:40.495 #undef SPDK_CONFIG_UNIT_TESTS 00:11:40.495 #undef SPDK_CONFIG_URING 00:11:40.495 #define SPDK_CONFIG_URING_PATH 00:11:40.495 #undef SPDK_CONFIG_URING_ZNS 00:11:40.495 #undef SPDK_CONFIG_USDT 00:11:40.495 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:11:40.495 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:11:40.495 #define SPDK_CONFIG_VFIO_USER 1 00:11:40.495 #define SPDK_CONFIG_VFIO_USER_DIR 00:11:40.495 #define SPDK_CONFIG_VHOST 1 00:11:40.495 #define SPDK_CONFIG_VIRTIO 1 00:11:40.495 #undef SPDK_CONFIG_VTUNE 00:11:40.495 #define SPDK_CONFIG_VTUNE_DIR 00:11:40.495 #define SPDK_CONFIG_WERROR 1 00:11:40.495 #define SPDK_CONFIG_WPDK_DIR 00:11:40.495 #undef SPDK_CONFIG_XNVME 00:11:40.495 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@15 -- # shopt -s extglob 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@5 -- # export PATH 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@56 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@64 -- # TEST_TAG=N/A 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@65 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@67 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:11:40.495 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@68 -- # uname -s 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@68 -- # PM_OS=Linux 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@70 -- # MONITOR_RESOURCES_SUDO=() 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@70 -- # declare -A MONITOR_RESOURCES_SUDO 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@71 -- # MONITOR_RESOURCES_SUDO["collect-bmc-pm"]=1 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@72 -- # MONITOR_RESOURCES_SUDO["collect-cpu-load"]=0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@73 -- # MONITOR_RESOURCES_SUDO["collect-cpu-temp"]=0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@74 -- # MONITOR_RESOURCES_SUDO["collect-vmstat"]=0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@76 -- # SUDO[0]= 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@76 -- # SUDO[1]='sudo -E' 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@78 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@79 -- # [[ Linux == FreeBSD ]] 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@81 -- # [[ Linux == Linux ]] 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@81 -- # [[ ............................... != QEMU ]] 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@81 -- # [[ ! -e /.dockerenv ]] 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@84 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@85 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@88 -- # [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power ]] 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@58 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@59 -- # export RUN_NIGHTLY 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@62 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@63 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@64 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@65 -- # export SPDK_RUN_VALGRIND 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@66 -- # : 1 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@67 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@68 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@69 -- # export SPDK_TEST_UNITTEST 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@70 -- # : 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@71 -- # export SPDK_TEST_AUTOBUILD 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@72 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@73 -- # export SPDK_TEST_RELEASE_BUILD 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@74 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@75 -- # export SPDK_TEST_ISAL 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@76 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@77 -- # export SPDK_TEST_ISCSI 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@78 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@79 -- # export SPDK_TEST_ISCSI_INITIATOR 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@80 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@82 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_PMR 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@84 -- # : 0 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_BP 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@86 -- # : 1 00:11:40.756 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVME_CLI 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@88 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@89 -- # export SPDK_TEST_NVME_CUSE 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@90 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@91 -- # export SPDK_TEST_NVME_FDP 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@92 -- # : 1 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@93 -- # export SPDK_TEST_NVMF 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@94 -- # : 1 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@95 -- # export SPDK_TEST_VFIOUSER 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@96 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@97 -- # export SPDK_TEST_VFIOUSER_QEMU 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@98 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@99 -- # export SPDK_TEST_FUZZER 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@100 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@101 -- # export SPDK_TEST_FUZZER_SHORT 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@102 -- # : tcp 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@103 -- # export SPDK_TEST_NVMF_TRANSPORT 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@104 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@105 -- # export SPDK_TEST_RBD 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@106 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@107 -- # export SPDK_TEST_VHOST 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@108 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@109 -- # export SPDK_TEST_BLOCKDEV 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@110 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@111 -- # export SPDK_TEST_RAID 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@112 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@113 -- # export SPDK_TEST_IOAT 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@114 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@115 -- # export SPDK_TEST_BLOBFS 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@116 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@117 -- # export SPDK_TEST_VHOST_INIT 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@118 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@119 -- # export SPDK_TEST_LVOL 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@120 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@121 -- # export SPDK_TEST_VBDEV_COMPRESS 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@122 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@123 -- # export SPDK_RUN_ASAN 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@124 -- # : 1 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@125 -- # export SPDK_RUN_UBSAN 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@126 -- # : 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@127 -- # export SPDK_RUN_EXTERNAL_DPDK 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@128 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@129 -- # export SPDK_RUN_NON_ROOT 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@130 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@131 -- # export SPDK_TEST_CRYPTO 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@132 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@133 -- # export SPDK_TEST_FTL 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@134 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@135 -- # export SPDK_TEST_OCF 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@136 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@137 -- # export SPDK_TEST_VMD 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@138 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@139 -- # export SPDK_TEST_OPAL 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@140 -- # : 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@141 -- # export SPDK_TEST_NATIVE_DPDK 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@142 -- # : true 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@143 -- # export SPDK_AUTOTEST_X 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@144 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@145 -- # export SPDK_TEST_URING 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@146 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@147 -- # export SPDK_TEST_USDT 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@148 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@149 -- # export SPDK_TEST_USE_IGB_UIO 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@150 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@151 -- # export SPDK_TEST_SCHEDULER 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@152 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@153 -- # export SPDK_TEST_SCANBUILD 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@154 -- # : e810 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@155 -- # export SPDK_TEST_NVMF_NICS 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@156 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@157 -- # export SPDK_TEST_SMA 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@158 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@159 -- # export SPDK_TEST_DAOS 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@160 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@161 -- # export SPDK_TEST_XNVME 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@162 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@163 -- # export SPDK_TEST_ACCEL 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@164 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@165 -- # export SPDK_TEST_ACCEL_DSA 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@166 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@167 -- # export SPDK_TEST_ACCEL_IAA 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@169 -- # : 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@170 -- # export SPDK_TEST_FUZZER_TARGET 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@171 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@172 -- # export SPDK_TEST_NVMF_MDNS 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@173 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@174 -- # export SPDK_JSONRPC_GO_CLIENT 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@175 -- # : 0 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@176 -- # export SPDK_TEST_SETUP 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@179 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@179 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@180 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@180 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@181 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@181 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@182 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:11:40.757 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@182 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@185 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@185 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@189 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@189 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@193 -- # export PYTHONDONTWRITEBYTECODE=1 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@193 -- # PYTHONDONTWRITEBYTECODE=1 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@197 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@197 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@198 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@198 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@202 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@203 -- # rm -rf /var/tmp/asan_suppression_file 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@204 -- # cat 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@240 -- # echo leak:libfuse3.so 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@242 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@242 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@244 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@244 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@246 -- # '[' -z /var/spdk/dependencies ']' 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@249 -- # export DEPENDENCY_DIR 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@253 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@253 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@254 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@254 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@257 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@257 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@258 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@258 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@260 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@260 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@263 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@263 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@265 -- # _LCOV_MAIN=0 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@266 -- # _LCOV_LLVM=1 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@267 -- # _LCOV= 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@268 -- # [[ '' == *clang* ]] 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@270 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@271 -- # _lcov_opt[_LCOV_MAIN]= 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@273 -- # lcov_opt= 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@276 -- # '[' 0 -eq 0 ']' 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@277 -- # export valgrind= 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@277 -- # valgrind= 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@283 -- # uname -s 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@283 -- # '[' Linux = Linux ']' 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@284 -- # HUGEMEM=4096 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@285 -- # export CLEAR_HUGE=yes 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@285 -- # CLEAR_HUGE=yes 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@287 -- # MAKE=make 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@288 -- # MAKEFLAGS=-j48 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@304 -- # export HUGEMEM=4096 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@304 -- # HUGEMEM=4096 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@306 -- # NO_HUGE=() 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@307 -- # TEST_MODE= 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@308 -- # for i in "$@" 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@309 -- # case "$i" in 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@314 -- # TEST_TRANSPORT=tcp 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@329 -- # [[ -z 577026 ]] 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@329 -- # kill -0 577026 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@339 -- # [[ -v testdir ]] 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@341 -- # local requested_size=2147483648 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@342 -- # local mount target_dir 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@344 -- # local -A mounts fss sizes avails uses 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@345 -- # local source fs size avail mount use 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@347 -- # local storage_fallback storage_candidates 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@349 -- # mktemp -udt spdk.XXXXXX 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@349 -- # storage_fallback=/tmp/spdk.0p1ohF 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@354 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@356 -- # [[ -n '' ]] 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@361 -- # [[ -n '' ]] 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@366 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.0p1ohF/tests/target /tmp/spdk.0p1ohF 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@369 -- # requested_size=2214592512 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@338 -- # df -T 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@338 -- # grep -v Filesystem 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=spdk_devtmpfs 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=devtmpfs 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=67108864 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=67108864 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=0 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/pmem0 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=ext2 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=660762624 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=5284429824 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=4623667200 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=spdk_root 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=overlay 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=39250915328 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=45077110784 00:11:40.758 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=5826195456 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=22528524288 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=22538555392 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=10031104 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=8992968704 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=9015422976 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=22454272 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=22538346496 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=22538555392 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=208896 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=4507697152 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=4507709440 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=12288 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@377 -- # printf '* Looking for test storage...\n' 00:11:40.759 * Looking for test storage... 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@379 -- # local target_space new_size 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@380 -- # for target_dir in "${storage_candidates[@]}" 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # awk '$1 !~ /Filesystem/{print $6}' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # mount=/ 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@385 -- # target_space=39250915328 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@386 -- # (( target_space == 0 || target_space < requested_size )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@389 -- # (( target_space >= requested_size )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ overlay == tmpfs ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ overlay == ramfs ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ / == / ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@392 -- # new_size=8040787968 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@393 -- # (( new_size * 100 / sizes[/] > 95 )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@398 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@398 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@399 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:40.759 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@400 -- # return 0 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1668 -- # set -o errtrace 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1672 -- # PS4=' \t ${test_domain:-} -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1673 -- # true 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1675 -- # xtrace_fd 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@25 -- # [[ -n 15 ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/15 ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@27 -- # exec 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@29 -- # exec 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@31 -- # xtrace_restore 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@18 -- # set -x 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lcov --version 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # IFS=.-: 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # read -ra ver1 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # IFS=.-: 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # read -ra ver2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@338 -- # local 'op=<' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@340 -- # ver1_l=2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@341 -- # ver2_l=1 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@344 -- # case "$op" in 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@345 -- # : 1 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # decimal 1 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=1 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 1 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # ver1[v]=1 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # decimal 2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # ver2[v]=2 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # return 0 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:40.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.759 --rc genhtml_branch_coverage=1 00:11:40.759 --rc genhtml_function_coverage=1 00:11:40.759 --rc genhtml_legend=1 00:11:40.759 --rc geninfo_all_blocks=1 00:11:40.759 --rc geninfo_unexecuted_blocks=1 00:11:40.759 00:11:40.759 ' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:40.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.759 --rc genhtml_branch_coverage=1 00:11:40.759 --rc genhtml_function_coverage=1 00:11:40.759 --rc genhtml_legend=1 00:11:40.759 --rc geninfo_all_blocks=1 00:11:40.759 --rc geninfo_unexecuted_blocks=1 00:11:40.759 00:11:40.759 ' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:40.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.759 --rc genhtml_branch_coverage=1 00:11:40.759 --rc genhtml_function_coverage=1 00:11:40.759 --rc genhtml_legend=1 00:11:40.759 --rc geninfo_all_blocks=1 00:11:40.759 --rc geninfo_unexecuted_blocks=1 00:11:40.759 00:11:40.759 ' 00:11:40.759 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:40.759 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.759 --rc genhtml_branch_coverage=1 00:11:40.759 --rc genhtml_function_coverage=1 00:11:40.759 --rc genhtml_legend=1 00:11:40.759 --rc geninfo_all_blocks=1 00:11:40.759 --rc geninfo_unexecuted_blocks=1 00:11:40.759 00:11:40.760 ' 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@7 -- # uname -s 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@15 -- # shopt -s extglob 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@5 -- # export PATH 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@51 -- # : 0 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:40.760 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@15 -- # nvmftestinit 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@309 -- # xtrace_disable 00:11:40.760 13:22:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@315 -- # pci_devs=() 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@315 -- # local -a pci_devs 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@316 -- # pci_net_devs=() 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@317 -- # pci_drivers=() 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@317 -- # local -A pci_drivers 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@319 -- # net_devs=() 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@319 -- # local -ga net_devs 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@320 -- # e810=() 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@320 -- # local -ga e810 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@321 -- # x722=() 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@321 -- # local -ga x722 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@322 -- # mlx=() 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@322 -- # local -ga mlx 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:11:43.293 Found 0000:84:00.0 (0x8086 - 0x159b) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:11:43.293 Found 0000:84:00.1 (0x8086 - 0x159b) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@416 -- # [[ up == up ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:11:43.293 Found net devices under 0000:84:00.0: cvl_0_0 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@416 -- # [[ up == up ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:11:43.293 Found net devices under 0000:84:00.1: cvl_0_1 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@440 -- # is_hw=yes 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:11:43.293 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:43.293 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:11:43.293 00:11:43.293 --- 10.0.0.2 ping statistics --- 00:11:43.293 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:43.293 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:43.293 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:43.293 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:11:43.293 00:11:43.293 --- 10.0.0.1 ping statistics --- 00:11:43.293 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:43.293 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@448 -- # return 0 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:43.293 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:11:43.294 ************************************ 00:11:43.294 START TEST nvmf_filesystem_no_in_capsule 00:11:43.294 ************************************ 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1125 -- # nvmf_filesystem_part 0 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@47 -- # in_capsule=0 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@507 -- # nvmfpid=578794 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@508 -- # waitforlisten 578794 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@831 -- # '[' -z 578794 ']' 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:43.294 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:43.294 13:22:38 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.294 [2024-10-07 13:22:39.012421] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:43.294 [2024-10-07 13:22:39.012548] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:43.294 [2024-10-07 13:22:39.080206] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:43.294 [2024-10-07 13:22:39.192296] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:43.294 [2024-10-07 13:22:39.192361] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:43.294 [2024-10-07 13:22:39.192391] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:43.294 [2024-10-07 13:22:39.192403] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:43.294 [2024-10-07 13:22:39.192413] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:43.294 [2024-10-07 13:22:39.194224] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:43.294 [2024-10-07 13:22:39.194284] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:43.294 [2024-10-07 13:22:39.194351] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:43.294 [2024-10-07 13:22:39.194354] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@864 -- # return 0 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.553 [2024-10-07 13:22:39.360235] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.553 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.812 Malloc1 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.812 [2024-10-07 13:22:39.535845] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1378 -- # local bdev_name=Malloc1 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1379 -- # local bdev_info 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1380 -- # local bs 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1381 -- # local nb 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1382 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:43.812 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1382 -- # bdev_info='[ 00:11:43.812 { 00:11:43.812 "name": "Malloc1", 00:11:43.812 "aliases": [ 00:11:43.812 "5e37059c-3725-4916-a4bc-5f9c1c0d296e" 00:11:43.812 ], 00:11:43.812 "product_name": "Malloc disk", 00:11:43.812 "block_size": 512, 00:11:43.812 "num_blocks": 1048576, 00:11:43.812 "uuid": "5e37059c-3725-4916-a4bc-5f9c1c0d296e", 00:11:43.812 "assigned_rate_limits": { 00:11:43.812 "rw_ios_per_sec": 0, 00:11:43.812 "rw_mbytes_per_sec": 0, 00:11:43.812 "r_mbytes_per_sec": 0, 00:11:43.812 "w_mbytes_per_sec": 0 00:11:43.812 }, 00:11:43.812 "claimed": true, 00:11:43.812 "claim_type": "exclusive_write", 00:11:43.813 "zoned": false, 00:11:43.813 "supported_io_types": { 00:11:43.813 "read": true, 00:11:43.813 "write": true, 00:11:43.813 "unmap": true, 00:11:43.813 "flush": true, 00:11:43.813 "reset": true, 00:11:43.813 "nvme_admin": false, 00:11:43.813 "nvme_io": false, 00:11:43.813 "nvme_io_md": false, 00:11:43.813 "write_zeroes": true, 00:11:43.813 "zcopy": true, 00:11:43.813 "get_zone_info": false, 00:11:43.813 "zone_management": false, 00:11:43.813 "zone_append": false, 00:11:43.813 "compare": false, 00:11:43.813 "compare_and_write": false, 00:11:43.813 "abort": true, 00:11:43.813 "seek_hole": false, 00:11:43.813 "seek_data": false, 00:11:43.813 "copy": true, 00:11:43.813 "nvme_iov_md": false 00:11:43.813 }, 00:11:43.813 "memory_domains": [ 00:11:43.813 { 00:11:43.813 "dma_device_id": "system", 00:11:43.813 "dma_device_type": 1 00:11:43.813 }, 00:11:43.813 { 00:11:43.813 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:11:43.813 "dma_device_type": 2 00:11:43.813 } 00:11:43.813 ], 00:11:43.813 "driver_specific": {} 00:11:43.813 } 00:11:43.813 ]' 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1383 -- # jq '.[] .block_size' 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1383 -- # bs=512 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1384 -- # jq '.[] .num_blocks' 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1384 -- # nb=1048576 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1387 -- # bdev_size=512 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1388 -- # echo 512 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@58 -- # malloc_size=536870912 00:11:43.813 13:22:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:44.745 13:22:40 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:11:44.745 13:22:40 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1198 -- # local i=0 00:11:44.746 13:22:40 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:44.746 13:22:40 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:44.746 13:22:40 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1205 -- # sleep 2 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1208 -- # return 0 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@76 -- # local dev=nvme0n1 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@80 -- # echo 536870912 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@64 -- # nvme_size=536870912 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:11:46.644 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:11:46.901 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@69 -- # partprobe 00:11:47.159 13:22:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@70 -- # sleep 1 00:11:48.091 13:22:43 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:11:48.091 13:22:43 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:11:48.091 13:22:43 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:11:48.091 13:22:43 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:48.091 13:22:43 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:48.091 ************************************ 00:11:48.091 START TEST filesystem_ext4 00:11:48.091 ************************************ 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create ext4 nvme0n1 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@18 -- # fstype=ext4 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@926 -- # local fstype=ext4 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@928 -- # local i=0 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@929 -- # local force 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@931 -- # '[' ext4 = ext4 ']' 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@932 -- # force=-F 00:11:48.091 13:22:44 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@937 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:11:48.349 mke2fs 1.47.0 (5-Feb-2023) 00:11:48.349 Discarding device blocks: 0/522240 done 00:11:48.349 Creating filesystem with 522240 1k blocks and 130560 inodes 00:11:48.349 Filesystem UUID: e350dc63-ef0a-4720-bb42-40270e9a94c6 00:11:48.349 Superblock backups stored on blocks: 00:11:48.349 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:11:48.349 00:11:48.349 Allocating group tables: 0/64 done 00:11:48.349 Writing inode tables: 0/64 done 00:11:48.607 Creating journal (8192 blocks): done 00:11:50.799 Writing superblocks and filesystem accounting information: 0/64 2/64 done 00:11:50.799 00:11:50.799 13:22:46 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@945 -- # return 0 00:11:50.799 13:22:46 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@25 -- # sync 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@27 -- # sync 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@29 -- # i=0 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@30 -- # umount /mnt/device 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@37 -- # kill -0 578794 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:11:57.347 00:11:57.347 real 0m8.361s 00:11:57.347 user 0m0.020s 00:11:57.347 sys 0m0.057s 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@10 -- # set +x 00:11:57.347 ************************************ 00:11:57.347 END TEST filesystem_ext4 00:11:57.347 ************************************ 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:57.347 ************************************ 00:11:57.347 START TEST filesystem_btrfs 00:11:57.347 ************************************ 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create btrfs nvme0n1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@18 -- # fstype=btrfs 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@926 -- # local fstype=btrfs 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@928 -- # local i=0 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@929 -- # local force 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@931 -- # '[' btrfs = ext4 ']' 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@934 -- # force=-f 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@937 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:11:57.347 btrfs-progs v6.8.1 00:11:57.347 See https://btrfs.readthedocs.io for more information. 00:11:57.347 00:11:57.347 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:11:57.347 NOTE: several default settings have changed in version 5.15, please make sure 00:11:57.347 this does not affect your deployments: 00:11:57.347 - DUP for metadata (-m dup) 00:11:57.347 - enabled no-holes (-O no-holes) 00:11:57.347 - enabled free-space-tree (-R free-space-tree) 00:11:57.347 00:11:57.347 Label: (null) 00:11:57.347 UUID: 7ba80883-ca8c-4ed8-8d2c-6d469fbdea3f 00:11:57.347 Node size: 16384 00:11:57.347 Sector size: 4096 (CPU page size: 4096) 00:11:57.347 Filesystem size: 510.00MiB 00:11:57.347 Block group profiles: 00:11:57.347 Data: single 8.00MiB 00:11:57.347 Metadata: DUP 32.00MiB 00:11:57.347 System: DUP 8.00MiB 00:11:57.347 SSD detected: yes 00:11:57.347 Zoned device: no 00:11:57.347 Features: extref, skinny-metadata, no-holes, free-space-tree 00:11:57.347 Checksum: crc32c 00:11:57.347 Number of devices: 1 00:11:57.347 Devices: 00:11:57.347 ID SIZE PATH 00:11:57.347 1 510.00MiB /dev/nvme0n1p1 00:11:57.347 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@945 -- # return 0 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@25 -- # sync 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@27 -- # sync 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@29 -- # i=0 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@37 -- # kill -0 578794 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:11:57.347 00:11:57.347 real 0m0.494s 00:11:57.347 user 0m0.027s 00:11:57.347 sys 0m0.089s 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@10 -- # set +x 00:11:57.347 ************************************ 00:11:57.347 END TEST filesystem_btrfs 00:11:57.347 ************************************ 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:11:57.347 ************************************ 00:11:57.347 START TEST filesystem_xfs 00:11:57.347 ************************************ 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create xfs nvme0n1 00:11:57.347 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@18 -- # fstype=xfs 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@926 -- # local fstype=xfs 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@928 -- # local i=0 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@929 -- # local force 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@931 -- # '[' xfs = ext4 ']' 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@934 -- # force=-f 00:11:57.348 13:22:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@937 -- # mkfs.xfs -f /dev/nvme0n1p1 00:11:57.348 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:11:57.348 = sectsz=512 attr=2, projid32bit=1 00:11:57.348 = crc=1 finobt=1, sparse=1, rmapbt=0 00:11:57.348 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:11:57.348 data = bsize=4096 blocks=130560, imaxpct=25 00:11:57.348 = sunit=0 swidth=0 blks 00:11:57.348 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:11:57.348 log =internal log bsize=4096 blocks=16384, version=2 00:11:57.348 = sectsz=512 sunit=0 blks, lazy-count=1 00:11:57.348 realtime =none extsz=4096 blocks=0, rtextents=0 00:11:58.295 Discarding blocks...Done. 00:11:58.295 13:22:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@945 -- # return 0 00:11:58.295 13:22:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@25 -- # sync 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@27 -- # sync 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@29 -- # i=0 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@37 -- # kill -0 578794 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:12:00.190 00:12:00.190 real 0m3.115s 00:12:00.190 user 0m0.022s 00:12:00.190 sys 0m0.059s 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@10 -- # set +x 00:12:00.190 ************************************ 00:12:00.190 END TEST filesystem_xfs 00:12:00.190 ************************************ 00:12:00.190 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@93 -- # sync 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:00.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1219 -- # local i=0 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1231 -- # return 0 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@101 -- # killprocess 578794 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@950 -- # '[' -z 578794 ']' 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@954 -- # kill -0 578794 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@955 -- # uname 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 578794 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@968 -- # echo 'killing process with pid 578794' 00:12:00.755 killing process with pid 578794 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@969 -- # kill 578794 00:12:00.755 13:22:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@974 -- # wait 578794 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@102 -- # nvmfpid= 00:12:01.320 00:12:01.320 real 0m18.071s 00:12:01.320 user 1m9.635s 00:12:01.320 sys 0m2.256s 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.320 ************************************ 00:12:01.320 END TEST nvmf_filesystem_no_in_capsule 00:12:01.320 ************************************ 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:12:01.320 ************************************ 00:12:01.320 START TEST nvmf_filesystem_in_capsule 00:12:01.320 ************************************ 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1125 -- # nvmf_filesystem_part 4096 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@47 -- # in_capsule=4096 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@507 -- # nvmfpid=581156 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@508 -- # waitforlisten 581156 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@831 -- # '[' -z 581156 ']' 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:01.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:01.320 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.320 [2024-10-07 13:22:57.134109] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:01.320 [2024-10-07 13:22:57.134188] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:01.320 [2024-10-07 13:22:57.195992] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:01.578 [2024-10-07 13:22:57.300791] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:01.578 [2024-10-07 13:22:57.300855] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:01.578 [2024-10-07 13:22:57.300882] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:01.578 [2024-10-07 13:22:57.300894] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:01.578 [2024-10-07 13:22:57.300903] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:01.578 [2024-10-07 13:22:57.302512] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:01.578 [2024-10-07 13:22:57.302564] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:01.578 [2024-10-07 13:22:57.302587] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:01.578 [2024-10-07 13:22:57.302590] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@864 -- # return 0 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.578 [2024-10-07 13:22:57.467272] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.578 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.836 Malloc1 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.836 [2024-10-07 13:22:57.647157] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1378 -- # local bdev_name=Malloc1 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1379 -- # local bdev_info 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1380 -- # local bs 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1381 -- # local nb 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1382 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1382 -- # bdev_info='[ 00:12:01.836 { 00:12:01.836 "name": "Malloc1", 00:12:01.836 "aliases": [ 00:12:01.836 "5d73cd41-749e-4121-ae6f-8230f2c0f26a" 00:12:01.836 ], 00:12:01.836 "product_name": "Malloc disk", 00:12:01.836 "block_size": 512, 00:12:01.836 "num_blocks": 1048576, 00:12:01.836 "uuid": "5d73cd41-749e-4121-ae6f-8230f2c0f26a", 00:12:01.836 "assigned_rate_limits": { 00:12:01.836 "rw_ios_per_sec": 0, 00:12:01.836 "rw_mbytes_per_sec": 0, 00:12:01.836 "r_mbytes_per_sec": 0, 00:12:01.836 "w_mbytes_per_sec": 0 00:12:01.836 }, 00:12:01.836 "claimed": true, 00:12:01.836 "claim_type": "exclusive_write", 00:12:01.836 "zoned": false, 00:12:01.836 "supported_io_types": { 00:12:01.836 "read": true, 00:12:01.836 "write": true, 00:12:01.836 "unmap": true, 00:12:01.836 "flush": true, 00:12:01.836 "reset": true, 00:12:01.836 "nvme_admin": false, 00:12:01.836 "nvme_io": false, 00:12:01.836 "nvme_io_md": false, 00:12:01.836 "write_zeroes": true, 00:12:01.836 "zcopy": true, 00:12:01.836 "get_zone_info": false, 00:12:01.836 "zone_management": false, 00:12:01.836 "zone_append": false, 00:12:01.836 "compare": false, 00:12:01.836 "compare_and_write": false, 00:12:01.836 "abort": true, 00:12:01.836 "seek_hole": false, 00:12:01.836 "seek_data": false, 00:12:01.836 "copy": true, 00:12:01.836 "nvme_iov_md": false 00:12:01.836 }, 00:12:01.836 "memory_domains": [ 00:12:01.836 { 00:12:01.836 "dma_device_id": "system", 00:12:01.836 "dma_device_type": 1 00:12:01.836 }, 00:12:01.836 { 00:12:01.836 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:12:01.836 "dma_device_type": 2 00:12:01.836 } 00:12:01.836 ], 00:12:01.836 "driver_specific": {} 00:12:01.836 } 00:12:01.836 ]' 00:12:01.836 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1383 -- # jq '.[] .block_size' 00:12:01.837 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1383 -- # bs=512 00:12:01.837 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1384 -- # jq '.[] .num_blocks' 00:12:01.837 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1384 -- # nb=1048576 00:12:01.837 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1387 -- # bdev_size=512 00:12:01.837 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1388 -- # echo 512 00:12:01.837 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@58 -- # malloc_size=536870912 00:12:01.837 13:22:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.768 13:22:58 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.768 13:22:58 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1198 -- # local i=0 00:12:02.768 13:22:58 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.768 13:22:58 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:12:02.768 13:22:58 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1205 -- # sleep 2 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1208 -- # return 0 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@76 -- # local dev=nvme0n1 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@80 -- # echo 536870912 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@64 -- # nvme_size=536870912 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:12:04.665 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:12:04.922 13:23:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@69 -- # partprobe 00:12:05.487 13:23:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@70 -- # sleep 1 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:06.421 ************************************ 00:12:06.421 START TEST filesystem_in_capsule_ext4 00:12:06.421 ************************************ 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create ext4 nvme0n1 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@18 -- # fstype=ext4 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@926 -- # local fstype=ext4 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@928 -- # local i=0 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@929 -- # local force 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@931 -- # '[' ext4 = ext4 ']' 00:12:06.421 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@932 -- # force=-F 00:12:06.422 13:23:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@937 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:12:06.422 mke2fs 1.47.0 (5-Feb-2023) 00:12:06.422 Discarding device blocks: 0/522240 done 00:12:06.422 Creating filesystem with 522240 1k blocks and 130560 inodes 00:12:06.422 Filesystem UUID: 16200ac8-f3d4-4ab7-a807-ba643e16d112 00:12:06.422 Superblock backups stored on blocks: 00:12:06.422 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:12:06.422 00:12:06.422 Allocating group tables: 0/64 done 00:12:06.422 Writing inode tables: 0/64 done 00:12:06.679 Creating journal (8192 blocks): done 00:12:09.054 Writing superblocks and filesystem accounting information: 0/64 2/64 done 00:12:09.054 00:12:09.054 13:23:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@945 -- # return 0 00:12:09.054 13:23:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:12:14.310 13:23:09 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@25 -- # sync 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@27 -- # sync 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@29 -- # i=0 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@30 -- # umount /mnt/device 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@37 -- # kill -0 581156 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:12:14.310 00:12:14.310 real 0m7.920s 00:12:14.310 user 0m0.018s 00:12:14.310 sys 0m0.066s 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@10 -- # set +x 00:12:14.310 ************************************ 00:12:14.310 END TEST filesystem_in_capsule_ext4 00:12:14.310 ************************************ 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:14.310 ************************************ 00:12:14.310 START TEST filesystem_in_capsule_btrfs 00:12:14.310 ************************************ 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create btrfs nvme0n1 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@18 -- # fstype=btrfs 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@926 -- # local fstype=btrfs 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@928 -- # local i=0 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@929 -- # local force 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@931 -- # '[' btrfs = ext4 ']' 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@934 -- # force=-f 00:12:14.310 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@937 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:12:14.567 btrfs-progs v6.8.1 00:12:14.567 See https://btrfs.readthedocs.io for more information. 00:12:14.567 00:12:14.567 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:12:14.567 NOTE: several default settings have changed in version 5.15, please make sure 00:12:14.567 this does not affect your deployments: 00:12:14.567 - DUP for metadata (-m dup) 00:12:14.567 - enabled no-holes (-O no-holes) 00:12:14.567 - enabled free-space-tree (-R free-space-tree) 00:12:14.567 00:12:14.567 Label: (null) 00:12:14.567 UUID: da68fef4-bb19-41ed-a0b3-68b871b7740a 00:12:14.567 Node size: 16384 00:12:14.567 Sector size: 4096 (CPU page size: 4096) 00:12:14.567 Filesystem size: 510.00MiB 00:12:14.567 Block group profiles: 00:12:14.567 Data: single 8.00MiB 00:12:14.567 Metadata: DUP 32.00MiB 00:12:14.567 System: DUP 8.00MiB 00:12:14.567 SSD detected: yes 00:12:14.567 Zoned device: no 00:12:14.567 Features: extref, skinny-metadata, no-holes, free-space-tree 00:12:14.567 Checksum: crc32c 00:12:14.567 Number of devices: 1 00:12:14.567 Devices: 00:12:14.567 ID SIZE PATH 00:12:14.567 1 510.00MiB /dev/nvme0n1p1 00:12:14.567 00:12:14.567 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@945 -- # return 0 00:12:14.567 13:23:10 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:12:15.498 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:12:15.498 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@25 -- # sync 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@27 -- # sync 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@29 -- # i=0 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@37 -- # kill -0 581156 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:12:15.756 00:12:15.756 real 0m1.370s 00:12:15.756 user 0m0.028s 00:12:15.756 sys 0m0.097s 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@10 -- # set +x 00:12:15.756 ************************************ 00:12:15.756 END TEST filesystem_in_capsule_btrfs 00:12:15.756 ************************************ 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:15.756 ************************************ 00:12:15.756 START TEST filesystem_in_capsule_xfs 00:12:15.756 ************************************ 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create xfs nvme0n1 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@18 -- # fstype=xfs 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@926 -- # local fstype=xfs 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@928 -- # local i=0 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@929 -- # local force 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@931 -- # '[' xfs = ext4 ']' 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@934 -- # force=-f 00:12:15.756 13:23:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@937 -- # mkfs.xfs -f /dev/nvme0n1p1 00:12:15.756 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:12:15.756 = sectsz=512 attr=2, projid32bit=1 00:12:15.756 = crc=1 finobt=1, sparse=1, rmapbt=0 00:12:15.756 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:12:15.756 data = bsize=4096 blocks=130560, imaxpct=25 00:12:15.756 = sunit=0 swidth=0 blks 00:12:15.756 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:12:15.756 log =internal log bsize=4096 blocks=16384, version=2 00:12:15.756 = sectsz=512 sunit=0 blks, lazy-count=1 00:12:15.756 realtime =none extsz=4096 blocks=0, rtextents=0 00:12:16.687 Discarding blocks...Done. 00:12:16.687 13:23:12 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@945 -- # return 0 00:12:16.687 13:23:12 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@25 -- # sync 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@27 -- # sync 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@29 -- # i=0 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@37 -- # kill -0 581156 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:12:19.211 00:12:19.211 real 0m3.100s 00:12:19.211 user 0m0.014s 00:12:19.211 sys 0m0.062s 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@10 -- # set +x 00:12:19.211 ************************************ 00:12:19.211 END TEST filesystem_in_capsule_xfs 00:12:19.211 ************************************ 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@93 -- # sync 00:12:19.211 13:23:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:19.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1219 -- # local i=0 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1231 -- # return 0 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@101 -- # killprocess 581156 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@950 -- # '[' -z 581156 ']' 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@954 -- # kill -0 581156 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@955 -- # uname 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 581156 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@968 -- # echo 'killing process with pid 581156' 00:12:19.211 killing process with pid 581156 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@969 -- # kill 581156 00:12:19.211 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@974 -- # wait 581156 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@102 -- # nvmfpid= 00:12:19.779 00:12:19.779 real 0m18.478s 00:12:19.779 user 1m11.256s 00:12:19.779 sys 0m2.351s 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:12:19.779 ************************************ 00:12:19.779 END TEST nvmf_filesystem_in_capsule 00:12:19.779 ************************************ 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@108 -- # nvmftestfini 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@121 -- # sync 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@124 -- # set +e 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:19.779 rmmod nvme_tcp 00:12:19.779 rmmod nvme_fabrics 00:12:19.779 rmmod nvme_keyring 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@128 -- # set -e 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@129 -- # return 0 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@515 -- # '[' -n '' ']' 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@297 -- # iptr 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # iptables-save 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # iptables-restore 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@302 -- # remove_spdk_ns 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:19.779 13:23:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:12:22.317 00:12:22.317 real 0m41.437s 00:12:22.317 user 2m22.004s 00:12:22.317 sys 0m6.415s 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:12:22.317 ************************************ 00:12:22.317 END TEST nvmf_filesystem 00:12:22.317 ************************************ 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@18 -- # run_test nvmf_target_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:12:22.317 ************************************ 00:12:22.317 START TEST nvmf_target_discovery 00:12:22.317 ************************************ 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:12:22.317 * Looking for test storage... 00:12:22.317 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # lcov --version 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@336 -- # IFS=.-: 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@336 -- # read -ra ver1 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@337 -- # IFS=.-: 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@337 -- # read -ra ver2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@338 -- # local 'op=<' 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@340 -- # ver1_l=2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@341 -- # ver2_l=1 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@344 -- # case "$op" in 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@345 -- # : 1 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@365 -- # decimal 1 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@353 -- # local d=1 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@355 -- # echo 1 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@365 -- # ver1[v]=1 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@366 -- # decimal 2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@353 -- # local d=2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@355 -- # echo 2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@366 -- # ver2[v]=2 00:12:22.317 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@368 -- # return 0 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:22.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.318 --rc genhtml_branch_coverage=1 00:12:22.318 --rc genhtml_function_coverage=1 00:12:22.318 --rc genhtml_legend=1 00:12:22.318 --rc geninfo_all_blocks=1 00:12:22.318 --rc geninfo_unexecuted_blocks=1 00:12:22.318 00:12:22.318 ' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:22.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.318 --rc genhtml_branch_coverage=1 00:12:22.318 --rc genhtml_function_coverage=1 00:12:22.318 --rc genhtml_legend=1 00:12:22.318 --rc geninfo_all_blocks=1 00:12:22.318 --rc geninfo_unexecuted_blocks=1 00:12:22.318 00:12:22.318 ' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:22.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.318 --rc genhtml_branch_coverage=1 00:12:22.318 --rc genhtml_function_coverage=1 00:12:22.318 --rc genhtml_legend=1 00:12:22.318 --rc geninfo_all_blocks=1 00:12:22.318 --rc geninfo_unexecuted_blocks=1 00:12:22.318 00:12:22.318 ' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:22.318 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.318 --rc genhtml_branch_coverage=1 00:12:22.318 --rc genhtml_function_coverage=1 00:12:22.318 --rc genhtml_legend=1 00:12:22.318 --rc geninfo_all_blocks=1 00:12:22.318 --rc geninfo_unexecuted_blocks=1 00:12:22.318 00:12:22.318 ' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@7 -- # uname -s 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@15 -- # shopt -s extglob 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@5 -- # export PATH 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@51 -- # : 0 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:22.318 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@15 -- # hash nvme 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@20 -- # nvmftestinit 00:12:22.318 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@309 -- # xtrace_disable 00:12:22.319 13:23:17 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@315 -- # pci_devs=() 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@315 -- # local -a pci_devs 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@316 -- # pci_net_devs=() 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@317 -- # pci_drivers=() 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@317 -- # local -A pci_drivers 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@319 -- # net_devs=() 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@319 -- # local -ga net_devs 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@320 -- # e810=() 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@320 -- # local -ga e810 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@321 -- # x722=() 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@321 -- # local -ga x722 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@322 -- # mlx=() 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@322 -- # local -ga mlx 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:12:24.223 Found 0000:84:00.0 (0x8086 - 0x159b) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:12:24.223 Found 0000:84:00.1 (0x8086 - 0x159b) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:24.223 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:12:24.224 Found net devices under 0000:84:00.0: cvl_0_0 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:12:24.224 Found net devices under 0000:84:00.1: cvl_0_1 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@440 -- # is_hw=yes 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:12:24.224 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:12:24.482 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:24.482 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:12:24.482 00:12:24.482 --- 10.0.0.2 ping statistics --- 00:12:24.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.482 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:24.482 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:24.482 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:12:24.482 00:12:24.482 --- 10.0.0.1 ping statistics --- 00:12:24.482 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.482 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@448 -- # return 0 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@507 -- # nvmfpid=585480 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@508 -- # waitforlisten 585480 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@831 -- # '[' -z 585480 ']' 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:24.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:24.482 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.482 [2024-10-07 13:23:20.247140] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:24.482 [2024-10-07 13:23:20.247217] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:24.482 [2024-10-07 13:23:20.309366] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:24.482 [2024-10-07 13:23:20.414764] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:24.483 [2024-10-07 13:23:20.414837] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:24.483 [2024-10-07 13:23:20.414867] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:24.483 [2024-10-07 13:23:20.414881] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:24.483 [2024-10-07 13:23:20.414891] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:24.740 [2024-10-07 13:23:20.416754] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:24.740 [2024-10-07 13:23:20.416807] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:24.740 [2024-10-07 13:23:20.416877] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:24.740 [2024-10-07 13:23:20.416882] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@864 -- # return 0 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 [2024-10-07 13:23:20.594739] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # seq 1 4 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 Null1 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 [2024-10-07 13:23:20.635098] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 Null2 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.740 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.997 Null3 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.997 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.998 Null4 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.998 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 4420 00:12:25.257 00:12:25.257 Discovery Log Number of Records 6, Generation counter 6 00:12:25.257 =====Discovery Log Entry 0====== 00:12:25.257 trtype: tcp 00:12:25.257 adrfam: ipv4 00:12:25.257 subtype: current discovery subsystem 00:12:25.257 treq: not required 00:12:25.257 portid: 0 00:12:25.257 trsvcid: 4420 00:12:25.257 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:12:25.257 traddr: 10.0.0.2 00:12:25.257 eflags: explicit discovery connections, duplicate discovery information 00:12:25.257 sectype: none 00:12:25.257 =====Discovery Log Entry 1====== 00:12:25.257 trtype: tcp 00:12:25.257 adrfam: ipv4 00:12:25.257 subtype: nvme subsystem 00:12:25.257 treq: not required 00:12:25.257 portid: 0 00:12:25.257 trsvcid: 4420 00:12:25.257 subnqn: nqn.2016-06.io.spdk:cnode1 00:12:25.257 traddr: 10.0.0.2 00:12:25.257 eflags: none 00:12:25.257 sectype: none 00:12:25.257 =====Discovery Log Entry 2====== 00:12:25.257 trtype: tcp 00:12:25.257 adrfam: ipv4 00:12:25.257 subtype: nvme subsystem 00:12:25.257 treq: not required 00:12:25.257 portid: 0 00:12:25.257 trsvcid: 4420 00:12:25.257 subnqn: nqn.2016-06.io.spdk:cnode2 00:12:25.257 traddr: 10.0.0.2 00:12:25.257 eflags: none 00:12:25.257 sectype: none 00:12:25.257 =====Discovery Log Entry 3====== 00:12:25.257 trtype: tcp 00:12:25.257 adrfam: ipv4 00:12:25.257 subtype: nvme subsystem 00:12:25.257 treq: not required 00:12:25.257 portid: 0 00:12:25.257 trsvcid: 4420 00:12:25.257 subnqn: nqn.2016-06.io.spdk:cnode3 00:12:25.257 traddr: 10.0.0.2 00:12:25.257 eflags: none 00:12:25.257 sectype: none 00:12:25.257 =====Discovery Log Entry 4====== 00:12:25.257 trtype: tcp 00:12:25.257 adrfam: ipv4 00:12:25.257 subtype: nvme subsystem 00:12:25.257 treq: not required 00:12:25.257 portid: 0 00:12:25.257 trsvcid: 4420 00:12:25.257 subnqn: nqn.2016-06.io.spdk:cnode4 00:12:25.257 traddr: 10.0.0.2 00:12:25.257 eflags: none 00:12:25.257 sectype: none 00:12:25.257 =====Discovery Log Entry 5====== 00:12:25.257 trtype: tcp 00:12:25.257 adrfam: ipv4 00:12:25.257 subtype: discovery subsystem referral 00:12:25.257 treq: not required 00:12:25.257 portid: 0 00:12:25.257 trsvcid: 4430 00:12:25.257 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:12:25.257 traddr: 10.0.0.2 00:12:25.257 eflags: none 00:12:25.257 sectype: none 00:12:25.257 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:12:25.257 Perform nvmf subsystem discovery via RPC 00:12:25.257 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:12:25.257 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.257 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.257 [ 00:12:25.257 { 00:12:25.257 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:12:25.257 "subtype": "Discovery", 00:12:25.257 "listen_addresses": [ 00:12:25.257 { 00:12:25.257 "trtype": "TCP", 00:12:25.257 "adrfam": "IPv4", 00:12:25.257 "traddr": "10.0.0.2", 00:12:25.257 "trsvcid": "4420" 00:12:25.257 } 00:12:25.257 ], 00:12:25.257 "allow_any_host": true, 00:12:25.257 "hosts": [] 00:12:25.257 }, 00:12:25.257 { 00:12:25.257 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:12:25.257 "subtype": "NVMe", 00:12:25.257 "listen_addresses": [ 00:12:25.257 { 00:12:25.257 "trtype": "TCP", 00:12:25.257 "adrfam": "IPv4", 00:12:25.257 "traddr": "10.0.0.2", 00:12:25.257 "trsvcid": "4420" 00:12:25.257 } 00:12:25.257 ], 00:12:25.257 "allow_any_host": true, 00:12:25.257 "hosts": [], 00:12:25.257 "serial_number": "SPDK00000000000001", 00:12:25.257 "model_number": "SPDK bdev Controller", 00:12:25.257 "max_namespaces": 32, 00:12:25.257 "min_cntlid": 1, 00:12:25.257 "max_cntlid": 65519, 00:12:25.257 "namespaces": [ 00:12:25.257 { 00:12:25.257 "nsid": 1, 00:12:25.257 "bdev_name": "Null1", 00:12:25.257 "name": "Null1", 00:12:25.257 "nguid": "95C20658CEB44F5D9AE2D360951DE26D", 00:12:25.257 "uuid": "95c20658-ceb4-4f5d-9ae2-d360951de26d" 00:12:25.257 } 00:12:25.257 ] 00:12:25.257 }, 00:12:25.257 { 00:12:25.257 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:12:25.257 "subtype": "NVMe", 00:12:25.257 "listen_addresses": [ 00:12:25.257 { 00:12:25.257 "trtype": "TCP", 00:12:25.257 "adrfam": "IPv4", 00:12:25.257 "traddr": "10.0.0.2", 00:12:25.257 "trsvcid": "4420" 00:12:25.257 } 00:12:25.257 ], 00:12:25.257 "allow_any_host": true, 00:12:25.257 "hosts": [], 00:12:25.257 "serial_number": "SPDK00000000000002", 00:12:25.257 "model_number": "SPDK bdev Controller", 00:12:25.257 "max_namespaces": 32, 00:12:25.257 "min_cntlid": 1, 00:12:25.257 "max_cntlid": 65519, 00:12:25.257 "namespaces": [ 00:12:25.257 { 00:12:25.257 "nsid": 1, 00:12:25.257 "bdev_name": "Null2", 00:12:25.257 "name": "Null2", 00:12:25.257 "nguid": "D347DBD3E7B6438A858A21E5839862F0", 00:12:25.257 "uuid": "d347dbd3-e7b6-438a-858a-21e5839862f0" 00:12:25.257 } 00:12:25.257 ] 00:12:25.257 }, 00:12:25.257 { 00:12:25.257 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:12:25.257 "subtype": "NVMe", 00:12:25.257 "listen_addresses": [ 00:12:25.257 { 00:12:25.257 "trtype": "TCP", 00:12:25.257 "adrfam": "IPv4", 00:12:25.257 "traddr": "10.0.0.2", 00:12:25.257 "trsvcid": "4420" 00:12:25.257 } 00:12:25.257 ], 00:12:25.257 "allow_any_host": true, 00:12:25.257 "hosts": [], 00:12:25.257 "serial_number": "SPDK00000000000003", 00:12:25.257 "model_number": "SPDK bdev Controller", 00:12:25.257 "max_namespaces": 32, 00:12:25.257 "min_cntlid": 1, 00:12:25.257 "max_cntlid": 65519, 00:12:25.257 "namespaces": [ 00:12:25.257 { 00:12:25.257 "nsid": 1, 00:12:25.257 "bdev_name": "Null3", 00:12:25.257 "name": "Null3", 00:12:25.257 "nguid": "5A35D241C81B402A8A2DE4BDFA4BF56C", 00:12:25.257 "uuid": "5a35d241-c81b-402a-8a2d-e4bdfa4bf56c" 00:12:25.257 } 00:12:25.257 ] 00:12:25.257 }, 00:12:25.257 { 00:12:25.257 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:12:25.257 "subtype": "NVMe", 00:12:25.257 "listen_addresses": [ 00:12:25.257 { 00:12:25.257 "trtype": "TCP", 00:12:25.257 "adrfam": "IPv4", 00:12:25.257 "traddr": "10.0.0.2", 00:12:25.257 "trsvcid": "4420" 00:12:25.257 } 00:12:25.257 ], 00:12:25.257 "allow_any_host": true, 00:12:25.257 "hosts": [], 00:12:25.257 "serial_number": "SPDK00000000000004", 00:12:25.257 "model_number": "SPDK bdev Controller", 00:12:25.257 "max_namespaces": 32, 00:12:25.257 "min_cntlid": 1, 00:12:25.257 "max_cntlid": 65519, 00:12:25.257 "namespaces": [ 00:12:25.257 { 00:12:25.257 "nsid": 1, 00:12:25.257 "bdev_name": "Null4", 00:12:25.257 "name": "Null4", 00:12:25.257 "nguid": "166679BBFE76498E9EF79746B328B622", 00:12:25.257 "uuid": "166679bb-fe76-498e-9ef7-9746b328b622" 00:12:25.257 } 00:12:25.257 ] 00:12:25.257 } 00:12:25.257 ] 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # seq 1 4 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:20 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # jq -r '.[].name' 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # check_bdevs= 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@50 -- # '[' -n '' ']' 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@57 -- # nvmftestfini 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@121 -- # sync 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@124 -- # set +e 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:25.258 rmmod nvme_tcp 00:12:25.258 rmmod nvme_fabrics 00:12:25.258 rmmod nvme_keyring 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@128 -- # set -e 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@129 -- # return 0 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@515 -- # '[' -n 585480 ']' 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@516 -- # killprocess 585480 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@950 -- # '[' -z 585480 ']' 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@954 -- # kill -0 585480 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@955 -- # uname 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:25.258 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 585480 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@968 -- # echo 'killing process with pid 585480' 00:12:25.518 killing process with pid 585480 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@969 -- # kill 585480 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@974 -- # wait 585480 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@297 -- # iptr 00:12:25.518 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # iptables-save 00:12:25.777 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:25.777 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # iptables-restore 00:12:25.777 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:25.777 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@302 -- # remove_spdk_ns 00:12:25.777 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:25.777 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:25.777 13:23:21 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:12:27.684 00:12:27.684 real 0m5.769s 00:12:27.684 user 0m4.948s 00:12:27.684 sys 0m1.994s 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:12:27.684 ************************************ 00:12:27.684 END TEST nvmf_target_discovery 00:12:27.684 ************************************ 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@19 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:12:27.684 ************************************ 00:12:27.684 START TEST nvmf_referrals 00:12:27.684 ************************************ 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:12:27.684 * Looking for test storage... 00:12:27.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # lcov --version 00:12:27.684 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@336 -- # IFS=.-: 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@336 -- # read -ra ver1 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@337 -- # IFS=.-: 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@337 -- # read -ra ver2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@338 -- # local 'op=<' 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@340 -- # ver1_l=2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@341 -- # ver2_l=1 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@344 -- # case "$op" in 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@345 -- # : 1 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@365 -- # decimal 1 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@353 -- # local d=1 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@355 -- # echo 1 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@365 -- # ver1[v]=1 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@366 -- # decimal 2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@353 -- # local d=2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@355 -- # echo 2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@366 -- # ver2[v]=2 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@368 -- # return 0 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:27.942 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.942 --rc genhtml_branch_coverage=1 00:12:27.942 --rc genhtml_function_coverage=1 00:12:27.942 --rc genhtml_legend=1 00:12:27.942 --rc geninfo_all_blocks=1 00:12:27.942 --rc geninfo_unexecuted_blocks=1 00:12:27.942 00:12:27.942 ' 00:12:27.942 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:27.942 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.942 --rc genhtml_branch_coverage=1 00:12:27.943 --rc genhtml_function_coverage=1 00:12:27.943 --rc genhtml_legend=1 00:12:27.943 --rc geninfo_all_blocks=1 00:12:27.943 --rc geninfo_unexecuted_blocks=1 00:12:27.943 00:12:27.943 ' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:27.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.943 --rc genhtml_branch_coverage=1 00:12:27.943 --rc genhtml_function_coverage=1 00:12:27.943 --rc genhtml_legend=1 00:12:27.943 --rc geninfo_all_blocks=1 00:12:27.943 --rc geninfo_unexecuted_blocks=1 00:12:27.943 00:12:27.943 ' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:27.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.943 --rc genhtml_branch_coverage=1 00:12:27.943 --rc genhtml_function_coverage=1 00:12:27.943 --rc genhtml_legend=1 00:12:27.943 --rc geninfo_all_blocks=1 00:12:27.943 --rc geninfo_unexecuted_blocks=1 00:12:27.943 00:12:27.943 ' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@7 -- # uname -s 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@15 -- # shopt -s extglob 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@5 -- # export PATH 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@51 -- # : 0 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:27.943 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@37 -- # nvmftestinit 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@309 -- # xtrace_disable 00:12:27.943 13:23:23 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@315 -- # pci_devs=() 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@315 -- # local -a pci_devs 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@316 -- # pci_net_devs=() 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@317 -- # pci_drivers=() 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@317 -- # local -A pci_drivers 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@319 -- # net_devs=() 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@319 -- # local -ga net_devs 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@320 -- # e810=() 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@320 -- # local -ga e810 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@321 -- # x722=() 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@321 -- # local -ga x722 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@322 -- # mlx=() 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@322 -- # local -ga mlx 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:12:30.474 Found 0000:84:00.0 (0x8086 - 0x159b) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:12:30.474 Found 0000:84:00.1 (0x8086 - 0x159b) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:12:30.474 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:12:30.475 Found net devices under 0000:84:00.0: cvl_0_0 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:12:30.475 Found net devices under 0000:84:00.1: cvl_0_1 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@440 -- # is_hw=yes 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:12:30.475 13:23:25 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:12:30.475 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:30.475 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.274 ms 00:12:30.475 00:12:30.475 --- 10.0.0.2 ping statistics --- 00:12:30.475 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:30.475 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:30.475 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:30.475 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:12:30.475 00:12:30.475 --- 10.0.0.1 ping statistics --- 00:12:30.475 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:30.475 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@448 -- # return 0 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@507 -- # nvmfpid=587599 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@508 -- # waitforlisten 587599 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@831 -- # '[' -z 587599 ']' 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:30.475 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:30.475 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.475 [2024-10-07 13:23:26.105894] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:30.475 [2024-10-07 13:23:26.105978] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:30.475 [2024-10-07 13:23:26.166266] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:30.475 [2024-10-07 13:23:26.268330] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:30.475 [2024-10-07 13:23:26.268396] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:30.475 [2024-10-07 13:23:26.268424] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:30.475 [2024-10-07 13:23:26.268435] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:30.475 [2024-10-07 13:23:26.268445] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:30.475 [2024-10-07 13:23:26.270229] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:30.476 [2024-10-07 13:23:26.270288] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:30.476 [2024-10-07 13:23:26.270397] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:30.476 [2024-10-07 13:23:26.270405] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:30.476 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:30.476 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@864 -- # return 0 00:12:30.476 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:30.476 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:30.476 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 [2024-10-07 13:23:26.424607] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 [2024-10-07 13:23:26.436903] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # jq length 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@49 -- # get_referral_ips rpc 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@50 -- # get_referral_ips nvme 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:12:30.733 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:12:30.990 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:12:30.990 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:12:30.990 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:12:30.990 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # jq length 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@57 -- # get_referral_ips nvme 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:12:30.991 13:23:26 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@65 -- # get_referral_ips rpc 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@66 -- # get_referral_ips nvme 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:12:31.248 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # jq -r .subnqn 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # jq -r .subnqn 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:31.505 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@73 -- # get_referral_ips rpc 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@74 -- # get_referral_ips nvme 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:12:31.763 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:12:32.021 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 00:12:32.021 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:12:32.021 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:12:32.021 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:12:32.021 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # jq -r .subnqn 00:12:32.021 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:32.021 13:23:27 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # jq -r .subnqn 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # jq length 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:32.279 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@83 -- # get_referral_ips nvme 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 8009 -o json 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@86 -- # nvmftestfini 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@121 -- # sync 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@124 -- # set +e 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:32.536 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:32.536 rmmod nvme_tcp 00:12:32.795 rmmod nvme_fabrics 00:12:32.795 rmmod nvme_keyring 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@128 -- # set -e 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@129 -- # return 0 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@515 -- # '[' -n 587599 ']' 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@516 -- # killprocess 587599 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@950 -- # '[' -z 587599 ']' 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@954 -- # kill -0 587599 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@955 -- # uname 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 587599 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@968 -- # echo 'killing process with pid 587599' 00:12:32.795 killing process with pid 587599 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@969 -- # kill 587599 00:12:32.795 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@974 -- # wait 587599 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@297 -- # iptr 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # iptables-save 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # iptables-restore 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@302 -- # remove_spdk_ns 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:33.054 13:23:28 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:34.963 13:23:30 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:12:34.963 00:12:34.963 real 0m7.328s 00:12:34.963 user 0m11.594s 00:12:34.963 sys 0m2.404s 00:12:34.963 13:23:30 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:34.963 13:23:30 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:12:34.963 ************************************ 00:12:34.963 END TEST nvmf_referrals 00:12:34.963 ************************************ 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@20 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:12:35.222 ************************************ 00:12:35.222 START TEST nvmf_connect_disconnect 00:12:35.222 ************************************ 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:12:35.222 * Looking for test storage... 00:12:35.222 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # lcov --version 00:12:35.222 13:23:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@336 -- # IFS=.-: 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@336 -- # read -ra ver1 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@337 -- # IFS=.-: 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@337 -- # read -ra ver2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@338 -- # local 'op=<' 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@340 -- # ver1_l=2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@341 -- # ver2_l=1 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@344 -- # case "$op" in 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@345 -- # : 1 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@365 -- # decimal 1 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@353 -- # local d=1 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@355 -- # echo 1 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@365 -- # ver1[v]=1 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@366 -- # decimal 2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@353 -- # local d=2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@355 -- # echo 2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@366 -- # ver2[v]=2 00:12:35.222 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@368 -- # return 0 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:35.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.223 --rc genhtml_branch_coverage=1 00:12:35.223 --rc genhtml_function_coverage=1 00:12:35.223 --rc genhtml_legend=1 00:12:35.223 --rc geninfo_all_blocks=1 00:12:35.223 --rc geninfo_unexecuted_blocks=1 00:12:35.223 00:12:35.223 ' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:35.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.223 --rc genhtml_branch_coverage=1 00:12:35.223 --rc genhtml_function_coverage=1 00:12:35.223 --rc genhtml_legend=1 00:12:35.223 --rc geninfo_all_blocks=1 00:12:35.223 --rc geninfo_unexecuted_blocks=1 00:12:35.223 00:12:35.223 ' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:35.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.223 --rc genhtml_branch_coverage=1 00:12:35.223 --rc genhtml_function_coverage=1 00:12:35.223 --rc genhtml_legend=1 00:12:35.223 --rc geninfo_all_blocks=1 00:12:35.223 --rc geninfo_unexecuted_blocks=1 00:12:35.223 00:12:35.223 ' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:35.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.223 --rc genhtml_branch_coverage=1 00:12:35.223 --rc genhtml_function_coverage=1 00:12:35.223 --rc genhtml_legend=1 00:12:35.223 --rc geninfo_all_blocks=1 00:12:35.223 --rc geninfo_unexecuted_blocks=1 00:12:35.223 00:12:35.223 ' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@7 -- # uname -s 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@15 -- # shopt -s extglob 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@5 -- # export PATH 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@51 -- # : 0 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:35.223 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@309 -- # xtrace_disable 00:12:35.223 13:23:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@315 -- # pci_devs=() 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@315 -- # local -a pci_devs 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@316 -- # pci_net_devs=() 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@317 -- # pci_drivers=() 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@317 -- # local -A pci_drivers 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@319 -- # net_devs=() 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@319 -- # local -ga net_devs 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@320 -- # e810=() 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@320 -- # local -ga e810 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@321 -- # x722=() 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@321 -- # local -ga x722 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@322 -- # mlx=() 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@322 -- # local -ga mlx 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:12:37.761 Found 0000:84:00.0 (0x8086 - 0x159b) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:12:37.761 Found 0000:84:00.1 (0x8086 - 0x159b) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:12:37.761 Found net devices under 0000:84:00.0: cvl_0_0 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:12:37.761 Found net devices under 0000:84:00.1: cvl_0_1 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:12:37.761 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@440 -- # is_hw=yes 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:12:37.762 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:37.762 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.199 ms 00:12:37.762 00:12:37.762 --- 10.0.0.2 ping statistics --- 00:12:37.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.762 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:37.762 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:37.762 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:12:37.762 00:12:37.762 --- 10.0.0.1 ping statistics --- 00:12:37.762 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.762 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@448 -- # return 0 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@507 -- # nvmfpid=589923 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@508 -- # waitforlisten 589923 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@831 -- # '[' -z 589923 ']' 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:37.762 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:37.762 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:37.762 [2024-10-07 13:23:33.477211] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:37.762 [2024-10-07 13:23:33.477291] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:37.762 [2024-10-07 13:23:33.544924] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:37.762 [2024-10-07 13:23:33.656533] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:37.762 [2024-10-07 13:23:33.656602] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:37.762 [2024-10-07 13:23:33.656629] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:37.762 [2024-10-07 13:23:33.656641] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:37.762 [2024-10-07 13:23:33.656652] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:37.762 [2024-10-07 13:23:33.658280] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:37.762 [2024-10-07 13:23:33.658380] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:37.762 [2024-10-07 13:23:33.658463] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:37.762 [2024-10-07 13:23:33.658466] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@864 -- # return 0 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:38.021 [2024-10-07 13:23:33.819690] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:38.021 [2024-10-07 13:23:33.876921] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:12:38.021 13:23:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@34 -- # set +x 00:12:41.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.869 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.393 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:49.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:52.195 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@121 -- # sync 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@124 -- # set +e 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:52.195 rmmod nvme_tcp 00:12:52.195 rmmod nvme_fabrics 00:12:52.195 rmmod nvme_keyring 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@128 -- # set -e 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@129 -- # return 0 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@515 -- # '[' -n 589923 ']' 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@516 -- # killprocess 589923 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@950 -- # '[' -z 589923 ']' 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@954 -- # kill -0 589923 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@955 -- # uname 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 589923 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@968 -- # echo 'killing process with pid 589923' 00:12:52.195 killing process with pid 589923 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@969 -- # kill 589923 00:12:52.195 13:23:47 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@974 -- # wait 589923 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@297 -- # iptr 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # iptables-save 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # iptables-restore 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@302 -- # remove_spdk_ns 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:52.195 13:23:48 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:12:54.730 00:12:54.730 real 0m19.195s 00:12:54.730 user 0m57.198s 00:12:54.730 sys 0m3.538s 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:12:54.730 ************************************ 00:12:54.730 END TEST nvmf_connect_disconnect 00:12:54.730 ************************************ 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@21 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:12:54.730 ************************************ 00:12:54.730 START TEST nvmf_multitarget 00:12:54.730 ************************************ 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:54.730 * Looking for test storage... 00:12:54.730 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # lcov --version 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@336 -- # IFS=.-: 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@336 -- # read -ra ver1 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@337 -- # IFS=.-: 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@337 -- # read -ra ver2 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@338 -- # local 'op=<' 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@340 -- # ver1_l=2 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@341 -- # ver2_l=1 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@344 -- # case "$op" in 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@345 -- # : 1 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@365 -- # decimal 1 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@353 -- # local d=1 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@355 -- # echo 1 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@365 -- # ver1[v]=1 00:12:54.730 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@366 -- # decimal 2 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@353 -- # local d=2 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@355 -- # echo 2 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@366 -- # ver2[v]=2 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@368 -- # return 0 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:54.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:54.731 --rc genhtml_branch_coverage=1 00:12:54.731 --rc genhtml_function_coverage=1 00:12:54.731 --rc genhtml_legend=1 00:12:54.731 --rc geninfo_all_blocks=1 00:12:54.731 --rc geninfo_unexecuted_blocks=1 00:12:54.731 00:12:54.731 ' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:54.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:54.731 --rc genhtml_branch_coverage=1 00:12:54.731 --rc genhtml_function_coverage=1 00:12:54.731 --rc genhtml_legend=1 00:12:54.731 --rc geninfo_all_blocks=1 00:12:54.731 --rc geninfo_unexecuted_blocks=1 00:12:54.731 00:12:54.731 ' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:54.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:54.731 --rc genhtml_branch_coverage=1 00:12:54.731 --rc genhtml_function_coverage=1 00:12:54.731 --rc genhtml_legend=1 00:12:54.731 --rc geninfo_all_blocks=1 00:12:54.731 --rc geninfo_unexecuted_blocks=1 00:12:54.731 00:12:54.731 ' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:54.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:54.731 --rc genhtml_branch_coverage=1 00:12:54.731 --rc genhtml_function_coverage=1 00:12:54.731 --rc genhtml_legend=1 00:12:54.731 --rc geninfo_all_blocks=1 00:12:54.731 --rc geninfo_unexecuted_blocks=1 00:12:54.731 00:12:54.731 ' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@7 -- # uname -s 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@15 -- # shopt -s extglob 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@5 -- # export PATH 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@51 -- # : 0 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:54.731 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@15 -- # nvmftestinit 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@309 -- # xtrace_disable 00:12:54.731 13:23:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@315 -- # pci_devs=() 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@315 -- # local -a pci_devs 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@316 -- # pci_net_devs=() 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@317 -- # pci_drivers=() 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@317 -- # local -A pci_drivers 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@319 -- # net_devs=() 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@319 -- # local -ga net_devs 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@320 -- # e810=() 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@320 -- # local -ga e810 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@321 -- # x722=() 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@321 -- # local -ga x722 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@322 -- # mlx=() 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@322 -- # local -ga mlx 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:12:56.636 Found 0000:84:00.0 (0x8086 - 0x159b) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:12:56.636 Found 0000:84:00.1 (0x8086 - 0x159b) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:12:56.636 Found net devices under 0000:84:00.0: cvl_0_0 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@416 -- # [[ up == up ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:12:56.636 Found net devices under 0000:84:00.1: cvl_0_1 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@440 -- # is_hw=yes 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:12:56.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:56.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:12:56.636 00:12:56.636 --- 10.0.0.2 ping statistics --- 00:12:56.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:56.636 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:56.636 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:56.636 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:12:56.636 00:12:56.636 --- 10.0.0.1 ping statistics --- 00:12:56.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:56.636 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@448 -- # return 0 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@507 -- # nvmfpid=593709 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@508 -- # waitforlisten 593709 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@831 -- # '[' -z 593709 ']' 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:56.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:56.636 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:12:56.894 [2024-10-07 13:23:52.577857] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:56.894 [2024-10-07 13:23:52.577937] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:56.894 [2024-10-07 13:23:52.640530] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:56.894 [2024-10-07 13:23:52.740400] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:56.894 [2024-10-07 13:23:52.740462] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:56.894 [2024-10-07 13:23:52.740491] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:56.894 [2024-10-07 13:23:52.740518] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:56.894 [2024-10-07 13:23:52.740528] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:56.894 [2024-10-07 13:23:52.742261] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:56.894 [2024-10-07 13:23:52.742371] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:56.894 [2024-10-07 13:23:52.742462] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:56.894 [2024-10-07 13:23:52.742471] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@864 -- # return 0 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:57.152 13:23:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # jq length 00:12:57.152 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:57.152 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:57.409 "nvmf_tgt_1" 00:12:57.409 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:57.409 "nvmf_tgt_2" 00:12:57.409 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:57.409 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # jq length 00:12:57.667 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:57.667 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:57.667 true 00:12:57.667 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:57.667 true 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # jq length 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@41 -- # nvmftestfini 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@121 -- # sync 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@124 -- # set +e 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:57.925 rmmod nvme_tcp 00:12:57.925 rmmod nvme_fabrics 00:12:57.925 rmmod nvme_keyring 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@128 -- # set -e 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@129 -- # return 0 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@515 -- # '[' -n 593709 ']' 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@516 -- # killprocess 593709 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@950 -- # '[' -z 593709 ']' 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@954 -- # kill -0 593709 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@955 -- # uname 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 593709 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@968 -- # echo 'killing process with pid 593709' 00:12:57.925 killing process with pid 593709 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@969 -- # kill 593709 00:12:57.925 13:23:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@974 -- # wait 593709 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@297 -- # iptr 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # iptables-save 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # iptables-restore 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@302 -- # remove_spdk_ns 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:58.183 13:23:54 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:13:00.717 00:13:00.717 real 0m5.955s 00:13:00.717 user 0m6.862s 00:13:00.717 sys 0m1.956s 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:13:00.717 ************************************ 00:13:00.717 END TEST nvmf_multitarget 00:13:00.717 ************************************ 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@22 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:13:00.717 ************************************ 00:13:00.717 START TEST nvmf_rpc 00:13:00.717 ************************************ 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:00.717 * Looking for test storage... 00:13:00.717 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@344 -- # case "$op" in 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@345 -- # : 1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@365 -- # decimal 1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@353 -- # local d=1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@355 -- # echo 1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@366 -- # decimal 2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@353 -- # local d=2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@355 -- # echo 2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@368 -- # return 0 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:00.717 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:00.717 --rc genhtml_branch_coverage=1 00:13:00.717 --rc genhtml_function_coverage=1 00:13:00.717 --rc genhtml_legend=1 00:13:00.717 --rc geninfo_all_blocks=1 00:13:00.717 --rc geninfo_unexecuted_blocks=1 00:13:00.717 00:13:00.717 ' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:00.717 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:00.717 --rc genhtml_branch_coverage=1 00:13:00.717 --rc genhtml_function_coverage=1 00:13:00.717 --rc genhtml_legend=1 00:13:00.717 --rc geninfo_all_blocks=1 00:13:00.717 --rc geninfo_unexecuted_blocks=1 00:13:00.717 00:13:00.717 ' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:00.717 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:00.717 --rc genhtml_branch_coverage=1 00:13:00.717 --rc genhtml_function_coverage=1 00:13:00.717 --rc genhtml_legend=1 00:13:00.717 --rc geninfo_all_blocks=1 00:13:00.717 --rc geninfo_unexecuted_blocks=1 00:13:00.717 00:13:00.717 ' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:00.717 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:00.717 --rc genhtml_branch_coverage=1 00:13:00.717 --rc genhtml_function_coverage=1 00:13:00.717 --rc genhtml_legend=1 00:13:00.717 --rc geninfo_all_blocks=1 00:13:00.717 --rc geninfo_unexecuted_blocks=1 00:13:00.717 00:13:00.717 ' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@7 -- # uname -s 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@15 -- # shopt -s extglob 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@5 -- # export PATH 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@51 -- # : 0 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:00.717 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:00.718 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@11 -- # loops=5 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@23 -- # nvmftestinit 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@309 -- # xtrace_disable 00:13:00.718 13:23:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@315 -- # pci_devs=() 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@315 -- # local -a pci_devs 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@316 -- # pci_net_devs=() 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@317 -- # pci_drivers=() 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@317 -- # local -A pci_drivers 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@319 -- # net_devs=() 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@319 -- # local -ga net_devs 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@320 -- # e810=() 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@320 -- # local -ga e810 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@321 -- # x722=() 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@321 -- # local -ga x722 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@322 -- # mlx=() 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@322 -- # local -ga mlx 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:13:02.619 Found 0000:84:00.0 (0x8086 - 0x159b) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:13:02.619 Found 0000:84:00.1 (0x8086 - 0x159b) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:13:02.619 Found net devices under 0000:84:00.0: cvl_0_0 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:13:02.619 Found net devices under 0000:84:00.1: cvl_0_1 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@440 -- # is_hw=yes 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:13:02.619 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:13:02.878 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:02.878 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:13:02.878 00:13:02.878 --- 10.0.0.2 ping statistics --- 00:13:02.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.878 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:02.878 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:02.878 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:13:02.878 00:13:02.878 --- 10.0.0.1 ping statistics --- 00:13:02.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.878 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@448 -- # return 0 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@507 -- # nvmfpid=595944 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@508 -- # waitforlisten 595944 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@831 -- # '[' -z 595944 ']' 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:02.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:02.878 13:23:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:02.878 [2024-10-07 13:23:58.748549] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:02.878 [2024-10-07 13:23:58.748633] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:02.878 [2024-10-07 13:23:58.811651] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:03.135 [2024-10-07 13:23:58.917491] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:03.135 [2024-10-07 13:23:58.917566] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:03.135 [2024-10-07 13:23:58.917588] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:03.135 [2024-10-07 13:23:58.917601] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:03.135 [2024-10-07 13:23:58.917611] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:03.135 [2024-10-07 13:23:58.919204] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:13:03.135 [2024-10-07 13:23:58.919314] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:13:03.135 [2024-10-07 13:23:58.919388] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:13:03.135 [2024-10-07 13:23:58.919391] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:13:03.135 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:03.135 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@864 -- # return 0 00:13:03.136 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:13:03.136 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:03.136 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.136 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:03.136 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:03.136 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.136 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@26 -- # stats='{ 00:13:03.394 "tick_rate": 2700000000, 00:13:03.394 "poll_groups": [ 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_000", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [] 00:13:03.394 }, 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_001", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [] 00:13:03.394 }, 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_002", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [] 00:13:03.394 }, 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_003", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [] 00:13:03.394 } 00:13:03.394 ] 00:13:03.394 }' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@15 -- # wc -l 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.394 [2024-10-07 13:23:59.163620] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@33 -- # stats='{ 00:13:03.394 "tick_rate": 2700000000, 00:13:03.394 "poll_groups": [ 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_000", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [ 00:13:03.394 { 00:13:03.394 "trtype": "TCP" 00:13:03.394 } 00:13:03.394 ] 00:13:03.394 }, 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_001", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [ 00:13:03.394 { 00:13:03.394 "trtype": "TCP" 00:13:03.394 } 00:13:03.394 ] 00:13:03.394 }, 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_002", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [ 00:13:03.394 { 00:13:03.394 "trtype": "TCP" 00:13:03.394 } 00:13:03.394 ] 00:13:03.394 }, 00:13:03.394 { 00:13:03.394 "name": "nvmf_tgt_poll_group_003", 00:13:03.394 "admin_qpairs": 0, 00:13:03.394 "io_qpairs": 0, 00:13:03.394 "current_admin_qpairs": 0, 00:13:03.394 "current_io_qpairs": 0, 00:13:03.394 "pending_bdev_io": 0, 00:13:03.394 "completed_nvme_io": 0, 00:13:03.394 "transports": [ 00:13:03.394 { 00:13:03.394 "trtype": "TCP" 00:13:03.394 } 00:13:03.394 ] 00:13:03.394 } 00:13:03.394 ] 00:13:03.394 }' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.394 Malloc1 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.394 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.395 [2024-10-07 13:23:59.316811] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -a 10.0.0.2 -s 4420 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@650 -- # local es=0 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -a 10.0.0.2 -s 4420 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # type -t nvme 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # type -P nvme 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:03.395 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -a 10.0.0.2 -s 4420 00:13:03.652 [2024-10-07 13:23:59.339448] ctrlr.c: 823:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02' 00:13:03.652 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:03.652 could not add new controller: failed to write to nvme-fabrics device 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # es=1 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.652 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:04.217 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:04.217 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:13:04.217 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:04.217 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:04.217 13:23:59 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:13:06.112 13:24:01 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:06.112 13:24:01 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:06.112 13:24:01 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:06.112 13:24:01 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:06.112 13:24:01 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:06.112 13:24:01 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:13:06.112 13:24:01 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:06.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@650 -- # local es=0 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # type -t nvme 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:06.370 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # type -P nvme 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.371 [2024-10-07 13:24:02.109692] ctrlr.c: 823:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02' 00:13:06.371 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:06.371 could not add new controller: failed to write to nvme-fabrics device 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # es=1 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.371 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.935 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:06.935 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:13:06.935 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:06.935 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:06.935 13:24:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:09.461 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # seq 1 5 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:09.461 [2024-10-07 13:24:04.917830] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.461 13:24:04 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.719 13:24:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:09.719 13:24:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:13:09.719 13:24:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:09.719 13:24:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:09.719 13:24:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:13:11.617 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:11.617 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:11.617 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:11.875 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:13:11.875 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:11.876 [2024-10-07 13:24:07.717850] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.876 13:24:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:12.808 13:24:08 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:12.808 13:24:08 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:13:12.808 13:24:08 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:12.808 13:24:08 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:12.808 13:24:08 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:14.763 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:14.763 [2024-10-07 13:24:10.541893] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.763 13:24:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:15.328 13:24:11 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:15.328 13:24:11 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:13:15.328 13:24:11 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:15.328 13:24:11 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:15.328 13:24:11 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:17.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:17.853 [2024-10-07 13:24:13.332126] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.853 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.112 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:18.112 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:13:18.112 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:18.112 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:18.112 13:24:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:13:20.639 13:24:15 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:20.639 13:24:15 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:20.639 13:24:15 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:20.639 13:24:15 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:20.639 13:24:15 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:20.639 13:24:15 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:13:20.639 13:24:15 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:20.639 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:20.639 [2024-10-07 13:24:16.071037] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.639 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:20.897 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:20.897 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:13:20.897 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:20.897 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:20.897 13:24:16 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:23.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # seq 1 5 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 [2024-10-07 13:24:18.956186] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.423 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:23.424 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.424 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:18 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 [2024-10-07 13:24:19.004197] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 [2024-10-07 13:24:19.052361] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 [2024-10-07 13:24:19.100567] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.424 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.425 [2024-10-07 13:24:19.148718] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@110 -- # stats='{ 00:13:23.425 "tick_rate": 2700000000, 00:13:23.425 "poll_groups": [ 00:13:23.425 { 00:13:23.425 "name": "nvmf_tgt_poll_group_000", 00:13:23.425 "admin_qpairs": 2, 00:13:23.425 "io_qpairs": 84, 00:13:23.425 "current_admin_qpairs": 0, 00:13:23.425 "current_io_qpairs": 0, 00:13:23.425 "pending_bdev_io": 0, 00:13:23.425 "completed_nvme_io": 184, 00:13:23.425 "transports": [ 00:13:23.425 { 00:13:23.425 "trtype": "TCP" 00:13:23.425 } 00:13:23.425 ] 00:13:23.425 }, 00:13:23.425 { 00:13:23.425 "name": "nvmf_tgt_poll_group_001", 00:13:23.425 "admin_qpairs": 2, 00:13:23.425 "io_qpairs": 84, 00:13:23.425 "current_admin_qpairs": 0, 00:13:23.425 "current_io_qpairs": 0, 00:13:23.425 "pending_bdev_io": 0, 00:13:23.425 "completed_nvme_io": 183, 00:13:23.425 "transports": [ 00:13:23.425 { 00:13:23.425 "trtype": "TCP" 00:13:23.425 } 00:13:23.425 ] 00:13:23.425 }, 00:13:23.425 { 00:13:23.425 "name": "nvmf_tgt_poll_group_002", 00:13:23.425 "admin_qpairs": 1, 00:13:23.425 "io_qpairs": 84, 00:13:23.425 "current_admin_qpairs": 0, 00:13:23.425 "current_io_qpairs": 0, 00:13:23.425 "pending_bdev_io": 0, 00:13:23.425 "completed_nvme_io": 183, 00:13:23.425 "transports": [ 00:13:23.425 { 00:13:23.425 "trtype": "TCP" 00:13:23.425 } 00:13:23.425 ] 00:13:23.425 }, 00:13:23.425 { 00:13:23.425 "name": "nvmf_tgt_poll_group_003", 00:13:23.425 "admin_qpairs": 2, 00:13:23.425 "io_qpairs": 84, 00:13:23.425 "current_admin_qpairs": 0, 00:13:23.425 "current_io_qpairs": 0, 00:13:23.425 "pending_bdev_io": 0, 00:13:23.425 "completed_nvme_io": 136, 00:13:23.425 "transports": [ 00:13:23.425 { 00:13:23.425 "trtype": "TCP" 00:13:23.425 } 00:13:23.425 ] 00:13:23.425 } 00:13:23.425 ] 00:13:23.425 }' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@123 -- # nvmftestfini 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@121 -- # sync 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:23.425 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@124 -- # set +e 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:23.426 rmmod nvme_tcp 00:13:23.426 rmmod nvme_fabrics 00:13:23.426 rmmod nvme_keyring 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@128 -- # set -e 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@129 -- # return 0 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@515 -- # '[' -n 595944 ']' 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@516 -- # killprocess 595944 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@950 -- # '[' -z 595944 ']' 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@954 -- # kill -0 595944 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@955 -- # uname 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:23.426 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 595944 00:13:23.684 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:13:23.684 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:13:23.684 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 595944' 00:13:23.684 killing process with pid 595944 00:13:23.684 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@969 -- # kill 595944 00:13:23.684 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@974 -- # wait 595944 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@297 -- # iptr 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # iptables-save 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # iptables-restore 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@302 -- # remove_spdk_ns 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:23.944 13:24:19 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:13:25.852 00:13:25.852 real 0m25.536s 00:13:25.852 user 1m22.292s 00:13:25.852 sys 0m4.279s 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:13:25.852 ************************************ 00:13:25.852 END TEST nvmf_rpc 00:13:25.852 ************************************ 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@23 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:13:25.852 ************************************ 00:13:25.852 START TEST nvmf_invalid 00:13:25.852 ************************************ 00:13:25.852 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:26.111 * Looking for test storage... 00:13:26.111 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # lcov --version 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@336 -- # IFS=.-: 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@336 -- # read -ra ver1 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@337 -- # IFS=.-: 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@337 -- # read -ra ver2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@338 -- # local 'op=<' 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@340 -- # ver1_l=2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@341 -- # ver2_l=1 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@344 -- # case "$op" in 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@345 -- # : 1 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@365 -- # decimal 1 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@353 -- # local d=1 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@355 -- # echo 1 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@365 -- # ver1[v]=1 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@366 -- # decimal 2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@353 -- # local d=2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@355 -- # echo 2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@366 -- # ver2[v]=2 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@368 -- # return 0 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:26.111 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:26.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.112 --rc genhtml_branch_coverage=1 00:13:26.112 --rc genhtml_function_coverage=1 00:13:26.112 --rc genhtml_legend=1 00:13:26.112 --rc geninfo_all_blocks=1 00:13:26.112 --rc geninfo_unexecuted_blocks=1 00:13:26.112 00:13:26.112 ' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:26.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.112 --rc genhtml_branch_coverage=1 00:13:26.112 --rc genhtml_function_coverage=1 00:13:26.112 --rc genhtml_legend=1 00:13:26.112 --rc geninfo_all_blocks=1 00:13:26.112 --rc geninfo_unexecuted_blocks=1 00:13:26.112 00:13:26.112 ' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:26.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.112 --rc genhtml_branch_coverage=1 00:13:26.112 --rc genhtml_function_coverage=1 00:13:26.112 --rc genhtml_legend=1 00:13:26.112 --rc geninfo_all_blocks=1 00:13:26.112 --rc geninfo_unexecuted_blocks=1 00:13:26.112 00:13:26.112 ' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:26.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:26.112 --rc genhtml_branch_coverage=1 00:13:26.112 --rc genhtml_function_coverage=1 00:13:26.112 --rc genhtml_legend=1 00:13:26.112 --rc geninfo_all_blocks=1 00:13:26.112 --rc geninfo_unexecuted_blocks=1 00:13:26.112 00:13:26.112 ' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@7 -- # uname -s 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@15 -- # shopt -s extglob 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@5 -- # export PATH 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@51 -- # : 0 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:26.112 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@14 -- # target=foobar 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@16 -- # RANDOM=0 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@34 -- # nvmftestinit 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@309 -- # xtrace_disable 00:13:26.112 13:24:21 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@315 -- # pci_devs=() 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@315 -- # local -a pci_devs 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@316 -- # pci_net_devs=() 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@317 -- # pci_drivers=() 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@317 -- # local -A pci_drivers 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@319 -- # net_devs=() 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@319 -- # local -ga net_devs 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@320 -- # e810=() 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@320 -- # local -ga e810 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@321 -- # x722=() 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@321 -- # local -ga x722 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@322 -- # mlx=() 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@322 -- # local -ga mlx 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:13:28.645 Found 0000:84:00.0 (0x8086 - 0x159b) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:13:28.645 Found 0000:84:00.1 (0x8086 - 0x159b) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:28.645 13:24:23 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:13:28.645 Found net devices under 0000:84:00.0: cvl_0_0 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:13:28.645 Found net devices under 0000:84:00.1: cvl_0_1 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@440 -- # is_hw=yes 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:13:28.645 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:28.645 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:13:28.645 00:13:28.645 --- 10.0.0.2 ping statistics --- 00:13:28.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:28.645 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:28.645 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:28.645 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:13:28.645 00:13:28.645 --- 10.0.0.1 ping statistics --- 00:13:28.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:28.645 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:13:28.645 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@448 -- # return 0 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@507 -- # nvmfpid=601081 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@508 -- # waitforlisten 601081 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@831 -- # '[' -z 601081 ']' 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:28.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:13:28.646 [2024-10-07 13:24:24.215188] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:28.646 [2024-10-07 13:24:24.215264] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:28.646 [2024-10-07 13:24:24.281808] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:28.646 [2024-10-07 13:24:24.389564] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:28.646 [2024-10-07 13:24:24.389625] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:28.646 [2024-10-07 13:24:24.389666] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:28.646 [2024-10-07 13:24:24.389677] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:28.646 [2024-10-07 13:24:24.389688] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:28.646 [2024-10-07 13:24:24.391318] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:13:28.646 [2024-10-07 13:24:24.391388] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:13:28.646 [2024-10-07 13:24:24.391501] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:13:28.646 [2024-10-07 13:24:24.391506] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@864 -- # return 0 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:28.646 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode543 00:13:28.904 [2024-10-07 13:24:24.798176] nvmf_rpc.c: 396:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:28.904 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@40 -- # out='request: 00:13:28.904 { 00:13:28.904 "nqn": "nqn.2016-06.io.spdk:cnode543", 00:13:28.904 "tgt_name": "foobar", 00:13:28.904 "method": "nvmf_create_subsystem", 00:13:28.904 "req_id": 1 00:13:28.904 } 00:13:28.904 Got JSON-RPC error response 00:13:28.904 response: 00:13:28.904 { 00:13:28.904 "code": -32603, 00:13:28.904 "message": "Unable to find target foobar" 00:13:28.904 }' 00:13:28.904 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@41 -- # [[ request: 00:13:28.904 { 00:13:28.904 "nqn": "nqn.2016-06.io.spdk:cnode543", 00:13:28.904 "tgt_name": "foobar", 00:13:28.904 "method": "nvmf_create_subsystem", 00:13:28.904 "req_id": 1 00:13:28.904 } 00:13:28.904 Got JSON-RPC error response 00:13:28.904 response: 00:13:28.904 { 00:13:28.904 "code": -32603, 00:13:28.904 "message": "Unable to find target foobar" 00:13:28.904 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:28.904 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:28.904 13:24:24 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode11426 00:13:29.161 [2024-10-07 13:24:25.079158] nvmf_rpc.c: 413:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11426: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:29.418 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # out='request: 00:13:29.418 { 00:13:29.419 "nqn": "nqn.2016-06.io.spdk:cnode11426", 00:13:29.419 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:29.419 "method": "nvmf_create_subsystem", 00:13:29.419 "req_id": 1 00:13:29.419 } 00:13:29.419 Got JSON-RPC error response 00:13:29.419 response: 00:13:29.419 { 00:13:29.419 "code": -32602, 00:13:29.419 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:29.419 }' 00:13:29.419 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@46 -- # [[ request: 00:13:29.419 { 00:13:29.419 "nqn": "nqn.2016-06.io.spdk:cnode11426", 00:13:29.419 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:29.419 "method": "nvmf_create_subsystem", 00:13:29.419 "req_id": 1 00:13:29.419 } 00:13:29.419 Got JSON-RPC error response 00:13:29.419 response: 00:13:29.419 { 00:13:29.419 "code": -32602, 00:13:29.419 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:29.419 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:29.419 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:29.419 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode3001 00:13:29.419 [2024-10-07 13:24:25.344034] nvmf_rpc.c: 422:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3001: invalid model number 'SPDK_Controller' 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # out='request: 00:13:29.676 { 00:13:29.676 "nqn": "nqn.2016-06.io.spdk:cnode3001", 00:13:29.676 "model_number": "SPDK_Controller\u001f", 00:13:29.676 "method": "nvmf_create_subsystem", 00:13:29.676 "req_id": 1 00:13:29.676 } 00:13:29.676 Got JSON-RPC error response 00:13:29.676 response: 00:13:29.676 { 00:13:29.676 "code": -32602, 00:13:29.676 "message": "Invalid MN SPDK_Controller\u001f" 00:13:29.676 }' 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@51 -- # [[ request: 00:13:29.676 { 00:13:29.676 "nqn": "nqn.2016-06.io.spdk:cnode3001", 00:13:29.676 "model_number": "SPDK_Controller\u001f", 00:13:29.676 "method": "nvmf_create_subsystem", 00:13:29.676 "req_id": 1 00:13:29.676 } 00:13:29.676 Got JSON-RPC error response 00:13:29.676 response: 00:13:29.676 { 00:13:29.676 "code": -32602, 00:13:29.676 "message": "Invalid MN SPDK_Controller\u001f" 00:13:29.676 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # gen_random_s 21 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@19 -- # local length=21 ll 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # local chars 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@22 -- # local string 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 124 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='|' 00:13:29.676 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 39 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=\' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 45 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=- 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 67 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=C 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 49 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=1 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 44 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=, 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 118 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=v 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 41 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=')' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 124 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='|' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 37 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=% 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 115 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=s 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 85 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=U 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 95 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=_ 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 41 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=')' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 65 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=A 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 70 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=F 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 98 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=b 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 66 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=B 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 127 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=$'\177' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 67 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=C 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 35 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='#' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@28 -- # [[ | == \- ]] 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@31 -- # echo '|'\''-C1,v)|%sU_)AFbBC#' 00:13:29.677 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '|'\''-C1,v)|%sU_)AFbBC#' nqn.2016-06.io.spdk:cnode7484 00:13:29.936 [2024-10-07 13:24:25.685210] nvmf_rpc.c: 413:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7484: invalid serial number '|'-C1,v)|%sU_)AFbBC#' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # out='request: 00:13:29.936 { 00:13:29.936 "nqn": "nqn.2016-06.io.spdk:cnode7484", 00:13:29.936 "serial_number": "|'\''-C1,v)|%sU_)AFbB\u007fC#", 00:13:29.936 "method": "nvmf_create_subsystem", 00:13:29.936 "req_id": 1 00:13:29.936 } 00:13:29.936 Got JSON-RPC error response 00:13:29.936 response: 00:13:29.936 { 00:13:29.936 "code": -32602, 00:13:29.936 "message": "Invalid SN |'\''-C1,v)|%sU_)AFbB\u007fC#" 00:13:29.936 }' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@55 -- # [[ request: 00:13:29.936 { 00:13:29.936 "nqn": "nqn.2016-06.io.spdk:cnode7484", 00:13:29.936 "serial_number": "|'-C1,v)|%sU_)AFbB\u007fC#", 00:13:29.936 "method": "nvmf_create_subsystem", 00:13:29.936 "req_id": 1 00:13:29.936 } 00:13:29.936 Got JSON-RPC error response 00:13:29.936 response: 00:13:29.936 { 00:13:29.936 "code": -32602, 00:13:29.936 "message": "Invalid SN |'-C1,v)|%sU_)AFbB\u007fC#" 00:13:29.936 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # gen_random_s 41 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@19 -- # local length=41 ll 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # local chars 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@22 -- # local string 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 44 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=, 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 89 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Y 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 76 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=L 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 97 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=a 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 89 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Y 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 91 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5b' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='[' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 75 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=K 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 104 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=h 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 123 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='{' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 81 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Q 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 46 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=. 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 75 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=K 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 99 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=c 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.936 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 51 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x33' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=3 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 84 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x54' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=T 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 67 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=C 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 83 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=S 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 44 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=, 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 64 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=@ 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 82 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=R 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 58 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=: 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 82 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=R 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 83 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=S 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 117 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=u 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 69 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=E 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 44 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=, 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 78 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=N 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 61 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3d' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+== 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 118 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=v 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 82 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=R 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 122 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=z 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 58 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=: 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 107 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=k 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 105 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=i 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 47 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=/ 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 52 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x34' 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=4 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.937 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 45 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=- 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 43 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=+ 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 80 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=P 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 69 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=E 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 105 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=i 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@28 -- # [[ , == \- ]] 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@31 -- # echo ',YLaY[Kh{Q.Kc3TCS,@R:RSuE,N=vRz:ki/4-+PEi' 00:13:29.938 13:24:25 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d ',YLaY[Kh{Q.Kc3TCS,@R:RSuE,N=vRz:ki/4-+PEi' nqn.2016-06.io.spdk:cnode7079 00:13:30.195 [2024-10-07 13:24:26.126614] nvmf_rpc.c: 422:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7079: invalid model number ',YLaY[Kh{Q.Kc3TCS,@R:RSuE,N=vRz:ki/4-+PEi' 00:13:30.453 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # out='request: 00:13:30.453 { 00:13:30.453 "nqn": "nqn.2016-06.io.spdk:cnode7079", 00:13:30.453 "model_number": ",YLaY[Kh{Q.Kc3TCS,@R:RSuE,N=vRz:ki/4-+PEi", 00:13:30.453 "method": "nvmf_create_subsystem", 00:13:30.453 "req_id": 1 00:13:30.453 } 00:13:30.453 Got JSON-RPC error response 00:13:30.453 response: 00:13:30.453 { 00:13:30.453 "code": -32602, 00:13:30.453 "message": "Invalid MN ,YLaY[Kh{Q.Kc3TCS,@R:RSuE,N=vRz:ki/4-+PEi" 00:13:30.453 }' 00:13:30.453 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@59 -- # [[ request: 00:13:30.453 { 00:13:30.453 "nqn": "nqn.2016-06.io.spdk:cnode7079", 00:13:30.453 "model_number": ",YLaY[Kh{Q.Kc3TCS,@R:RSuE,N=vRz:ki/4-+PEi", 00:13:30.453 "method": "nvmf_create_subsystem", 00:13:30.453 "req_id": 1 00:13:30.453 } 00:13:30.453 Got JSON-RPC error response 00:13:30.453 response: 00:13:30.453 { 00:13:30.453 "code": -32602, 00:13:30.453 "message": "Invalid MN ,YLaY[Kh{Q.Kc3TCS,@R:RSuE,N=vRz:ki/4-+PEi" 00:13:30.453 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:30.453 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:30.711 [2024-10-07 13:24:26.387553] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:30.711 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:30.968 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:30.968 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # echo '' 00:13:30.968 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # head -n 1 00:13:30.968 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # IP= 00:13:30.968 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:31.225 [2024-10-07 13:24:26.937314] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:31.225 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@69 -- # out='request: 00:13:31.225 { 00:13:31.225 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:31.225 "listen_address": { 00:13:31.225 "trtype": "tcp", 00:13:31.225 "traddr": "", 00:13:31.225 "trsvcid": "4421" 00:13:31.225 }, 00:13:31.225 "method": "nvmf_subsystem_remove_listener", 00:13:31.225 "req_id": 1 00:13:31.225 } 00:13:31.225 Got JSON-RPC error response 00:13:31.225 response: 00:13:31.225 { 00:13:31.225 "code": -32602, 00:13:31.225 "message": "Invalid parameters" 00:13:31.225 }' 00:13:31.225 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@70 -- # [[ request: 00:13:31.225 { 00:13:31.225 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:31.225 "listen_address": { 00:13:31.225 "trtype": "tcp", 00:13:31.225 "traddr": "", 00:13:31.225 "trsvcid": "4421" 00:13:31.225 }, 00:13:31.225 "method": "nvmf_subsystem_remove_listener", 00:13:31.225 "req_id": 1 00:13:31.225 } 00:13:31.225 Got JSON-RPC error response 00:13:31.225 response: 00:13:31.225 { 00:13:31.225 "code": -32602, 00:13:31.225 "message": "Invalid parameters" 00:13:31.225 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:31.225 13:24:26 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11660 -i 0 00:13:31.482 [2024-10-07 13:24:27.218228] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11660: invalid cntlid range [0-65519] 00:13:31.482 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@73 -- # out='request: 00:13:31.482 { 00:13:31.482 "nqn": "nqn.2016-06.io.spdk:cnode11660", 00:13:31.482 "min_cntlid": 0, 00:13:31.482 "method": "nvmf_create_subsystem", 00:13:31.482 "req_id": 1 00:13:31.482 } 00:13:31.482 Got JSON-RPC error response 00:13:31.482 response: 00:13:31.482 { 00:13:31.482 "code": -32602, 00:13:31.482 "message": "Invalid cntlid range [0-65519]" 00:13:31.482 }' 00:13:31.482 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@74 -- # [[ request: 00:13:31.482 { 00:13:31.483 "nqn": "nqn.2016-06.io.spdk:cnode11660", 00:13:31.483 "min_cntlid": 0, 00:13:31.483 "method": "nvmf_create_subsystem", 00:13:31.483 "req_id": 1 00:13:31.483 } 00:13:31.483 Got JSON-RPC error response 00:13:31.483 response: 00:13:31.483 { 00:13:31.483 "code": -32602, 00:13:31.483 "message": "Invalid cntlid range [0-65519]" 00:13:31.483 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:31.483 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8769 -i 65520 00:13:31.740 [2024-10-07 13:24:27.483142] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8769: invalid cntlid range [65520-65519] 00:13:31.740 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@75 -- # out='request: 00:13:31.740 { 00:13:31.740 "nqn": "nqn.2016-06.io.spdk:cnode8769", 00:13:31.740 "min_cntlid": 65520, 00:13:31.740 "method": "nvmf_create_subsystem", 00:13:31.740 "req_id": 1 00:13:31.740 } 00:13:31.740 Got JSON-RPC error response 00:13:31.740 response: 00:13:31.740 { 00:13:31.740 "code": -32602, 00:13:31.740 "message": "Invalid cntlid range [65520-65519]" 00:13:31.740 }' 00:13:31.740 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@76 -- # [[ request: 00:13:31.740 { 00:13:31.740 "nqn": "nqn.2016-06.io.spdk:cnode8769", 00:13:31.740 "min_cntlid": 65520, 00:13:31.740 "method": "nvmf_create_subsystem", 00:13:31.740 "req_id": 1 00:13:31.740 } 00:13:31.740 Got JSON-RPC error response 00:13:31.740 response: 00:13:31.740 { 00:13:31.740 "code": -32602, 00:13:31.740 "message": "Invalid cntlid range [65520-65519]" 00:13:31.740 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:31.740 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1772 -I 0 00:13:31.998 [2024-10-07 13:24:27.756037] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1772: invalid cntlid range [1-0] 00:13:31.998 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@77 -- # out='request: 00:13:31.998 { 00:13:31.998 "nqn": "nqn.2016-06.io.spdk:cnode1772", 00:13:31.998 "max_cntlid": 0, 00:13:31.998 "method": "nvmf_create_subsystem", 00:13:31.998 "req_id": 1 00:13:31.998 } 00:13:31.998 Got JSON-RPC error response 00:13:31.998 response: 00:13:31.998 { 00:13:31.998 "code": -32602, 00:13:31.998 "message": "Invalid cntlid range [1-0]" 00:13:31.998 }' 00:13:31.998 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@78 -- # [[ request: 00:13:31.998 { 00:13:31.998 "nqn": "nqn.2016-06.io.spdk:cnode1772", 00:13:31.998 "max_cntlid": 0, 00:13:31.998 "method": "nvmf_create_subsystem", 00:13:31.998 "req_id": 1 00:13:31.998 } 00:13:31.998 Got JSON-RPC error response 00:13:31.998 response: 00:13:31.998 { 00:13:31.998 "code": -32602, 00:13:31.998 "message": "Invalid cntlid range [1-0]" 00:13:31.998 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:31.998 13:24:27 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode28533 -I 65520 00:13:32.255 [2024-10-07 13:24:28.016879] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28533: invalid cntlid range [1-65520] 00:13:32.255 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@79 -- # out='request: 00:13:32.255 { 00:13:32.255 "nqn": "nqn.2016-06.io.spdk:cnode28533", 00:13:32.255 "max_cntlid": 65520, 00:13:32.255 "method": "nvmf_create_subsystem", 00:13:32.255 "req_id": 1 00:13:32.255 } 00:13:32.255 Got JSON-RPC error response 00:13:32.255 response: 00:13:32.255 { 00:13:32.255 "code": -32602, 00:13:32.255 "message": "Invalid cntlid range [1-65520]" 00:13:32.255 }' 00:13:32.255 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@80 -- # [[ request: 00:13:32.255 { 00:13:32.255 "nqn": "nqn.2016-06.io.spdk:cnode28533", 00:13:32.255 "max_cntlid": 65520, 00:13:32.255 "method": "nvmf_create_subsystem", 00:13:32.255 "req_id": 1 00:13:32.255 } 00:13:32.255 Got JSON-RPC error response 00:13:32.255 response: 00:13:32.255 { 00:13:32.255 "code": -32602, 00:13:32.255 "message": "Invalid cntlid range [1-65520]" 00:13:32.255 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:32.255 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode21467 -i 6 -I 5 00:13:32.513 [2024-10-07 13:24:28.293797] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21467: invalid cntlid range [6-5] 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@83 -- # out='request: 00:13:32.513 { 00:13:32.513 "nqn": "nqn.2016-06.io.spdk:cnode21467", 00:13:32.513 "min_cntlid": 6, 00:13:32.513 "max_cntlid": 5, 00:13:32.513 "method": "nvmf_create_subsystem", 00:13:32.513 "req_id": 1 00:13:32.513 } 00:13:32.513 Got JSON-RPC error response 00:13:32.513 response: 00:13:32.513 { 00:13:32.513 "code": -32602, 00:13:32.513 "message": "Invalid cntlid range [6-5]" 00:13:32.513 }' 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@84 -- # [[ request: 00:13:32.513 { 00:13:32.513 "nqn": "nqn.2016-06.io.spdk:cnode21467", 00:13:32.513 "min_cntlid": 6, 00:13:32.513 "max_cntlid": 5, 00:13:32.513 "method": "nvmf_create_subsystem", 00:13:32.513 "req_id": 1 00:13:32.513 } 00:13:32.513 Got JSON-RPC error response 00:13:32.513 response: 00:13:32.513 { 00:13:32.513 "code": -32602, 00:13:32.513 "message": "Invalid cntlid range [6-5]" 00:13:32.513 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@87 -- # out='request: 00:13:32.513 { 00:13:32.513 "name": "foobar", 00:13:32.513 "method": "nvmf_delete_target", 00:13:32.513 "req_id": 1 00:13:32.513 } 00:13:32.513 Got JSON-RPC error response 00:13:32.513 response: 00:13:32.513 { 00:13:32.513 "code": -32602, 00:13:32.513 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:32.513 }' 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@88 -- # [[ request: 00:13:32.513 { 00:13:32.513 "name": "foobar", 00:13:32.513 "method": "nvmf_delete_target", 00:13:32.513 "req_id": 1 00:13:32.513 } 00:13:32.513 Got JSON-RPC error response 00:13:32.513 response: 00:13:32.513 { 00:13:32.513 "code": -32602, 00:13:32.513 "message": "The specified target doesn't exist, cannot delete it." 00:13:32.513 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@91 -- # nvmftestfini 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@121 -- # sync 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@124 -- # set +e 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:32.513 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:32.513 rmmod nvme_tcp 00:13:32.771 rmmod nvme_fabrics 00:13:32.771 rmmod nvme_keyring 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@128 -- # set -e 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@129 -- # return 0 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@515 -- # '[' -n 601081 ']' 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@516 -- # killprocess 601081 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@950 -- # '[' -z 601081 ']' 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@954 -- # kill -0 601081 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@955 -- # uname 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 601081 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@968 -- # echo 'killing process with pid 601081' 00:13:32.771 killing process with pid 601081 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@969 -- # kill 601081 00:13:32.771 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@974 -- # wait 601081 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@297 -- # iptr 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # iptables-save 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # iptables-restore 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@302 -- # remove_spdk_ns 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:33.032 13:24:28 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:13:35.055 00:13:35.055 real 0m9.058s 00:13:35.055 user 0m21.464s 00:13:35.055 sys 0m2.480s 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:13:35.055 ************************************ 00:13:35.055 END TEST nvmf_invalid 00:13:35.055 ************************************ 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@24 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:13:35.055 ************************************ 00:13:35.055 START TEST nvmf_connect_stress 00:13:35.055 ************************************ 00:13:35.055 13:24:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:35.056 * Looking for test storage... 00:13:35.056 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:35.056 13:24:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:35.056 13:24:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # lcov --version 00:13:35.056 13:24:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@336 -- # IFS=.-: 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@336 -- # read -ra ver1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@337 -- # IFS=.-: 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@337 -- # read -ra ver2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@338 -- # local 'op=<' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@340 -- # ver1_l=2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@341 -- # ver2_l=1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@344 -- # case "$op" in 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@345 -- # : 1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@365 -- # decimal 1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@353 -- # local d=1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@355 -- # echo 1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@365 -- # ver1[v]=1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@366 -- # decimal 2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@353 -- # local d=2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@355 -- # echo 2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@366 -- # ver2[v]=2 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@368 -- # return 0 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:35.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.313 --rc genhtml_branch_coverage=1 00:13:35.313 --rc genhtml_function_coverage=1 00:13:35.313 --rc genhtml_legend=1 00:13:35.313 --rc geninfo_all_blocks=1 00:13:35.313 --rc geninfo_unexecuted_blocks=1 00:13:35.313 00:13:35.313 ' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:35.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.313 --rc genhtml_branch_coverage=1 00:13:35.313 --rc genhtml_function_coverage=1 00:13:35.313 --rc genhtml_legend=1 00:13:35.313 --rc geninfo_all_blocks=1 00:13:35.313 --rc geninfo_unexecuted_blocks=1 00:13:35.313 00:13:35.313 ' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:35.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.313 --rc genhtml_branch_coverage=1 00:13:35.313 --rc genhtml_function_coverage=1 00:13:35.313 --rc genhtml_legend=1 00:13:35.313 --rc geninfo_all_blocks=1 00:13:35.313 --rc geninfo_unexecuted_blocks=1 00:13:35.313 00:13:35.313 ' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:35.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:35.313 --rc genhtml_branch_coverage=1 00:13:35.313 --rc genhtml_function_coverage=1 00:13:35.313 --rc genhtml_legend=1 00:13:35.313 --rc geninfo_all_blocks=1 00:13:35.313 --rc geninfo_unexecuted_blocks=1 00:13:35.313 00:13:35.313 ' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@7 -- # uname -s 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@15 -- # shopt -s extglob 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:35.313 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@5 -- # export PATH 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@51 -- # : 0 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:35.314 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@309 -- # xtrace_disable 00:13:35.314 13:24:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@315 -- # pci_devs=() 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@315 -- # local -a pci_devs 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@316 -- # pci_net_devs=() 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@317 -- # pci_drivers=() 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@317 -- # local -A pci_drivers 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@319 -- # net_devs=() 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@319 -- # local -ga net_devs 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@320 -- # e810=() 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@320 -- # local -ga e810 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@321 -- # x722=() 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@321 -- # local -ga x722 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@322 -- # mlx=() 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@322 -- # local -ga mlx 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:13:37.216 Found 0000:84:00.0 (0x8086 - 0x159b) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:13:37.216 Found 0000:84:00.1 (0x8086 - 0x159b) 00:13:37.216 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:13:37.217 Found net devices under 0000:84:00.0: cvl_0_0 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:13:37.217 Found net devices under 0000:84:00.1: cvl_0_1 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@440 -- # is_hw=yes 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:13:37.217 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:13:37.476 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:37.476 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:13:37.476 00:13:37.476 --- 10.0.0.2 ping statistics --- 00:13:37.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:37.476 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:37.476 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:37.476 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:13:37.476 00:13:37.476 --- 10.0.0.1 ping statistics --- 00:13:37.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:37.476 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@448 -- # return 0 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@507 -- # nvmfpid=603744 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@508 -- # waitforlisten 603744 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@831 -- # '[' -z 603744 ']' 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:37.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:37.476 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.476 [2024-10-07 13:24:33.301043] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:37.476 [2024-10-07 13:24:33.301149] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:37.476 [2024-10-07 13:24:33.368277] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:37.734 [2024-10-07 13:24:33.479788] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:37.734 [2024-10-07 13:24:33.479847] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:37.734 [2024-10-07 13:24:33.479876] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:37.734 [2024-10-07 13:24:33.479889] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:37.734 [2024-10-07 13:24:33.479899] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:37.734 [2024-10-07 13:24:33.480925] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:13:37.734 [2024-10-07 13:24:33.480987] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:13:37.734 [2024-10-07 13:24:33.480990] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:13:37.734 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:37.734 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@864 -- # return 0 00:13:37.734 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:13:37.734 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:37.734 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.734 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.735 [2024-10-07 13:24:33.632418] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.735 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.992 [2024-10-07 13:24:33.670516] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:37.992 NULL1 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@21 -- # PERF_PID=603774 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # seq 1 20 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.992 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.993 13:24:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:38.251 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.251 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:38.251 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.251 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.251 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:38.508 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.508 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:38.508 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.508 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.508 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:38.767 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.767 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:38.767 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.767 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.767 13:24:34 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:39.332 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.332 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:39.332 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.332 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.332 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:39.589 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.589 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:39.589 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.589 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.589 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:39.847 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.847 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:39.847 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.847 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.847 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:40.104 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.104 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:40.104 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.104 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.104 13:24:35 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:40.668 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.668 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:40.668 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.668 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.668 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:40.925 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.925 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:40.925 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.925 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.925 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:41.183 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.183 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:41.183 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.183 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.183 13:24:36 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:41.441 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.441 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:41.441 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.441 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.441 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:41.699 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.699 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:41.699 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.699 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.699 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:42.263 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.263 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:42.263 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.263 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.263 13:24:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:42.520 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.520 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:42.520 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.520 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.520 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:42.776 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.776 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:42.776 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.776 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.777 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:43.034 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.034 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:43.034 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.034 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.034 13:24:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:43.291 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.291 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:43.291 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.291 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.291 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:43.856 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.857 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:43.857 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.857 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.857 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:44.115 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.115 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:44.115 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.115 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.115 13:24:39 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:44.372 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.372 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:44.372 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.372 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.372 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:44.630 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.630 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:44.630 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.630 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.630 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:44.887 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.887 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:44.887 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:44.887 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.887 13:24:40 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:45.452 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.452 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:45.452 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:45.452 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.452 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:45.710 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.710 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:45.710 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:45.710 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.710 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:45.967 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.967 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:45.967 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:45.967 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.967 13:24:41 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:46.224 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.224 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:46.224 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:46.224 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.224 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:46.481 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.481 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:46.481 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:46.481 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.481 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:47.046 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.046 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:47.046 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.046 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.046 13:24:42 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:47.304 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.304 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:47.304 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.304 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.304 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:47.562 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.562 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:47.562 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.562 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.562 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:47.820 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.820 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:47.820 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.820 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.820 13:24:43 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:48.077 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:48.078 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.078 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 603774 00:13:48.078 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (603774) - No such process 00:13:48.078 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@38 -- # wait 603774 00:13:48.078 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:48.078 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:48.078 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:48.335 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:48.335 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@121 -- # sync 00:13:48.335 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:48.335 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@124 -- # set +e 00:13:48.335 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:48.335 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:48.335 rmmod nvme_tcp 00:13:48.335 rmmod nvme_fabrics 00:13:48.335 rmmod nvme_keyring 00:13:48.335 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@128 -- # set -e 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@129 -- # return 0 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@515 -- # '[' -n 603744 ']' 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@516 -- # killprocess 603744 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@950 -- # '[' -z 603744 ']' 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@954 -- # kill -0 603744 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@955 -- # uname 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 603744 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@968 -- # echo 'killing process with pid 603744' 00:13:48.336 killing process with pid 603744 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@969 -- # kill 603744 00:13:48.336 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@974 -- # wait 603744 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@297 -- # iptr 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # iptables-save 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # iptables-restore 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@302 -- # remove_spdk_ns 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:48.595 13:24:44 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.501 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:13:50.501 00:13:50.501 real 0m15.533s 00:13:50.501 user 0m38.519s 00:13:50.501 sys 0m6.102s 00:13:50.501 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:50.501 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:13:50.501 ************************************ 00:13:50.501 END TEST nvmf_connect_stress 00:13:50.501 ************************************ 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@25 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:13:50.760 ************************************ 00:13:50.760 START TEST nvmf_fused_ordering 00:13:50.760 ************************************ 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:50.760 * Looking for test storage... 00:13:50.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # lcov --version 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@336 -- # IFS=.-: 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@336 -- # read -ra ver1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@337 -- # IFS=.-: 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@337 -- # read -ra ver2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@338 -- # local 'op=<' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@340 -- # ver1_l=2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@341 -- # ver2_l=1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@344 -- # case "$op" in 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@345 -- # : 1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@365 -- # decimal 1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@353 -- # local d=1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@355 -- # echo 1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@365 -- # ver1[v]=1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@366 -- # decimal 2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@353 -- # local d=2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@355 -- # echo 2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@366 -- # ver2[v]=2 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@368 -- # return 0 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:50.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.760 --rc genhtml_branch_coverage=1 00:13:50.760 --rc genhtml_function_coverage=1 00:13:50.760 --rc genhtml_legend=1 00:13:50.760 --rc geninfo_all_blocks=1 00:13:50.760 --rc geninfo_unexecuted_blocks=1 00:13:50.760 00:13:50.760 ' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:50.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.760 --rc genhtml_branch_coverage=1 00:13:50.760 --rc genhtml_function_coverage=1 00:13:50.760 --rc genhtml_legend=1 00:13:50.760 --rc geninfo_all_blocks=1 00:13:50.760 --rc geninfo_unexecuted_blocks=1 00:13:50.760 00:13:50.760 ' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:50.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.760 --rc genhtml_branch_coverage=1 00:13:50.760 --rc genhtml_function_coverage=1 00:13:50.760 --rc genhtml_legend=1 00:13:50.760 --rc geninfo_all_blocks=1 00:13:50.760 --rc geninfo_unexecuted_blocks=1 00:13:50.760 00:13:50.760 ' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:50.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.760 --rc genhtml_branch_coverage=1 00:13:50.760 --rc genhtml_function_coverage=1 00:13:50.760 --rc genhtml_legend=1 00:13:50.760 --rc geninfo_all_blocks=1 00:13:50.760 --rc geninfo_unexecuted_blocks=1 00:13:50.760 00:13:50.760 ' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@7 -- # uname -s 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:50.760 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@15 -- # shopt -s extglob 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@5 -- # export PATH 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@51 -- # : 0 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:50.761 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@309 -- # xtrace_disable 00:13:50.761 13:24:46 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@315 -- # pci_devs=() 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@315 -- # local -a pci_devs 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@316 -- # pci_net_devs=() 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@317 -- # pci_drivers=() 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@317 -- # local -A pci_drivers 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@319 -- # net_devs=() 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@319 -- # local -ga net_devs 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@320 -- # e810=() 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@320 -- # local -ga e810 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@321 -- # x722=() 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@321 -- # local -ga x722 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@322 -- # mlx=() 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@322 -- # local -ga mlx 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:13:53.294 Found 0000:84:00.0 (0x8086 - 0x159b) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:13:53.294 Found 0000:84:00.1 (0x8086 - 0x159b) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:13:53.294 Found net devices under 0000:84:00.0: cvl_0_0 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@416 -- # [[ up == up ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:13:53.294 Found net devices under 0000:84:00.1: cvl_0_1 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@440 -- # is_hw=yes 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:13:53.294 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:53.294 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:13:53.294 00:13:53.294 --- 10.0.0.2 ping statistics --- 00:13:53.294 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.294 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:53.294 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:53.294 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:13:53.294 00:13:53.294 --- 10.0.0.1 ping statistics --- 00:13:53.294 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.294 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:13:53.294 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@448 -- # return 0 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@507 -- # nvmfpid=607060 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@508 -- # waitforlisten 607060 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@831 -- # '[' -z 607060 ']' 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:53.295 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:53.295 13:24:48 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.295 [2024-10-07 13:24:48.977902] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:53.295 [2024-10-07 13:24:48.978002] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:53.295 [2024-10-07 13:24:49.058703] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:53.295 [2024-10-07 13:24:49.195136] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:53.295 [2024-10-07 13:24:49.195216] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:53.295 [2024-10-07 13:24:49.195257] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:53.295 [2024-10-07 13:24:49.195280] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:53.295 [2024-10-07 13:24:49.195300] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:53.295 [2024-10-07 13:24:49.196216] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:13:53.553 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@864 -- # return 0 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.554 [2024-10-07 13:24:49.371698] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.554 [2024-10-07 13:24:49.387949] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.554 NULL1 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.554 13:24:49 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:53.554 [2024-10-07 13:24:49.434171] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:53.554 [2024-10-07 13:24:49.434214] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid607085 ] 00:13:54.120 Attached to nqn.2016-06.io.spdk:cnode1 00:13:54.120 Namespace ID: 1 size: 1GB 00:13:54.120 fused_ordering(0) 00:13:54.120 fused_ordering(1) 00:13:54.120 fused_ordering(2) 00:13:54.120 fused_ordering(3) 00:13:54.120 fused_ordering(4) 00:13:54.120 fused_ordering(5) 00:13:54.120 fused_ordering(6) 00:13:54.120 fused_ordering(7) 00:13:54.120 fused_ordering(8) 00:13:54.120 fused_ordering(9) 00:13:54.120 fused_ordering(10) 00:13:54.120 fused_ordering(11) 00:13:54.120 fused_ordering(12) 00:13:54.120 fused_ordering(13) 00:13:54.120 fused_ordering(14) 00:13:54.120 fused_ordering(15) 00:13:54.120 fused_ordering(16) 00:13:54.120 fused_ordering(17) 00:13:54.120 fused_ordering(18) 00:13:54.120 fused_ordering(19) 00:13:54.120 fused_ordering(20) 00:13:54.120 fused_ordering(21) 00:13:54.120 fused_ordering(22) 00:13:54.120 fused_ordering(23) 00:13:54.120 fused_ordering(24) 00:13:54.120 fused_ordering(25) 00:13:54.120 fused_ordering(26) 00:13:54.120 fused_ordering(27) 00:13:54.120 fused_ordering(28) 00:13:54.120 fused_ordering(29) 00:13:54.120 fused_ordering(30) 00:13:54.120 fused_ordering(31) 00:13:54.120 fused_ordering(32) 00:13:54.120 fused_ordering(33) 00:13:54.120 fused_ordering(34) 00:13:54.120 fused_ordering(35) 00:13:54.120 fused_ordering(36) 00:13:54.120 fused_ordering(37) 00:13:54.120 fused_ordering(38) 00:13:54.120 fused_ordering(39) 00:13:54.120 fused_ordering(40) 00:13:54.120 fused_ordering(41) 00:13:54.120 fused_ordering(42) 00:13:54.120 fused_ordering(43) 00:13:54.120 fused_ordering(44) 00:13:54.120 fused_ordering(45) 00:13:54.120 fused_ordering(46) 00:13:54.120 fused_ordering(47) 00:13:54.120 fused_ordering(48) 00:13:54.120 fused_ordering(49) 00:13:54.120 fused_ordering(50) 00:13:54.120 fused_ordering(51) 00:13:54.120 fused_ordering(52) 00:13:54.120 fused_ordering(53) 00:13:54.120 fused_ordering(54) 00:13:54.120 fused_ordering(55) 00:13:54.120 fused_ordering(56) 00:13:54.120 fused_ordering(57) 00:13:54.120 fused_ordering(58) 00:13:54.120 fused_ordering(59) 00:13:54.120 fused_ordering(60) 00:13:54.120 fused_ordering(61) 00:13:54.120 fused_ordering(62) 00:13:54.120 fused_ordering(63) 00:13:54.120 fused_ordering(64) 00:13:54.120 fused_ordering(65) 00:13:54.120 fused_ordering(66) 00:13:54.120 fused_ordering(67) 00:13:54.120 fused_ordering(68) 00:13:54.120 fused_ordering(69) 00:13:54.120 fused_ordering(70) 00:13:54.120 fused_ordering(71) 00:13:54.120 fused_ordering(72) 00:13:54.120 fused_ordering(73) 00:13:54.120 fused_ordering(74) 00:13:54.120 fused_ordering(75) 00:13:54.120 fused_ordering(76) 00:13:54.120 fused_ordering(77) 00:13:54.120 fused_ordering(78) 00:13:54.120 fused_ordering(79) 00:13:54.120 fused_ordering(80) 00:13:54.120 fused_ordering(81) 00:13:54.120 fused_ordering(82) 00:13:54.120 fused_ordering(83) 00:13:54.120 fused_ordering(84) 00:13:54.120 fused_ordering(85) 00:13:54.120 fused_ordering(86) 00:13:54.120 fused_ordering(87) 00:13:54.120 fused_ordering(88) 00:13:54.120 fused_ordering(89) 00:13:54.120 fused_ordering(90) 00:13:54.120 fused_ordering(91) 00:13:54.120 fused_ordering(92) 00:13:54.120 fused_ordering(93) 00:13:54.120 fused_ordering(94) 00:13:54.120 fused_ordering(95) 00:13:54.120 fused_ordering(96) 00:13:54.120 fused_ordering(97) 00:13:54.120 fused_ordering(98) 00:13:54.120 fused_ordering(99) 00:13:54.120 fused_ordering(100) 00:13:54.120 fused_ordering(101) 00:13:54.120 fused_ordering(102) 00:13:54.120 fused_ordering(103) 00:13:54.120 fused_ordering(104) 00:13:54.120 fused_ordering(105) 00:13:54.120 fused_ordering(106) 00:13:54.120 fused_ordering(107) 00:13:54.120 fused_ordering(108) 00:13:54.120 fused_ordering(109) 00:13:54.120 fused_ordering(110) 00:13:54.120 fused_ordering(111) 00:13:54.120 fused_ordering(112) 00:13:54.120 fused_ordering(113) 00:13:54.120 fused_ordering(114) 00:13:54.120 fused_ordering(115) 00:13:54.120 fused_ordering(116) 00:13:54.120 fused_ordering(117) 00:13:54.120 fused_ordering(118) 00:13:54.120 fused_ordering(119) 00:13:54.120 fused_ordering(120) 00:13:54.120 fused_ordering(121) 00:13:54.120 fused_ordering(122) 00:13:54.120 fused_ordering(123) 00:13:54.120 fused_ordering(124) 00:13:54.120 fused_ordering(125) 00:13:54.120 fused_ordering(126) 00:13:54.120 fused_ordering(127) 00:13:54.120 fused_ordering(128) 00:13:54.120 fused_ordering(129) 00:13:54.121 fused_ordering(130) 00:13:54.121 fused_ordering(131) 00:13:54.121 fused_ordering(132) 00:13:54.121 fused_ordering(133) 00:13:54.121 fused_ordering(134) 00:13:54.121 fused_ordering(135) 00:13:54.121 fused_ordering(136) 00:13:54.121 fused_ordering(137) 00:13:54.121 fused_ordering(138) 00:13:54.121 fused_ordering(139) 00:13:54.121 fused_ordering(140) 00:13:54.121 fused_ordering(141) 00:13:54.121 fused_ordering(142) 00:13:54.121 fused_ordering(143) 00:13:54.121 fused_ordering(144) 00:13:54.121 fused_ordering(145) 00:13:54.121 fused_ordering(146) 00:13:54.121 fused_ordering(147) 00:13:54.121 fused_ordering(148) 00:13:54.121 fused_ordering(149) 00:13:54.121 fused_ordering(150) 00:13:54.121 fused_ordering(151) 00:13:54.121 fused_ordering(152) 00:13:54.121 fused_ordering(153) 00:13:54.121 fused_ordering(154) 00:13:54.121 fused_ordering(155) 00:13:54.121 fused_ordering(156) 00:13:54.121 fused_ordering(157) 00:13:54.121 fused_ordering(158) 00:13:54.121 fused_ordering(159) 00:13:54.121 fused_ordering(160) 00:13:54.121 fused_ordering(161) 00:13:54.121 fused_ordering(162) 00:13:54.121 fused_ordering(163) 00:13:54.121 fused_ordering(164) 00:13:54.121 fused_ordering(165) 00:13:54.121 fused_ordering(166) 00:13:54.121 fused_ordering(167) 00:13:54.121 fused_ordering(168) 00:13:54.121 fused_ordering(169) 00:13:54.121 fused_ordering(170) 00:13:54.121 fused_ordering(171) 00:13:54.121 fused_ordering(172) 00:13:54.121 fused_ordering(173) 00:13:54.121 fused_ordering(174) 00:13:54.121 fused_ordering(175) 00:13:54.121 fused_ordering(176) 00:13:54.121 fused_ordering(177) 00:13:54.121 fused_ordering(178) 00:13:54.121 fused_ordering(179) 00:13:54.121 fused_ordering(180) 00:13:54.121 fused_ordering(181) 00:13:54.121 fused_ordering(182) 00:13:54.121 fused_ordering(183) 00:13:54.121 fused_ordering(184) 00:13:54.121 fused_ordering(185) 00:13:54.121 fused_ordering(186) 00:13:54.121 fused_ordering(187) 00:13:54.121 fused_ordering(188) 00:13:54.121 fused_ordering(189) 00:13:54.121 fused_ordering(190) 00:13:54.121 fused_ordering(191) 00:13:54.121 fused_ordering(192) 00:13:54.121 fused_ordering(193) 00:13:54.121 fused_ordering(194) 00:13:54.121 fused_ordering(195) 00:13:54.121 fused_ordering(196) 00:13:54.121 fused_ordering(197) 00:13:54.121 fused_ordering(198) 00:13:54.121 fused_ordering(199) 00:13:54.121 fused_ordering(200) 00:13:54.121 fused_ordering(201) 00:13:54.121 fused_ordering(202) 00:13:54.121 fused_ordering(203) 00:13:54.121 fused_ordering(204) 00:13:54.121 fused_ordering(205) 00:13:54.378 fused_ordering(206) 00:13:54.378 fused_ordering(207) 00:13:54.378 fused_ordering(208) 00:13:54.378 fused_ordering(209) 00:13:54.378 fused_ordering(210) 00:13:54.378 fused_ordering(211) 00:13:54.378 fused_ordering(212) 00:13:54.378 fused_ordering(213) 00:13:54.378 fused_ordering(214) 00:13:54.378 fused_ordering(215) 00:13:54.378 fused_ordering(216) 00:13:54.378 fused_ordering(217) 00:13:54.378 fused_ordering(218) 00:13:54.378 fused_ordering(219) 00:13:54.378 fused_ordering(220) 00:13:54.378 fused_ordering(221) 00:13:54.378 fused_ordering(222) 00:13:54.378 fused_ordering(223) 00:13:54.378 fused_ordering(224) 00:13:54.378 fused_ordering(225) 00:13:54.378 fused_ordering(226) 00:13:54.378 fused_ordering(227) 00:13:54.378 fused_ordering(228) 00:13:54.378 fused_ordering(229) 00:13:54.378 fused_ordering(230) 00:13:54.378 fused_ordering(231) 00:13:54.378 fused_ordering(232) 00:13:54.378 fused_ordering(233) 00:13:54.378 fused_ordering(234) 00:13:54.378 fused_ordering(235) 00:13:54.378 fused_ordering(236) 00:13:54.378 fused_ordering(237) 00:13:54.378 fused_ordering(238) 00:13:54.378 fused_ordering(239) 00:13:54.378 fused_ordering(240) 00:13:54.378 fused_ordering(241) 00:13:54.378 fused_ordering(242) 00:13:54.378 fused_ordering(243) 00:13:54.378 fused_ordering(244) 00:13:54.378 fused_ordering(245) 00:13:54.378 fused_ordering(246) 00:13:54.378 fused_ordering(247) 00:13:54.378 fused_ordering(248) 00:13:54.378 fused_ordering(249) 00:13:54.378 fused_ordering(250) 00:13:54.378 fused_ordering(251) 00:13:54.378 fused_ordering(252) 00:13:54.378 fused_ordering(253) 00:13:54.378 fused_ordering(254) 00:13:54.378 fused_ordering(255) 00:13:54.378 fused_ordering(256) 00:13:54.378 fused_ordering(257) 00:13:54.378 fused_ordering(258) 00:13:54.378 fused_ordering(259) 00:13:54.378 fused_ordering(260) 00:13:54.378 fused_ordering(261) 00:13:54.378 fused_ordering(262) 00:13:54.378 fused_ordering(263) 00:13:54.378 fused_ordering(264) 00:13:54.378 fused_ordering(265) 00:13:54.378 fused_ordering(266) 00:13:54.378 fused_ordering(267) 00:13:54.378 fused_ordering(268) 00:13:54.378 fused_ordering(269) 00:13:54.378 fused_ordering(270) 00:13:54.378 fused_ordering(271) 00:13:54.378 fused_ordering(272) 00:13:54.378 fused_ordering(273) 00:13:54.378 fused_ordering(274) 00:13:54.378 fused_ordering(275) 00:13:54.378 fused_ordering(276) 00:13:54.378 fused_ordering(277) 00:13:54.378 fused_ordering(278) 00:13:54.378 fused_ordering(279) 00:13:54.378 fused_ordering(280) 00:13:54.378 fused_ordering(281) 00:13:54.378 fused_ordering(282) 00:13:54.378 fused_ordering(283) 00:13:54.378 fused_ordering(284) 00:13:54.378 fused_ordering(285) 00:13:54.378 fused_ordering(286) 00:13:54.378 fused_ordering(287) 00:13:54.378 fused_ordering(288) 00:13:54.378 fused_ordering(289) 00:13:54.378 fused_ordering(290) 00:13:54.378 fused_ordering(291) 00:13:54.378 fused_ordering(292) 00:13:54.378 fused_ordering(293) 00:13:54.378 fused_ordering(294) 00:13:54.378 fused_ordering(295) 00:13:54.378 fused_ordering(296) 00:13:54.378 fused_ordering(297) 00:13:54.378 fused_ordering(298) 00:13:54.378 fused_ordering(299) 00:13:54.378 fused_ordering(300) 00:13:54.378 fused_ordering(301) 00:13:54.378 fused_ordering(302) 00:13:54.378 fused_ordering(303) 00:13:54.378 fused_ordering(304) 00:13:54.378 fused_ordering(305) 00:13:54.378 fused_ordering(306) 00:13:54.378 fused_ordering(307) 00:13:54.378 fused_ordering(308) 00:13:54.378 fused_ordering(309) 00:13:54.378 fused_ordering(310) 00:13:54.378 fused_ordering(311) 00:13:54.378 fused_ordering(312) 00:13:54.378 fused_ordering(313) 00:13:54.378 fused_ordering(314) 00:13:54.378 fused_ordering(315) 00:13:54.378 fused_ordering(316) 00:13:54.378 fused_ordering(317) 00:13:54.378 fused_ordering(318) 00:13:54.378 fused_ordering(319) 00:13:54.378 fused_ordering(320) 00:13:54.378 fused_ordering(321) 00:13:54.378 fused_ordering(322) 00:13:54.378 fused_ordering(323) 00:13:54.378 fused_ordering(324) 00:13:54.378 fused_ordering(325) 00:13:54.378 fused_ordering(326) 00:13:54.378 fused_ordering(327) 00:13:54.378 fused_ordering(328) 00:13:54.378 fused_ordering(329) 00:13:54.378 fused_ordering(330) 00:13:54.378 fused_ordering(331) 00:13:54.378 fused_ordering(332) 00:13:54.378 fused_ordering(333) 00:13:54.378 fused_ordering(334) 00:13:54.379 fused_ordering(335) 00:13:54.379 fused_ordering(336) 00:13:54.379 fused_ordering(337) 00:13:54.379 fused_ordering(338) 00:13:54.379 fused_ordering(339) 00:13:54.379 fused_ordering(340) 00:13:54.379 fused_ordering(341) 00:13:54.379 fused_ordering(342) 00:13:54.379 fused_ordering(343) 00:13:54.379 fused_ordering(344) 00:13:54.379 fused_ordering(345) 00:13:54.379 fused_ordering(346) 00:13:54.379 fused_ordering(347) 00:13:54.379 fused_ordering(348) 00:13:54.379 fused_ordering(349) 00:13:54.379 fused_ordering(350) 00:13:54.379 fused_ordering(351) 00:13:54.379 fused_ordering(352) 00:13:54.379 fused_ordering(353) 00:13:54.379 fused_ordering(354) 00:13:54.379 fused_ordering(355) 00:13:54.379 fused_ordering(356) 00:13:54.379 fused_ordering(357) 00:13:54.379 fused_ordering(358) 00:13:54.379 fused_ordering(359) 00:13:54.379 fused_ordering(360) 00:13:54.379 fused_ordering(361) 00:13:54.379 fused_ordering(362) 00:13:54.379 fused_ordering(363) 00:13:54.379 fused_ordering(364) 00:13:54.379 fused_ordering(365) 00:13:54.379 fused_ordering(366) 00:13:54.379 fused_ordering(367) 00:13:54.379 fused_ordering(368) 00:13:54.379 fused_ordering(369) 00:13:54.379 fused_ordering(370) 00:13:54.379 fused_ordering(371) 00:13:54.379 fused_ordering(372) 00:13:54.379 fused_ordering(373) 00:13:54.379 fused_ordering(374) 00:13:54.379 fused_ordering(375) 00:13:54.379 fused_ordering(376) 00:13:54.379 fused_ordering(377) 00:13:54.379 fused_ordering(378) 00:13:54.379 fused_ordering(379) 00:13:54.379 fused_ordering(380) 00:13:54.379 fused_ordering(381) 00:13:54.379 fused_ordering(382) 00:13:54.379 fused_ordering(383) 00:13:54.379 fused_ordering(384) 00:13:54.379 fused_ordering(385) 00:13:54.379 fused_ordering(386) 00:13:54.379 fused_ordering(387) 00:13:54.379 fused_ordering(388) 00:13:54.379 fused_ordering(389) 00:13:54.379 fused_ordering(390) 00:13:54.379 fused_ordering(391) 00:13:54.379 fused_ordering(392) 00:13:54.379 fused_ordering(393) 00:13:54.379 fused_ordering(394) 00:13:54.379 fused_ordering(395) 00:13:54.379 fused_ordering(396) 00:13:54.379 fused_ordering(397) 00:13:54.379 fused_ordering(398) 00:13:54.379 fused_ordering(399) 00:13:54.379 fused_ordering(400) 00:13:54.379 fused_ordering(401) 00:13:54.379 fused_ordering(402) 00:13:54.379 fused_ordering(403) 00:13:54.379 fused_ordering(404) 00:13:54.379 fused_ordering(405) 00:13:54.379 fused_ordering(406) 00:13:54.379 fused_ordering(407) 00:13:54.379 fused_ordering(408) 00:13:54.379 fused_ordering(409) 00:13:54.379 fused_ordering(410) 00:13:54.944 fused_ordering(411) 00:13:54.944 fused_ordering(412) 00:13:54.944 fused_ordering(413) 00:13:54.944 fused_ordering(414) 00:13:54.944 fused_ordering(415) 00:13:54.944 fused_ordering(416) 00:13:54.944 fused_ordering(417) 00:13:54.944 fused_ordering(418) 00:13:54.944 fused_ordering(419) 00:13:54.944 fused_ordering(420) 00:13:54.944 fused_ordering(421) 00:13:54.944 fused_ordering(422) 00:13:54.944 fused_ordering(423) 00:13:54.944 fused_ordering(424) 00:13:54.944 fused_ordering(425) 00:13:54.944 fused_ordering(426) 00:13:54.944 fused_ordering(427) 00:13:54.944 fused_ordering(428) 00:13:54.944 fused_ordering(429) 00:13:54.944 fused_ordering(430) 00:13:54.944 fused_ordering(431) 00:13:54.944 fused_ordering(432) 00:13:54.944 fused_ordering(433) 00:13:54.944 fused_ordering(434) 00:13:54.944 fused_ordering(435) 00:13:54.944 fused_ordering(436) 00:13:54.944 fused_ordering(437) 00:13:54.944 fused_ordering(438) 00:13:54.944 fused_ordering(439) 00:13:54.944 fused_ordering(440) 00:13:54.944 fused_ordering(441) 00:13:54.944 fused_ordering(442) 00:13:54.944 fused_ordering(443) 00:13:54.944 fused_ordering(444) 00:13:54.944 fused_ordering(445) 00:13:54.944 fused_ordering(446) 00:13:54.944 fused_ordering(447) 00:13:54.944 fused_ordering(448) 00:13:54.944 fused_ordering(449) 00:13:54.944 fused_ordering(450) 00:13:54.944 fused_ordering(451) 00:13:54.944 fused_ordering(452) 00:13:54.944 fused_ordering(453) 00:13:54.944 fused_ordering(454) 00:13:54.944 fused_ordering(455) 00:13:54.944 fused_ordering(456) 00:13:54.944 fused_ordering(457) 00:13:54.944 fused_ordering(458) 00:13:54.944 fused_ordering(459) 00:13:54.944 fused_ordering(460) 00:13:54.944 fused_ordering(461) 00:13:54.944 fused_ordering(462) 00:13:54.944 fused_ordering(463) 00:13:54.944 fused_ordering(464) 00:13:54.944 fused_ordering(465) 00:13:54.944 fused_ordering(466) 00:13:54.944 fused_ordering(467) 00:13:54.944 fused_ordering(468) 00:13:54.944 fused_ordering(469) 00:13:54.944 fused_ordering(470) 00:13:54.944 fused_ordering(471) 00:13:54.944 fused_ordering(472) 00:13:54.944 fused_ordering(473) 00:13:54.944 fused_ordering(474) 00:13:54.944 fused_ordering(475) 00:13:54.944 fused_ordering(476) 00:13:54.944 fused_ordering(477) 00:13:54.944 fused_ordering(478) 00:13:54.944 fused_ordering(479) 00:13:54.944 fused_ordering(480) 00:13:54.944 fused_ordering(481) 00:13:54.944 fused_ordering(482) 00:13:54.944 fused_ordering(483) 00:13:54.944 fused_ordering(484) 00:13:54.944 fused_ordering(485) 00:13:54.944 fused_ordering(486) 00:13:54.944 fused_ordering(487) 00:13:54.944 fused_ordering(488) 00:13:54.944 fused_ordering(489) 00:13:54.944 fused_ordering(490) 00:13:54.944 fused_ordering(491) 00:13:54.944 fused_ordering(492) 00:13:54.944 fused_ordering(493) 00:13:54.944 fused_ordering(494) 00:13:54.944 fused_ordering(495) 00:13:54.944 fused_ordering(496) 00:13:54.944 fused_ordering(497) 00:13:54.944 fused_ordering(498) 00:13:54.944 fused_ordering(499) 00:13:54.944 fused_ordering(500) 00:13:54.944 fused_ordering(501) 00:13:54.944 fused_ordering(502) 00:13:54.944 fused_ordering(503) 00:13:54.944 fused_ordering(504) 00:13:54.944 fused_ordering(505) 00:13:54.944 fused_ordering(506) 00:13:54.944 fused_ordering(507) 00:13:54.944 fused_ordering(508) 00:13:54.944 fused_ordering(509) 00:13:54.944 fused_ordering(510) 00:13:54.944 fused_ordering(511) 00:13:54.944 fused_ordering(512) 00:13:54.944 fused_ordering(513) 00:13:54.944 fused_ordering(514) 00:13:54.944 fused_ordering(515) 00:13:54.944 fused_ordering(516) 00:13:54.944 fused_ordering(517) 00:13:54.944 fused_ordering(518) 00:13:54.944 fused_ordering(519) 00:13:54.944 fused_ordering(520) 00:13:54.944 fused_ordering(521) 00:13:54.944 fused_ordering(522) 00:13:54.944 fused_ordering(523) 00:13:54.944 fused_ordering(524) 00:13:54.944 fused_ordering(525) 00:13:54.944 fused_ordering(526) 00:13:54.944 fused_ordering(527) 00:13:54.944 fused_ordering(528) 00:13:54.944 fused_ordering(529) 00:13:54.944 fused_ordering(530) 00:13:54.944 fused_ordering(531) 00:13:54.944 fused_ordering(532) 00:13:54.944 fused_ordering(533) 00:13:54.944 fused_ordering(534) 00:13:54.944 fused_ordering(535) 00:13:54.944 fused_ordering(536) 00:13:54.944 fused_ordering(537) 00:13:54.944 fused_ordering(538) 00:13:54.944 fused_ordering(539) 00:13:54.944 fused_ordering(540) 00:13:54.944 fused_ordering(541) 00:13:54.944 fused_ordering(542) 00:13:54.944 fused_ordering(543) 00:13:54.944 fused_ordering(544) 00:13:54.944 fused_ordering(545) 00:13:54.944 fused_ordering(546) 00:13:54.944 fused_ordering(547) 00:13:54.944 fused_ordering(548) 00:13:54.944 fused_ordering(549) 00:13:54.944 fused_ordering(550) 00:13:54.944 fused_ordering(551) 00:13:54.944 fused_ordering(552) 00:13:54.944 fused_ordering(553) 00:13:54.944 fused_ordering(554) 00:13:54.944 fused_ordering(555) 00:13:54.944 fused_ordering(556) 00:13:54.944 fused_ordering(557) 00:13:54.944 fused_ordering(558) 00:13:54.944 fused_ordering(559) 00:13:54.944 fused_ordering(560) 00:13:54.944 fused_ordering(561) 00:13:54.944 fused_ordering(562) 00:13:54.944 fused_ordering(563) 00:13:54.944 fused_ordering(564) 00:13:54.944 fused_ordering(565) 00:13:54.944 fused_ordering(566) 00:13:54.944 fused_ordering(567) 00:13:54.944 fused_ordering(568) 00:13:54.944 fused_ordering(569) 00:13:54.944 fused_ordering(570) 00:13:54.944 fused_ordering(571) 00:13:54.944 fused_ordering(572) 00:13:54.944 fused_ordering(573) 00:13:54.944 fused_ordering(574) 00:13:54.944 fused_ordering(575) 00:13:54.944 fused_ordering(576) 00:13:54.944 fused_ordering(577) 00:13:54.944 fused_ordering(578) 00:13:54.944 fused_ordering(579) 00:13:54.944 fused_ordering(580) 00:13:54.944 fused_ordering(581) 00:13:54.945 fused_ordering(582) 00:13:54.945 fused_ordering(583) 00:13:54.945 fused_ordering(584) 00:13:54.945 fused_ordering(585) 00:13:54.945 fused_ordering(586) 00:13:54.945 fused_ordering(587) 00:13:54.945 fused_ordering(588) 00:13:54.945 fused_ordering(589) 00:13:54.945 fused_ordering(590) 00:13:54.945 fused_ordering(591) 00:13:54.945 fused_ordering(592) 00:13:54.945 fused_ordering(593) 00:13:54.945 fused_ordering(594) 00:13:54.945 fused_ordering(595) 00:13:54.945 fused_ordering(596) 00:13:54.945 fused_ordering(597) 00:13:54.945 fused_ordering(598) 00:13:54.945 fused_ordering(599) 00:13:54.945 fused_ordering(600) 00:13:54.945 fused_ordering(601) 00:13:54.945 fused_ordering(602) 00:13:54.945 fused_ordering(603) 00:13:54.945 fused_ordering(604) 00:13:54.945 fused_ordering(605) 00:13:54.945 fused_ordering(606) 00:13:54.945 fused_ordering(607) 00:13:54.945 fused_ordering(608) 00:13:54.945 fused_ordering(609) 00:13:54.945 fused_ordering(610) 00:13:54.945 fused_ordering(611) 00:13:54.945 fused_ordering(612) 00:13:54.945 fused_ordering(613) 00:13:54.945 fused_ordering(614) 00:13:54.945 fused_ordering(615) 00:13:55.202 fused_ordering(616) 00:13:55.202 fused_ordering(617) 00:13:55.202 fused_ordering(618) 00:13:55.202 fused_ordering(619) 00:13:55.202 fused_ordering(620) 00:13:55.202 fused_ordering(621) 00:13:55.202 fused_ordering(622) 00:13:55.202 fused_ordering(623) 00:13:55.202 fused_ordering(624) 00:13:55.202 fused_ordering(625) 00:13:55.202 fused_ordering(626) 00:13:55.202 fused_ordering(627) 00:13:55.202 fused_ordering(628) 00:13:55.202 fused_ordering(629) 00:13:55.202 fused_ordering(630) 00:13:55.202 fused_ordering(631) 00:13:55.202 fused_ordering(632) 00:13:55.202 fused_ordering(633) 00:13:55.202 fused_ordering(634) 00:13:55.202 fused_ordering(635) 00:13:55.202 fused_ordering(636) 00:13:55.202 fused_ordering(637) 00:13:55.202 fused_ordering(638) 00:13:55.202 fused_ordering(639) 00:13:55.202 fused_ordering(640) 00:13:55.202 fused_ordering(641) 00:13:55.202 fused_ordering(642) 00:13:55.202 fused_ordering(643) 00:13:55.202 fused_ordering(644) 00:13:55.203 fused_ordering(645) 00:13:55.203 fused_ordering(646) 00:13:55.203 fused_ordering(647) 00:13:55.203 fused_ordering(648) 00:13:55.203 fused_ordering(649) 00:13:55.203 fused_ordering(650) 00:13:55.203 fused_ordering(651) 00:13:55.203 fused_ordering(652) 00:13:55.203 fused_ordering(653) 00:13:55.203 fused_ordering(654) 00:13:55.203 fused_ordering(655) 00:13:55.203 fused_ordering(656) 00:13:55.203 fused_ordering(657) 00:13:55.203 fused_ordering(658) 00:13:55.203 fused_ordering(659) 00:13:55.203 fused_ordering(660) 00:13:55.203 fused_ordering(661) 00:13:55.203 fused_ordering(662) 00:13:55.203 fused_ordering(663) 00:13:55.203 fused_ordering(664) 00:13:55.203 fused_ordering(665) 00:13:55.203 fused_ordering(666) 00:13:55.203 fused_ordering(667) 00:13:55.203 fused_ordering(668) 00:13:55.203 fused_ordering(669) 00:13:55.203 fused_ordering(670) 00:13:55.203 fused_ordering(671) 00:13:55.203 fused_ordering(672) 00:13:55.203 fused_ordering(673) 00:13:55.203 fused_ordering(674) 00:13:55.203 fused_ordering(675) 00:13:55.203 fused_ordering(676) 00:13:55.203 fused_ordering(677) 00:13:55.203 fused_ordering(678) 00:13:55.203 fused_ordering(679) 00:13:55.203 fused_ordering(680) 00:13:55.203 fused_ordering(681) 00:13:55.203 fused_ordering(682) 00:13:55.203 fused_ordering(683) 00:13:55.203 fused_ordering(684) 00:13:55.203 fused_ordering(685) 00:13:55.203 fused_ordering(686) 00:13:55.203 fused_ordering(687) 00:13:55.203 fused_ordering(688) 00:13:55.203 fused_ordering(689) 00:13:55.203 fused_ordering(690) 00:13:55.203 fused_ordering(691) 00:13:55.203 fused_ordering(692) 00:13:55.203 fused_ordering(693) 00:13:55.203 fused_ordering(694) 00:13:55.203 fused_ordering(695) 00:13:55.203 fused_ordering(696) 00:13:55.203 fused_ordering(697) 00:13:55.203 fused_ordering(698) 00:13:55.203 fused_ordering(699) 00:13:55.203 fused_ordering(700) 00:13:55.203 fused_ordering(701) 00:13:55.203 fused_ordering(702) 00:13:55.203 fused_ordering(703) 00:13:55.203 fused_ordering(704) 00:13:55.203 fused_ordering(705) 00:13:55.203 fused_ordering(706) 00:13:55.203 fused_ordering(707) 00:13:55.203 fused_ordering(708) 00:13:55.203 fused_ordering(709) 00:13:55.203 fused_ordering(710) 00:13:55.203 fused_ordering(711) 00:13:55.203 fused_ordering(712) 00:13:55.203 fused_ordering(713) 00:13:55.203 fused_ordering(714) 00:13:55.203 fused_ordering(715) 00:13:55.203 fused_ordering(716) 00:13:55.203 fused_ordering(717) 00:13:55.203 fused_ordering(718) 00:13:55.203 fused_ordering(719) 00:13:55.203 fused_ordering(720) 00:13:55.203 fused_ordering(721) 00:13:55.203 fused_ordering(722) 00:13:55.203 fused_ordering(723) 00:13:55.203 fused_ordering(724) 00:13:55.203 fused_ordering(725) 00:13:55.203 fused_ordering(726) 00:13:55.203 fused_ordering(727) 00:13:55.203 fused_ordering(728) 00:13:55.203 fused_ordering(729) 00:13:55.203 fused_ordering(730) 00:13:55.203 fused_ordering(731) 00:13:55.203 fused_ordering(732) 00:13:55.203 fused_ordering(733) 00:13:55.203 fused_ordering(734) 00:13:55.203 fused_ordering(735) 00:13:55.203 fused_ordering(736) 00:13:55.203 fused_ordering(737) 00:13:55.203 fused_ordering(738) 00:13:55.203 fused_ordering(739) 00:13:55.203 fused_ordering(740) 00:13:55.203 fused_ordering(741) 00:13:55.203 fused_ordering(742) 00:13:55.203 fused_ordering(743) 00:13:55.203 fused_ordering(744) 00:13:55.203 fused_ordering(745) 00:13:55.203 fused_ordering(746) 00:13:55.203 fused_ordering(747) 00:13:55.203 fused_ordering(748) 00:13:55.203 fused_ordering(749) 00:13:55.203 fused_ordering(750) 00:13:55.203 fused_ordering(751) 00:13:55.203 fused_ordering(752) 00:13:55.203 fused_ordering(753) 00:13:55.203 fused_ordering(754) 00:13:55.203 fused_ordering(755) 00:13:55.203 fused_ordering(756) 00:13:55.203 fused_ordering(757) 00:13:55.203 fused_ordering(758) 00:13:55.203 fused_ordering(759) 00:13:55.203 fused_ordering(760) 00:13:55.203 fused_ordering(761) 00:13:55.203 fused_ordering(762) 00:13:55.203 fused_ordering(763) 00:13:55.203 fused_ordering(764) 00:13:55.203 fused_ordering(765) 00:13:55.203 fused_ordering(766) 00:13:55.203 fused_ordering(767) 00:13:55.203 fused_ordering(768) 00:13:55.203 fused_ordering(769) 00:13:55.203 fused_ordering(770) 00:13:55.203 fused_ordering(771) 00:13:55.203 fused_ordering(772) 00:13:55.203 fused_ordering(773) 00:13:55.203 fused_ordering(774) 00:13:55.203 fused_ordering(775) 00:13:55.203 fused_ordering(776) 00:13:55.203 fused_ordering(777) 00:13:55.203 fused_ordering(778) 00:13:55.203 fused_ordering(779) 00:13:55.203 fused_ordering(780) 00:13:55.203 fused_ordering(781) 00:13:55.203 fused_ordering(782) 00:13:55.203 fused_ordering(783) 00:13:55.203 fused_ordering(784) 00:13:55.203 fused_ordering(785) 00:13:55.203 fused_ordering(786) 00:13:55.203 fused_ordering(787) 00:13:55.203 fused_ordering(788) 00:13:55.203 fused_ordering(789) 00:13:55.203 fused_ordering(790) 00:13:55.203 fused_ordering(791) 00:13:55.203 fused_ordering(792) 00:13:55.203 fused_ordering(793) 00:13:55.203 fused_ordering(794) 00:13:55.203 fused_ordering(795) 00:13:55.203 fused_ordering(796) 00:13:55.203 fused_ordering(797) 00:13:55.203 fused_ordering(798) 00:13:55.203 fused_ordering(799) 00:13:55.203 fused_ordering(800) 00:13:55.203 fused_ordering(801) 00:13:55.203 fused_ordering(802) 00:13:55.203 fused_ordering(803) 00:13:55.203 fused_ordering(804) 00:13:55.203 fused_ordering(805) 00:13:55.203 fused_ordering(806) 00:13:55.203 fused_ordering(807) 00:13:55.203 fused_ordering(808) 00:13:55.203 fused_ordering(809) 00:13:55.203 fused_ordering(810) 00:13:55.203 fused_ordering(811) 00:13:55.203 fused_ordering(812) 00:13:55.203 fused_ordering(813) 00:13:55.203 fused_ordering(814) 00:13:55.203 fused_ordering(815) 00:13:55.203 fused_ordering(816) 00:13:55.203 fused_ordering(817) 00:13:55.203 fused_ordering(818) 00:13:55.203 fused_ordering(819) 00:13:55.203 fused_ordering(820) 00:13:56.136 fused_ordering(821) 00:13:56.136 fused_ordering(822) 00:13:56.136 fused_ordering(823) 00:13:56.136 fused_ordering(824) 00:13:56.136 fused_ordering(825) 00:13:56.136 fused_ordering(826) 00:13:56.136 fused_ordering(827) 00:13:56.136 fused_ordering(828) 00:13:56.136 fused_ordering(829) 00:13:56.136 fused_ordering(830) 00:13:56.136 fused_ordering(831) 00:13:56.136 fused_ordering(832) 00:13:56.136 fused_ordering(833) 00:13:56.136 fused_ordering(834) 00:13:56.136 fused_ordering(835) 00:13:56.136 fused_ordering(836) 00:13:56.136 fused_ordering(837) 00:13:56.136 fused_ordering(838) 00:13:56.136 fused_ordering(839) 00:13:56.136 fused_ordering(840) 00:13:56.136 fused_ordering(841) 00:13:56.136 fused_ordering(842) 00:13:56.136 fused_ordering(843) 00:13:56.136 fused_ordering(844) 00:13:56.136 fused_ordering(845) 00:13:56.136 fused_ordering(846) 00:13:56.136 fused_ordering(847) 00:13:56.136 fused_ordering(848) 00:13:56.136 fused_ordering(849) 00:13:56.136 fused_ordering(850) 00:13:56.136 fused_ordering(851) 00:13:56.136 fused_ordering(852) 00:13:56.136 fused_ordering(853) 00:13:56.136 fused_ordering(854) 00:13:56.136 fused_ordering(855) 00:13:56.136 fused_ordering(856) 00:13:56.136 fused_ordering(857) 00:13:56.136 fused_ordering(858) 00:13:56.136 fused_ordering(859) 00:13:56.136 fused_ordering(860) 00:13:56.136 fused_ordering(861) 00:13:56.136 fused_ordering(862) 00:13:56.136 fused_ordering(863) 00:13:56.136 fused_ordering(864) 00:13:56.136 fused_ordering(865) 00:13:56.136 fused_ordering(866) 00:13:56.136 fused_ordering(867) 00:13:56.136 fused_ordering(868) 00:13:56.136 fused_ordering(869) 00:13:56.136 fused_ordering(870) 00:13:56.136 fused_ordering(871) 00:13:56.136 fused_ordering(872) 00:13:56.136 fused_ordering(873) 00:13:56.136 fused_ordering(874) 00:13:56.136 fused_ordering(875) 00:13:56.136 fused_ordering(876) 00:13:56.136 fused_ordering(877) 00:13:56.136 fused_ordering(878) 00:13:56.136 fused_ordering(879) 00:13:56.136 fused_ordering(880) 00:13:56.136 fused_ordering(881) 00:13:56.136 fused_ordering(882) 00:13:56.136 fused_ordering(883) 00:13:56.136 fused_ordering(884) 00:13:56.136 fused_ordering(885) 00:13:56.136 fused_ordering(886) 00:13:56.136 fused_ordering(887) 00:13:56.136 fused_ordering(888) 00:13:56.136 fused_ordering(889) 00:13:56.136 fused_ordering(890) 00:13:56.136 fused_ordering(891) 00:13:56.136 fused_ordering(892) 00:13:56.136 fused_ordering(893) 00:13:56.136 fused_ordering(894) 00:13:56.136 fused_ordering(895) 00:13:56.136 fused_ordering(896) 00:13:56.136 fused_ordering(897) 00:13:56.136 fused_ordering(898) 00:13:56.136 fused_ordering(899) 00:13:56.136 fused_ordering(900) 00:13:56.136 fused_ordering(901) 00:13:56.136 fused_ordering(902) 00:13:56.136 fused_ordering(903) 00:13:56.136 fused_ordering(904) 00:13:56.136 fused_ordering(905) 00:13:56.136 fused_ordering(906) 00:13:56.136 fused_ordering(907) 00:13:56.136 fused_ordering(908) 00:13:56.136 fused_ordering(909) 00:13:56.136 fused_ordering(910) 00:13:56.136 fused_ordering(911) 00:13:56.136 fused_ordering(912) 00:13:56.136 fused_ordering(913) 00:13:56.136 fused_ordering(914) 00:13:56.136 fused_ordering(915) 00:13:56.136 fused_ordering(916) 00:13:56.136 fused_ordering(917) 00:13:56.136 fused_ordering(918) 00:13:56.136 fused_ordering(919) 00:13:56.136 fused_ordering(920) 00:13:56.136 fused_ordering(921) 00:13:56.136 fused_ordering(922) 00:13:56.136 fused_ordering(923) 00:13:56.136 fused_ordering(924) 00:13:56.136 fused_ordering(925) 00:13:56.136 fused_ordering(926) 00:13:56.136 fused_ordering(927) 00:13:56.136 fused_ordering(928) 00:13:56.136 fused_ordering(929) 00:13:56.136 fused_ordering(930) 00:13:56.136 fused_ordering(931) 00:13:56.136 fused_ordering(932) 00:13:56.136 fused_ordering(933) 00:13:56.136 fused_ordering(934) 00:13:56.136 fused_ordering(935) 00:13:56.136 fused_ordering(936) 00:13:56.136 fused_ordering(937) 00:13:56.136 fused_ordering(938) 00:13:56.136 fused_ordering(939) 00:13:56.136 fused_ordering(940) 00:13:56.136 fused_ordering(941) 00:13:56.136 fused_ordering(942) 00:13:56.136 fused_ordering(943) 00:13:56.136 fused_ordering(944) 00:13:56.136 fused_ordering(945) 00:13:56.136 fused_ordering(946) 00:13:56.136 fused_ordering(947) 00:13:56.136 fused_ordering(948) 00:13:56.136 fused_ordering(949) 00:13:56.136 fused_ordering(950) 00:13:56.136 fused_ordering(951) 00:13:56.136 fused_ordering(952) 00:13:56.136 fused_ordering(953) 00:13:56.137 fused_ordering(954) 00:13:56.137 fused_ordering(955) 00:13:56.137 fused_ordering(956) 00:13:56.137 fused_ordering(957) 00:13:56.137 fused_ordering(958) 00:13:56.137 fused_ordering(959) 00:13:56.137 fused_ordering(960) 00:13:56.137 fused_ordering(961) 00:13:56.137 fused_ordering(962) 00:13:56.137 fused_ordering(963) 00:13:56.137 fused_ordering(964) 00:13:56.137 fused_ordering(965) 00:13:56.137 fused_ordering(966) 00:13:56.137 fused_ordering(967) 00:13:56.137 fused_ordering(968) 00:13:56.137 fused_ordering(969) 00:13:56.137 fused_ordering(970) 00:13:56.137 fused_ordering(971) 00:13:56.137 fused_ordering(972) 00:13:56.137 fused_ordering(973) 00:13:56.137 fused_ordering(974) 00:13:56.137 fused_ordering(975) 00:13:56.137 fused_ordering(976) 00:13:56.137 fused_ordering(977) 00:13:56.137 fused_ordering(978) 00:13:56.137 fused_ordering(979) 00:13:56.137 fused_ordering(980) 00:13:56.137 fused_ordering(981) 00:13:56.137 fused_ordering(982) 00:13:56.137 fused_ordering(983) 00:13:56.137 fused_ordering(984) 00:13:56.137 fused_ordering(985) 00:13:56.137 fused_ordering(986) 00:13:56.137 fused_ordering(987) 00:13:56.137 fused_ordering(988) 00:13:56.137 fused_ordering(989) 00:13:56.137 fused_ordering(990) 00:13:56.137 fused_ordering(991) 00:13:56.137 fused_ordering(992) 00:13:56.137 fused_ordering(993) 00:13:56.137 fused_ordering(994) 00:13:56.137 fused_ordering(995) 00:13:56.137 fused_ordering(996) 00:13:56.137 fused_ordering(997) 00:13:56.137 fused_ordering(998) 00:13:56.137 fused_ordering(999) 00:13:56.137 fused_ordering(1000) 00:13:56.137 fused_ordering(1001) 00:13:56.137 fused_ordering(1002) 00:13:56.137 fused_ordering(1003) 00:13:56.137 fused_ordering(1004) 00:13:56.137 fused_ordering(1005) 00:13:56.137 fused_ordering(1006) 00:13:56.137 fused_ordering(1007) 00:13:56.137 fused_ordering(1008) 00:13:56.137 fused_ordering(1009) 00:13:56.137 fused_ordering(1010) 00:13:56.137 fused_ordering(1011) 00:13:56.137 fused_ordering(1012) 00:13:56.137 fused_ordering(1013) 00:13:56.137 fused_ordering(1014) 00:13:56.137 fused_ordering(1015) 00:13:56.137 fused_ordering(1016) 00:13:56.137 fused_ordering(1017) 00:13:56.137 fused_ordering(1018) 00:13:56.137 fused_ordering(1019) 00:13:56.137 fused_ordering(1020) 00:13:56.137 fused_ordering(1021) 00:13:56.137 fused_ordering(1022) 00:13:56.137 fused_ordering(1023) 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@121 -- # sync 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@124 -- # set +e 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:56.137 rmmod nvme_tcp 00:13:56.137 rmmod nvme_fabrics 00:13:56.137 rmmod nvme_keyring 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@128 -- # set -e 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@129 -- # return 0 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@515 -- # '[' -n 607060 ']' 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@516 -- # killprocess 607060 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@950 -- # '[' -z 607060 ']' 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@954 -- # kill -0 607060 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@955 -- # uname 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 607060 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@968 -- # echo 'killing process with pid 607060' 00:13:56.137 killing process with pid 607060 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@969 -- # kill 607060 00:13:56.137 13:24:51 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@974 -- # wait 607060 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@297 -- # iptr 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # iptables-save 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # iptables-restore 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@302 -- # remove_spdk_ns 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:56.395 13:24:52 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:13:58.301 00:13:58.301 real 0m7.718s 00:13:58.301 user 0m4.934s 00:13:58.301 sys 0m3.627s 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:13:58.301 ************************************ 00:13:58.301 END TEST nvmf_fused_ordering 00:13:58.301 ************************************ 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@26 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=tcp 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:13:58.301 ************************************ 00:13:58.301 START TEST nvmf_ns_masking 00:13:58.301 ************************************ 00:13:58.301 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1125 -- # test/nvmf/target/ns_masking.sh --transport=tcp 00:13:58.559 * Looking for test storage... 00:13:58.559 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # lcov --version 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@336 -- # IFS=.-: 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@336 -- # read -ra ver1 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@337 -- # IFS=.-: 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@337 -- # read -ra ver2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@338 -- # local 'op=<' 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@340 -- # ver1_l=2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@341 -- # ver2_l=1 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@344 -- # case "$op" in 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@345 -- # : 1 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@365 -- # decimal 1 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@353 -- # local d=1 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@355 -- # echo 1 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@365 -- # ver1[v]=1 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@366 -- # decimal 2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@353 -- # local d=2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@355 -- # echo 2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@366 -- # ver2[v]=2 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@368 -- # return 0 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:58.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:58.559 --rc genhtml_branch_coverage=1 00:13:58.559 --rc genhtml_function_coverage=1 00:13:58.559 --rc genhtml_legend=1 00:13:58.559 --rc geninfo_all_blocks=1 00:13:58.559 --rc geninfo_unexecuted_blocks=1 00:13:58.559 00:13:58.559 ' 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:58.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:58.559 --rc genhtml_branch_coverage=1 00:13:58.559 --rc genhtml_function_coverage=1 00:13:58.559 --rc genhtml_legend=1 00:13:58.559 --rc geninfo_all_blocks=1 00:13:58.559 --rc geninfo_unexecuted_blocks=1 00:13:58.559 00:13:58.559 ' 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:58.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:58.559 --rc genhtml_branch_coverage=1 00:13:58.559 --rc genhtml_function_coverage=1 00:13:58.559 --rc genhtml_legend=1 00:13:58.559 --rc geninfo_all_blocks=1 00:13:58.559 --rc geninfo_unexecuted_blocks=1 00:13:58.559 00:13:58.559 ' 00:13:58.559 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:58.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:58.560 --rc genhtml_branch_coverage=1 00:13:58.560 --rc genhtml_function_coverage=1 00:13:58.560 --rc genhtml_legend=1 00:13:58.560 --rc geninfo_all_blocks=1 00:13:58.560 --rc geninfo_unexecuted_blocks=1 00:13:58.560 00:13:58.560 ' 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@7 -- # uname -s 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@15 -- # shopt -s extglob 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@5 -- # export PATH 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@51 -- # : 0 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:58.560 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@11 -- # hostsock=/var/tmp/host.sock 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@12 -- # loops=5 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@13 -- # uuidgen 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@13 -- # ns1uuid=2e13741f-f08b-4a9c-9fca-8ebb1388d462 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@14 -- # uuidgen 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@14 -- # ns2uuid=6a5c4bb7-6dad-448a-8830-9ce3ffa4b834 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@16 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@17 -- # HOSTNQN1=nqn.2016-06.io.spdk:host1 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@18 -- # HOSTNQN2=nqn.2016-06.io.spdk:host2 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@19 -- # uuidgen 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@19 -- # HOSTID=979758e1-7eda-40de-a5ae-abf8a6e08045 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@50 -- # nvmftestinit 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@309 -- # xtrace_disable 00:13:58.560 13:24:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@315 -- # pci_devs=() 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@315 -- # local -a pci_devs 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@316 -- # pci_net_devs=() 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@317 -- # pci_drivers=() 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@317 -- # local -A pci_drivers 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@319 -- # net_devs=() 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@319 -- # local -ga net_devs 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@320 -- # e810=() 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@320 -- # local -ga e810 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@321 -- # x722=() 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@321 -- # local -ga x722 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@322 -- # mlx=() 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@322 -- # local -ga mlx 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:14:01.096 Found 0000:84:00.0 (0x8086 - 0x159b) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:14:01.096 Found 0000:84:00.1 (0x8086 - 0x159b) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@416 -- # [[ up == up ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:14:01.096 Found net devices under 0000:84:00.0: cvl_0_0 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@416 -- # [[ up == up ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:14:01.096 Found net devices under 0000:84:00.1: cvl_0_1 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@440 -- # is_hw=yes 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:14:01.096 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:14:01.097 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:01.097 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:14:01.097 00:14:01.097 --- 10.0.0.2 ping statistics --- 00:14:01.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.097 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:01.097 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:01.097 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:14:01.097 00:14:01.097 --- 10.0.0.1 ping statistics --- 00:14:01.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:01.097 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@448 -- # return 0 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@51 -- # nvmfappstart 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@507 -- # nvmfpid=609430 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@508 -- # waitforlisten 609430 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@831 -- # '[' -z 609430 ']' 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:01.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:01.097 13:24:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:14:01.097 [2024-10-07 13:24:56.870730] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:01.097 [2024-10-07 13:24:56.870826] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:01.097 [2024-10-07 13:24:56.934249] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:01.355 [2024-10-07 13:24:57.036376] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:01.355 [2024-10-07 13:24:57.036414] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:01.355 [2024-10-07 13:24:57.036435] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:01.355 [2024-10-07 13:24:57.036446] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:01.355 [2024-10-07 13:24:57.036455] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:01.355 [2024-10-07 13:24:57.037028] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:01.355 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:01.355 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@864 -- # return 0 00:14:01.355 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:01.355 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:01.355 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:14:01.355 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:01.355 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:01.613 [2024-10-07 13:24:57.476823] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:01.613 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@55 -- # MALLOC_BDEV_SIZE=64 00:14:01.613 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@56 -- # MALLOC_BLOCK_SIZE=512 00:14:01.613 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:14:01.871 Malloc1 00:14:01.871 13:24:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:14:02.436 Malloc2 00:14:02.436 13:24:58 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:02.693 13:24:58 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:14:02.949 13:24:58 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:03.207 [2024-10-07 13:24:58.971244] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:03.207 13:24:58 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@67 -- # connect 00:14:03.207 13:24:58 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 979758e1-7eda-40de-a5ae-abf8a6e08045 -a 10.0.0.2 -s 4420 -i 4 00:14:03.464 13:24:59 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 00:14:03.464 13:24:59 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:14:03.464 13:24:59 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:14:03.464 13:24:59 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:14:03.464 13:24:59 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@68 -- # ns_is_visible 0x1 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:05.361 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:05.619 [ 0]:0x1 00:14:05.619 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:05.619 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:05.619 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=21ea4c5e209d4ee297c879d817b7e769 00:14:05.619 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 21ea4c5e209d4ee297c879d817b7e769 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:05.619 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@72 -- # ns_is_visible 0x1 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:05.877 [ 0]:0x1 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=21ea4c5e209d4ee297c879d817b7e769 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 21ea4c5e209d4ee297c879d817b7e769 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@73 -- # ns_is_visible 0x2 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:14:05.877 [ 1]:0x2 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=03fbd3743fda466785b443f2b9e345bb 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 03fbd3743fda466785b443f2b9e345bb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@75 -- # disconnect 00:14:05.877 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:06.153 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:06.153 13:25:01 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.410 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@83 -- # connect 1 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 979758e1-7eda-40de-a5ae-abf8a6e08045 -a 10.0.0.2 -s 4420 -i 4 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 1 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n 1 ]] 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1201 -- # nvme_device_counter=1 00:14:06.668 13:25:02 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@84 -- # NOT ns_is_visible 0x1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@85 -- # ns_is_visible 0x2 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:14:09.194 [ 0]:0x2 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=03fbd3743fda466785b443f2b9e345bb 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 03fbd3743fda466785b443f2b9e345bb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@89 -- # ns_is_visible 0x1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:09.194 [ 0]:0x1 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=21ea4c5e209d4ee297c879d817b7e769 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 21ea4c5e209d4ee297c879d817b7e769 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@90 -- # ns_is_visible 0x2 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:09.194 13:25:04 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:14:09.194 [ 1]:0x2 00:14:09.194 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:09.194 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:09.194 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=03fbd3743fda466785b443f2b9e345bb 00:14:09.194 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 03fbd3743fda466785b443f2b9e345bb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:09.194 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@94 -- # NOT ns_is_visible 0x1 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:09.452 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@95 -- # ns_is_visible 0x2 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:14:09.709 [ 0]:0x2 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=03fbd3743fda466785b443f2b9e345bb 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 03fbd3743fda466785b443f2b9e345bb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@97 -- # disconnect 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:09.709 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:09.709 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:09.967 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@101 -- # connect 2 00:14:09.967 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 979758e1-7eda-40de-a5ae-abf8a6e08045 -a 10.0.0.2 -s 4420 -i 4 00:14:10.225 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:10.225 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:14:10.225 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:14:10.225 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n 2 ]] 00:14:10.225 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1201 -- # nvme_device_counter=2 00:14:10.225 13:25:05 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=2 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:14:12.123 13:25:07 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:12.123 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:14:12.123 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:14:12.123 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@102 -- # ns_is_visible 0x1 00:14:12.123 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:12.123 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:12.123 [ 0]:0x1 00:14:12.123 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:12.123 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=21ea4c5e209d4ee297c879d817b7e769 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 21ea4c5e209d4ee297c879d817b7e769 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@103 -- # ns_is_visible 0x2 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:14:12.404 [ 1]:0x2 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=03fbd3743fda466785b443f2b9e345bb 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 03fbd3743fda466785b443f2b9e345bb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:12.404 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@107 -- # NOT ns_is_visible 0x1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@108 -- # ns_is_visible 0x2 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:14:12.661 [ 0]:0x2 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=03fbd3743fda466785b443f2b9e345bb 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 03fbd3743fda466785b443f2b9e345bb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@111 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:12.661 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:12.919 [2024-10-07 13:25:08.816920] nvmf_rpc.c:1870:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:14:12.919 request: 00:14:12.919 { 00:14:12.919 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:14:12.919 "nsid": 2, 00:14:12.919 "host": "nqn.2016-06.io.spdk:host1", 00:14:12.919 "method": "nvmf_ns_remove_host", 00:14:12.919 "req_id": 1 00:14:12.919 } 00:14:12.919 Got JSON-RPC error response 00:14:12.919 response: 00:14:12.919 { 00:14:12.919 "code": -32602, 00:14:12.919 "message": "Invalid parameters" 00:14:12.919 } 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@112 -- # NOT ns_is_visible 0x1 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:12.919 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@113 -- # ns_is_visible 0x2 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:14:13.177 [ 0]:0x2 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=03fbd3743fda466785b443f2b9e345bb 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 03fbd3743fda466785b443f2b9e345bb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@114 -- # disconnect 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:13.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@118 -- # hostpid=610929 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@117 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -r /var/tmp/host.sock -m 2 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@119 -- # trap 'killprocess $hostpid; nvmftestfini' SIGINT SIGTERM EXIT 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@121 -- # waitforlisten 610929 /var/tmp/host.sock 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@831 -- # '[' -z 610929 ']' 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/host.sock 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock...' 00:14:13.177 Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock... 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:13.177 13:25:08 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:14:13.177 [2024-10-07 13:25:09.020656] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:13.177 [2024-10-07 13:25:09.020756] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid610929 ] 00:14:13.177 [2024-10-07 13:25:09.078527] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:13.435 [2024-10-07 13:25:09.187719] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:13.693 13:25:09 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:13.693 13:25:09 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@864 -- # return 0 00:14:13.693 13:25:09 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@122 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.950 13:25:09 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:14.208 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@124 -- # uuid2nguid 2e13741f-f08b-4a9c-9fca-8ebb1388d462 00:14:14.208 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@785 -- # tr -d - 00:14:14.208 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@124 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 -g 2E13741FF08B4A9C9FCA8EBB1388D462 -i 00:14:14.773 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@125 -- # uuid2nguid 6a5c4bb7-6dad-448a-8830-9ce3ffa4b834 00:14:14.773 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@785 -- # tr -d - 00:14:14.773 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 -g 6A5C4BB76DAD448A88309CE3FFA4B834 -i 00:14:14.773 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:15.030 13:25:10 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@127 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host2 00:14:15.288 13:25:11 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@129 -- # hostrpc bdev_nvme_attach_controller -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -b nvme0 00:14:15.288 13:25:11 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -b nvme0 00:14:15.854 nvme0n1 00:14:15.854 13:25:11 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@131 -- # hostrpc bdev_nvme_attach_controller -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 -b nvme1 00:14:15.854 13:25:11 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 -b nvme1 00:14:16.419 nvme1n2 00:14:16.419 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # hostrpc bdev_get_bdevs 00:14:16.419 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # jq -r '.[].name' 00:14:16.419 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs 00:14:16.419 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # sort 00:14:16.419 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # xargs 00:14:16.677 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # [[ nvme0n1 nvme1n2 == \n\v\m\e\0\n\1\ \n\v\m\e\1\n\2 ]] 00:14:16.677 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # hostrpc bdev_get_bdevs -b nvme0n1 00:14:16.677 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # jq -r '.[].uuid' 00:14:16.677 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs -b nvme0n1 00:14:16.935 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # [[ 2e13741f-f08b-4a9c-9fca-8ebb1388d462 == \2\e\1\3\7\4\1\f\-\f\0\8\b\-\4\a\9\c\-\9\f\c\a\-\8\e\b\b\1\3\8\8\d\4\6\2 ]] 00:14:16.935 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # hostrpc bdev_get_bdevs -b nvme1n2 00:14:16.935 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # jq -r '.[].uuid' 00:14:16.935 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs -b nvme1n2 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # [[ 6a5c4bb7-6dad-448a-8830-9ce3ffa4b834 == \6\a\5\c\4\b\b\7\-\6\d\a\d\-\4\4\8\a\-\8\8\3\0\-\9\c\e\3\f\f\a\4\b\8\3\4 ]] 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@138 -- # killprocess 610929 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@950 -- # '[' -z 610929 ']' 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@954 -- # kill -0 610929 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # uname 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 610929 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@968 -- # echo 'killing process with pid 610929' 00:14:17.193 killing process with pid 610929 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@969 -- # kill 610929 00:14:17.193 13:25:12 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@974 -- # wait 610929 00:14:17.758 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@141 -- # trap - SIGINT SIGTERM EXIT 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@142 -- # nvmftestfini 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@121 -- # sync 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@124 -- # set +e 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:18.016 rmmod nvme_tcp 00:14:18.016 rmmod nvme_fabrics 00:14:18.016 rmmod nvme_keyring 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@128 -- # set -e 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@129 -- # return 0 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@515 -- # '[' -n 609430 ']' 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@516 -- # killprocess 609430 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@950 -- # '[' -z 609430 ']' 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@954 -- # kill -0 609430 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # uname 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 609430 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@968 -- # echo 'killing process with pid 609430' 00:14:18.016 killing process with pid 609430 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@969 -- # kill 609430 00:14:18.016 13:25:13 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@974 -- # wait 609430 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@297 -- # iptr 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # iptables-save 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # iptables-restore 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@302 -- # remove_spdk_ns 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:18.275 13:25:14 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:14:20.846 00:14:20.846 real 0m22.002s 00:14:20.846 user 0m29.190s 00:14:20.846 sys 0m4.360s 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:14:20.846 ************************************ 00:14:20.846 END TEST nvmf_ns_masking 00:14:20.846 ************************************ 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@27 -- # [[ 1 -eq 1 ]] 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@28 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:20.846 ************************************ 00:14:20.846 START TEST nvmf_nvme_cli 00:14:20.846 ************************************ 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:20.846 * Looking for test storage... 00:14:20.846 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:20.846 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1681 -- # lcov --version 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@336 -- # IFS=.-: 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@336 -- # read -ra ver1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@337 -- # IFS=.-: 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@337 -- # read -ra ver2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@338 -- # local 'op=<' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@340 -- # ver1_l=2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@341 -- # ver2_l=1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@344 -- # case "$op" in 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@345 -- # : 1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@365 -- # decimal 1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@353 -- # local d=1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@355 -- # echo 1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@365 -- # ver1[v]=1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@366 -- # decimal 2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@353 -- # local d=2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@355 -- # echo 2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@366 -- # ver2[v]=2 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@368 -- # return 0 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:20.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.847 --rc genhtml_branch_coverage=1 00:14:20.847 --rc genhtml_function_coverage=1 00:14:20.847 --rc genhtml_legend=1 00:14:20.847 --rc geninfo_all_blocks=1 00:14:20.847 --rc geninfo_unexecuted_blocks=1 00:14:20.847 00:14:20.847 ' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:20.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.847 --rc genhtml_branch_coverage=1 00:14:20.847 --rc genhtml_function_coverage=1 00:14:20.847 --rc genhtml_legend=1 00:14:20.847 --rc geninfo_all_blocks=1 00:14:20.847 --rc geninfo_unexecuted_blocks=1 00:14:20.847 00:14:20.847 ' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:20.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.847 --rc genhtml_branch_coverage=1 00:14:20.847 --rc genhtml_function_coverage=1 00:14:20.847 --rc genhtml_legend=1 00:14:20.847 --rc geninfo_all_blocks=1 00:14:20.847 --rc geninfo_unexecuted_blocks=1 00:14:20.847 00:14:20.847 ' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:20.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.847 --rc genhtml_branch_coverage=1 00:14:20.847 --rc genhtml_function_coverage=1 00:14:20.847 --rc genhtml_legend=1 00:14:20.847 --rc geninfo_all_blocks=1 00:14:20.847 --rc geninfo_unexecuted_blocks=1 00:14:20.847 00:14:20.847 ' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@7 -- # uname -s 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@15 -- # shopt -s extglob 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- paths/export.sh@5 -- # export PATH 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@51 -- # : 0 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:20.847 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@14 -- # devs=() 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@474 -- # prepare_net_devs 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@436 -- # local -g is_hw=no 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@438 -- # remove_spdk_ns 00:14:20.847 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:20.848 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:20.848 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:20.848 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:14:20.848 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:14:20.848 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@309 -- # xtrace_disable 00:14:20.848 13:25:16 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@315 -- # pci_devs=() 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@315 -- # local -a pci_devs 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@316 -- # pci_net_devs=() 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@317 -- # pci_drivers=() 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@317 -- # local -A pci_drivers 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@319 -- # net_devs=() 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@319 -- # local -ga net_devs 00:14:22.814 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@320 -- # e810=() 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@320 -- # local -ga e810 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@321 -- # x722=() 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@321 -- # local -ga x722 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@322 -- # mlx=() 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@322 -- # local -ga mlx 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:14:22.815 Found 0000:84:00.0 (0x8086 - 0x159b) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:14:22.815 Found 0000:84:00.1 (0x8086 - 0x159b) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@416 -- # [[ up == up ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:14:22.815 Found net devices under 0000:84:00.0: cvl_0_0 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@416 -- # [[ up == up ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:14:22.815 Found net devices under 0000:84:00.1: cvl_0_1 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@440 -- # is_hw=yes 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:14:22.815 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:22.815 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:14:22.815 00:14:22.815 --- 10.0.0.2 ping statistics --- 00:14:22.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.815 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:14:22.815 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:22.815 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:22.815 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:14:22.815 00:14:22.815 --- 10.0.0.1 ping statistics --- 00:14:22.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.816 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@448 -- # return 0 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:22.816 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@507 -- # nvmfpid=613576 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@508 -- # waitforlisten 613576 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@831 -- # '[' -z 613576 ']' 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:23.074 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:23.074 13:25:18 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.074 [2024-10-07 13:25:18.820964] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:23.074 [2024-10-07 13:25:18.821040] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:23.074 [2024-10-07 13:25:18.884550] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:23.074 [2024-10-07 13:25:18.997410] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:23.074 [2024-10-07 13:25:18.997497] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:23.074 [2024-10-07 13:25:18.997514] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:23.074 [2024-10-07 13:25:18.997525] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:23.074 [2024-10-07 13:25:18.997535] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:23.074 [2024-10-07 13:25:18.999531] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:23.074 [2024-10-07 13:25:18.999589] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:23.074 [2024-10-07 13:25:18.999656] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:23.074 [2024-10-07 13:25:18.999659] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@864 -- # return 0 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 [2024-10-07 13:25:19.167061] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 Malloc0 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 Malloc1 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 [2024-10-07 13:25:19.249009] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.332 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -a 10.0.0.2 -s 4420 00:14:23.590 00:14:23.590 Discovery Log Number of Records 2, Generation counter 2 00:14:23.590 =====Discovery Log Entry 0====== 00:14:23.590 trtype: tcp 00:14:23.590 adrfam: ipv4 00:14:23.590 subtype: current discovery subsystem 00:14:23.590 treq: not required 00:14:23.590 portid: 0 00:14:23.590 trsvcid: 4420 00:14:23.590 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:23.590 traddr: 10.0.0.2 00:14:23.590 eflags: explicit discovery connections, duplicate discovery information 00:14:23.590 sectype: none 00:14:23.590 =====Discovery Log Entry 1====== 00:14:23.590 trtype: tcp 00:14:23.590 adrfam: ipv4 00:14:23.590 subtype: nvme subsystem 00:14:23.590 treq: not required 00:14:23.590 portid: 0 00:14:23.590 trsvcid: 4420 00:14:23.590 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:23.590 traddr: 10.0.0.2 00:14:23.590 eflags: none 00:14:23.590 sectype: none 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@548 -- # local dev _ 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@547 -- # nvme list 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ Node == /dev/nvme* ]] 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ --------------------- == /dev/nvme* ]] 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:23.590 13:25:19 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid=cd6acfbe-4794-e311-a299-001e67a97b02 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:24.155 13:25:20 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:24.155 13:25:20 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1198 -- # local i=0 00:14:24.155 13:25:20 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:14:24.155 13:25:20 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1200 -- # [[ -n 2 ]] 00:14:24.155 13:25:20 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1201 -- # nvme_device_counter=2 00:14:24.155 13:25:20 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1205 -- # sleep 2 00:14:26.679 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1207 -- # nvme_devices=2 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1208 -- # return 0 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@548 -- # local dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@547 -- # nvme list 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ Node == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ --------------------- == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@552 -- # echo /dev/nvme0n1 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@552 -- # echo /dev/nvme0n2 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:26.680 /dev/nvme0n2 ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@548 -- # local dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@547 -- # nvme list 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ Node == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ --------------------- == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@552 -- # echo /dev/nvme0n1 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@551 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@552 -- # echo /dev/nvme0n2 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@550 -- # read -r dev _ 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:26.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:26.680 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1219 -- # local i=0 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1231 -- # return 0 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@121 -- # sync 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@124 -- # set +e 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:26.937 rmmod nvme_tcp 00:14:26.937 rmmod nvme_fabrics 00:14:26.937 rmmod nvme_keyring 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@128 -- # set -e 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@129 -- # return 0 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@515 -- # '[' -n 613576 ']' 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@516 -- # killprocess 613576 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@950 -- # '[' -z 613576 ']' 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@954 -- # kill -0 613576 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@955 -- # uname 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 613576 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@968 -- # echo 'killing process with pid 613576' 00:14:26.937 killing process with pid 613576 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@969 -- # kill 613576 00:14:26.937 13:25:22 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@974 -- # wait 613576 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@297 -- # iptr 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@789 -- # iptables-save 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@789 -- # iptables-restore 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@302 -- # remove_spdk_ns 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:27.196 13:25:23 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:29.730 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:14:29.730 00:14:29.730 real 0m8.804s 00:14:29.730 user 0m16.626s 00:14:29.730 sys 0m2.372s 00:14:29.730 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_nvme_cli -- common/autotest_common.sh@10 -- # set +x 00:14:29.731 ************************************ 00:14:29.731 END TEST nvmf_nvme_cli 00:14:29.731 ************************************ 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@30 -- # [[ 1 -eq 1 ]] 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@31 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:29.731 ************************************ 00:14:29.731 START TEST nvmf_vfio_user 00:14:29.731 ************************************ 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:14:29.731 * Looking for test storage... 00:14:29.731 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1681 -- # lcov --version 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@336 -- # IFS=.-: 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@336 -- # read -ra ver1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@337 -- # IFS=.-: 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@337 -- # read -ra ver2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@338 -- # local 'op=<' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@340 -- # ver1_l=2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@341 -- # ver2_l=1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@344 -- # case "$op" in 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@345 -- # : 1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@365 -- # decimal 1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@353 -- # local d=1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@355 -- # echo 1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@365 -- # ver1[v]=1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@366 -- # decimal 2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@353 -- # local d=2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@355 -- # echo 2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@366 -- # ver2[v]=2 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@368 -- # return 0 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:29.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:29.731 --rc genhtml_branch_coverage=1 00:14:29.731 --rc genhtml_function_coverage=1 00:14:29.731 --rc genhtml_legend=1 00:14:29.731 --rc geninfo_all_blocks=1 00:14:29.731 --rc geninfo_unexecuted_blocks=1 00:14:29.731 00:14:29.731 ' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:29.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:29.731 --rc genhtml_branch_coverage=1 00:14:29.731 --rc genhtml_function_coverage=1 00:14:29.731 --rc genhtml_legend=1 00:14:29.731 --rc geninfo_all_blocks=1 00:14:29.731 --rc geninfo_unexecuted_blocks=1 00:14:29.731 00:14:29.731 ' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:29.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:29.731 --rc genhtml_branch_coverage=1 00:14:29.731 --rc genhtml_function_coverage=1 00:14:29.731 --rc genhtml_legend=1 00:14:29.731 --rc geninfo_all_blocks=1 00:14:29.731 --rc geninfo_unexecuted_blocks=1 00:14:29.731 00:14:29.731 ' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:29.731 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:29.731 --rc genhtml_branch_coverage=1 00:14:29.731 --rc genhtml_function_coverage=1 00:14:29.731 --rc genhtml_legend=1 00:14:29.731 --rc geninfo_all_blocks=1 00:14:29.731 --rc geninfo_unexecuted_blocks=1 00:14:29.731 00:14:29.731 ' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@7 -- # uname -s 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@15 -- # shopt -s extglob 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- paths/export.sh@5 -- # export PATH 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:29.731 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@51 -- # : 0 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:29.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=614505 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 614505' 00:14:29.732 Process pid: 614505 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 614505 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@831 -- # '[' -z 614505 ']' 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:29.732 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@10 -- # set +x 00:14:29.732 [2024-10-07 13:25:25.372871] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:29.732 [2024-10-07 13:25:25.372959] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:29.732 [2024-10-07 13:25:25.432298] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:29.732 [2024-10-07 13:25:25.539733] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:29.732 [2024-10-07 13:25:25.539795] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:29.732 [2024-10-07 13:25:25.539810] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:29.732 [2024-10-07 13:25:25.539822] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:29.732 [2024-10-07 13:25:25.539832] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:29.732 [2024-10-07 13:25:25.541599] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:29.732 [2024-10-07 13:25:25.541630] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:29.732 [2024-10-07 13:25:25.541680] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:29.732 [2024-10-07 13:25:25.541683] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@864 -- # return 0 00:14:29.732 13:25:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:14:31.102 13:25:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:14:31.102 13:25:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:14:31.102 13:25:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:14:31.102 13:25:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:14:31.102 13:25:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:14:31.102 13:25:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:14:31.360 Malloc1 00:14:31.360 13:25:27 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:14:31.924 13:25:27 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:14:31.924 13:25:27 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:14:32.182 13:25:28 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:14:32.182 13:25:28 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:14:32.182 13:25:28 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:14:32.439 Malloc2 00:14:32.697 13:25:28 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:14:32.955 13:25:28 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:14:33.213 13:25:28 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:14:33.472 13:25:29 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:14:33.472 13:25:29 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:14:33.472 13:25:29 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:14:33.472 13:25:29 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:14:33.472 13:25:29 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:14:33.472 13:25:29 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:14:33.472 [2024-10-07 13:25:29.216147] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:33.472 [2024-10-07 13:25:29.216189] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid614930 ] 00:14:33.472 [2024-10-07 13:25:29.248934] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:14:33.472 [2024-10-07 13:25:29.257977] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:14:33.472 [2024-10-07 13:25:29.258007] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f8e2b1df000 00:14:33.472 [2024-10-07 13:25:29.258967] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.259964] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.260965] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.261976] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.262977] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.263983] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.264990] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.265993] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:33.472 [2024-10-07 13:25:29.267003] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:14:33.472 [2024-10-07 13:25:29.267023] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f8e2b1d4000 00:14:33.472 [2024-10-07 13:25:29.268144] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:14:33.472 [2024-10-07 13:25:29.283136] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:14:33.472 [2024-10-07 13:25:29.283177] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:14:33.472 [2024-10-07 13:25:29.288127] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:14:33.472 [2024-10-07 13:25:29.288182] nvme_pcie_common.c: 134:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:14:33.472 [2024-10-07 13:25:29.288284] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:14:33.472 [2024-10-07 13:25:29.288320] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:14:33.472 [2024-10-07 13:25:29.288331] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:14:33.472 [2024-10-07 13:25:29.289118] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:14:33.472 [2024-10-07 13:25:29.289140] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:14:33.472 [2024-10-07 13:25:29.289152] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:14:33.472 [2024-10-07 13:25:29.290124] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:14:33.472 [2024-10-07 13:25:29.290144] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:14:33.472 [2024-10-07 13:25:29.290158] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:14:33.472 [2024-10-07 13:25:29.291129] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:14:33.473 [2024-10-07 13:25:29.291147] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:14:33.473 [2024-10-07 13:25:29.292134] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:14:33.473 [2024-10-07 13:25:29.292154] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:14:33.473 [2024-10-07 13:25:29.292163] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:14:33.473 [2024-10-07 13:25:29.292179] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:14:33.473 [2024-10-07 13:25:29.292290] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:14:33.473 [2024-10-07 13:25:29.292299] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:14:33.473 [2024-10-07 13:25:29.292308] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:14:33.473 [2024-10-07 13:25:29.293498] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:14:33.473 [2024-10-07 13:25:29.294145] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:14:33.473 [2024-10-07 13:25:29.295150] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:14:33.473 [2024-10-07 13:25:29.296149] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:33.473 [2024-10-07 13:25:29.296245] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:14:33.473 [2024-10-07 13:25:29.297167] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:14:33.473 [2024-10-07 13:25:29.297185] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:14:33.473 [2024-10-07 13:25:29.297194] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297218] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:14:33.473 [2024-10-07 13:25:29.297232] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297262] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:33.473 [2024-10-07 13:25:29.297273] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:33.473 [2024-10-07 13:25:29.297279] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:33.473 [2024-10-07 13:25:29.297302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.297369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:14:33.473 [2024-10-07 13:25:29.297388] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:14:33.473 [2024-10-07 13:25:29.297398] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:14:33.473 [2024-10-07 13:25:29.297405] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:14:33.473 [2024-10-07 13:25:29.297412] nvme_ctrlr.c:2095:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:14:33.473 [2024-10-07 13:25:29.297420] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:14:33.473 [2024-10-07 13:25:29.297427] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:14:33.473 [2024-10-07 13:25:29.297434] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297452] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297483] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.297512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:14:33.473 [2024-10-07 13:25:29.297532] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:14:33.473 [2024-10-07 13:25:29.297545] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:14:33.473 [2024-10-07 13:25:29.297558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:14:33.473 [2024-10-07 13:25:29.297570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:14:33.473 [2024-10-07 13:25:29.297579] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297597] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297613] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.297626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:14:33.473 [2024-10-07 13:25:29.297638] nvme_ctrlr.c:3034:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:14:33.473 [2024-10-07 13:25:29.297646] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297657] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297672] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297686] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.297698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:14:33.473 [2024-10-07 13:25:29.297782] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297799] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297813] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:14:33.473 [2024-10-07 13:25:29.297821] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:14:33.473 [2024-10-07 13:25:29.297827] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:33.473 [2024-10-07 13:25:29.297837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.297854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:14:33.473 [2024-10-07 13:25:29.297880] nvme_ctrlr.c:4722:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:14:33.473 [2024-10-07 13:25:29.297901] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297918] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.297930] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:33.473 [2024-10-07 13:25:29.297937] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:33.473 [2024-10-07 13:25:29.297943] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:33.473 [2024-10-07 13:25:29.297952] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.297983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:14:33.473 [2024-10-07 13:25:29.298007] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298022] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298034] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:33.473 [2024-10-07 13:25:29.298042] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:33.473 [2024-10-07 13:25:29.298048] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:33.473 [2024-10-07 13:25:29.298057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.298074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:14:33.473 [2024-10-07 13:25:29.298089] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298101] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298115] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298126] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host behavior support feature (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298134] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298142] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298151] nvme_ctrlr.c:3134:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:14:33.473 [2024-10-07 13:25:29.298159] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:14:33.473 [2024-10-07 13:25:29.298167] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:14:33.473 [2024-10-07 13:25:29.298195] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:14:33.473 [2024-10-07 13:25:29.298210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:14:33.474 [2024-10-07 13:25:29.298232] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:14:33.474 [2024-10-07 13:25:29.298244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:14:33.474 [2024-10-07 13:25:29.298261] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:14:33.474 [2024-10-07 13:25:29.298273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:14:33.474 [2024-10-07 13:25:29.298304] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:14:33.474 [2024-10-07 13:25:29.298317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:14:33.474 [2024-10-07 13:25:29.298341] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:14:33.474 [2024-10-07 13:25:29.298352] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:14:33.474 [2024-10-07 13:25:29.298358] nvme_pcie_common.c:1241:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:14:33.474 [2024-10-07 13:25:29.298364] nvme_pcie_common.c:1257:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:14:33.474 [2024-10-07 13:25:29.298370] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 2 00:14:33.474 [2024-10-07 13:25:29.298379] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:14:33.474 [2024-10-07 13:25:29.298391] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:14:33.474 [2024-10-07 13:25:29.298400] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:14:33.474 [2024-10-07 13:25:29.298406] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:33.474 [2024-10-07 13:25:29.298414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:14:33.474 [2024-10-07 13:25:29.298426] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:14:33.474 [2024-10-07 13:25:29.298434] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:33.474 [2024-10-07 13:25:29.298440] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:33.474 [2024-10-07 13:25:29.298448] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:33.474 [2024-10-07 13:25:29.298461] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:14:33.474 [2024-10-07 13:25:29.298484] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:14:33.474 [2024-10-07 13:25:29.298499] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:33.474 [2024-10-07 13:25:29.298508] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:14:33.474 [2024-10-07 13:25:29.298521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:14:33.474 [2024-10-07 13:25:29.298543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:14:33.474 [2024-10-07 13:25:29.298563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:14:33.474 [2024-10-07 13:25:29.298577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:14:33.474 ===================================================== 00:14:33.474 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:14:33.474 ===================================================== 00:14:33.474 Controller Capabilities/Features 00:14:33.474 ================================ 00:14:33.474 Vendor ID: 4e58 00:14:33.474 Subsystem Vendor ID: 4e58 00:14:33.474 Serial Number: SPDK1 00:14:33.474 Model Number: SPDK bdev Controller 00:14:33.474 Firmware Version: 25.01 00:14:33.474 Recommended Arb Burst: 6 00:14:33.474 IEEE OUI Identifier: 8d 6b 50 00:14:33.474 Multi-path I/O 00:14:33.474 May have multiple subsystem ports: Yes 00:14:33.474 May have multiple controllers: Yes 00:14:33.474 Associated with SR-IOV VF: No 00:14:33.474 Max Data Transfer Size: 131072 00:14:33.474 Max Number of Namespaces: 32 00:14:33.474 Max Number of I/O Queues: 127 00:14:33.474 NVMe Specification Version (VS): 1.3 00:14:33.474 NVMe Specification Version (Identify): 1.3 00:14:33.474 Maximum Queue Entries: 256 00:14:33.474 Contiguous Queues Required: Yes 00:14:33.474 Arbitration Mechanisms Supported 00:14:33.474 Weighted Round Robin: Not Supported 00:14:33.474 Vendor Specific: Not Supported 00:14:33.474 Reset Timeout: 15000 ms 00:14:33.474 Doorbell Stride: 4 bytes 00:14:33.474 NVM Subsystem Reset: Not Supported 00:14:33.474 Command Sets Supported 00:14:33.474 NVM Command Set: Supported 00:14:33.474 Boot Partition: Not Supported 00:14:33.474 Memory Page Size Minimum: 4096 bytes 00:14:33.474 Memory Page Size Maximum: 4096 bytes 00:14:33.474 Persistent Memory Region: Not Supported 00:14:33.474 Optional Asynchronous Events Supported 00:14:33.474 Namespace Attribute Notices: Supported 00:14:33.474 Firmware Activation Notices: Not Supported 00:14:33.474 ANA Change Notices: Not Supported 00:14:33.474 PLE Aggregate Log Change Notices: Not Supported 00:14:33.474 LBA Status Info Alert Notices: Not Supported 00:14:33.474 EGE Aggregate Log Change Notices: Not Supported 00:14:33.474 Normal NVM Subsystem Shutdown event: Not Supported 00:14:33.474 Zone Descriptor Change Notices: Not Supported 00:14:33.474 Discovery Log Change Notices: Not Supported 00:14:33.474 Controller Attributes 00:14:33.474 128-bit Host Identifier: Supported 00:14:33.474 Non-Operational Permissive Mode: Not Supported 00:14:33.474 NVM Sets: Not Supported 00:14:33.474 Read Recovery Levels: Not Supported 00:14:33.474 Endurance Groups: Not Supported 00:14:33.474 Predictable Latency Mode: Not Supported 00:14:33.474 Traffic Based Keep ALive: Not Supported 00:14:33.474 Namespace Granularity: Not Supported 00:14:33.474 SQ Associations: Not Supported 00:14:33.474 UUID List: Not Supported 00:14:33.474 Multi-Domain Subsystem: Not Supported 00:14:33.474 Fixed Capacity Management: Not Supported 00:14:33.474 Variable Capacity Management: Not Supported 00:14:33.474 Delete Endurance Group: Not Supported 00:14:33.474 Delete NVM Set: Not Supported 00:14:33.474 Extended LBA Formats Supported: Not Supported 00:14:33.474 Flexible Data Placement Supported: Not Supported 00:14:33.474 00:14:33.474 Controller Memory Buffer Support 00:14:33.474 ================================ 00:14:33.474 Supported: No 00:14:33.474 00:14:33.474 Persistent Memory Region Support 00:14:33.474 ================================ 00:14:33.474 Supported: No 00:14:33.474 00:14:33.474 Admin Command Set Attributes 00:14:33.474 ============================ 00:14:33.474 Security Send/Receive: Not Supported 00:14:33.474 Format NVM: Not Supported 00:14:33.474 Firmware Activate/Download: Not Supported 00:14:33.474 Namespace Management: Not Supported 00:14:33.474 Device Self-Test: Not Supported 00:14:33.474 Directives: Not Supported 00:14:33.474 NVMe-MI: Not Supported 00:14:33.474 Virtualization Management: Not Supported 00:14:33.474 Doorbell Buffer Config: Not Supported 00:14:33.474 Get LBA Status Capability: Not Supported 00:14:33.474 Command & Feature Lockdown Capability: Not Supported 00:14:33.474 Abort Command Limit: 4 00:14:33.474 Async Event Request Limit: 4 00:14:33.474 Number of Firmware Slots: N/A 00:14:33.474 Firmware Slot 1 Read-Only: N/A 00:14:33.474 Firmware Activation Without Reset: N/A 00:14:33.474 Multiple Update Detection Support: N/A 00:14:33.474 Firmware Update Granularity: No Information Provided 00:14:33.474 Per-Namespace SMART Log: No 00:14:33.474 Asymmetric Namespace Access Log Page: Not Supported 00:14:33.474 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:14:33.474 Command Effects Log Page: Supported 00:14:33.474 Get Log Page Extended Data: Supported 00:14:33.474 Telemetry Log Pages: Not Supported 00:14:33.474 Persistent Event Log Pages: Not Supported 00:14:33.474 Supported Log Pages Log Page: May Support 00:14:33.474 Commands Supported & Effects Log Page: Not Supported 00:14:33.474 Feature Identifiers & Effects Log Page:May Support 00:14:33.474 NVMe-MI Commands & Effects Log Page: May Support 00:14:33.474 Data Area 4 for Telemetry Log: Not Supported 00:14:33.474 Error Log Page Entries Supported: 128 00:14:33.474 Keep Alive: Supported 00:14:33.474 Keep Alive Granularity: 10000 ms 00:14:33.474 00:14:33.474 NVM Command Set Attributes 00:14:33.474 ========================== 00:14:33.474 Submission Queue Entry Size 00:14:33.474 Max: 64 00:14:33.474 Min: 64 00:14:33.474 Completion Queue Entry Size 00:14:33.474 Max: 16 00:14:33.475 Min: 16 00:14:33.475 Number of Namespaces: 32 00:14:33.475 Compare Command: Supported 00:14:33.475 Write Uncorrectable Command: Not Supported 00:14:33.475 Dataset Management Command: Supported 00:14:33.475 Write Zeroes Command: Supported 00:14:33.475 Set Features Save Field: Not Supported 00:14:33.475 Reservations: Not Supported 00:14:33.475 Timestamp: Not Supported 00:14:33.475 Copy: Supported 00:14:33.475 Volatile Write Cache: Present 00:14:33.475 Atomic Write Unit (Normal): 1 00:14:33.475 Atomic Write Unit (PFail): 1 00:14:33.475 Atomic Compare & Write Unit: 1 00:14:33.475 Fused Compare & Write: Supported 00:14:33.475 Scatter-Gather List 00:14:33.475 SGL Command Set: Supported (Dword aligned) 00:14:33.475 SGL Keyed: Not Supported 00:14:33.475 SGL Bit Bucket Descriptor: Not Supported 00:14:33.475 SGL Metadata Pointer: Not Supported 00:14:33.475 Oversized SGL: Not Supported 00:14:33.475 SGL Metadata Address: Not Supported 00:14:33.475 SGL Offset: Not Supported 00:14:33.475 Transport SGL Data Block: Not Supported 00:14:33.475 Replay Protected Memory Block: Not Supported 00:14:33.475 00:14:33.475 Firmware Slot Information 00:14:33.475 ========================= 00:14:33.475 Active slot: 1 00:14:33.475 Slot 1 Firmware Revision: 25.01 00:14:33.475 00:14:33.475 00:14:33.475 Commands Supported and Effects 00:14:33.475 ============================== 00:14:33.475 Admin Commands 00:14:33.475 -------------- 00:14:33.475 Get Log Page (02h): Supported 00:14:33.475 Identify (06h): Supported 00:14:33.475 Abort (08h): Supported 00:14:33.475 Set Features (09h): Supported 00:14:33.475 Get Features (0Ah): Supported 00:14:33.475 Asynchronous Event Request (0Ch): Supported 00:14:33.475 Keep Alive (18h): Supported 00:14:33.475 I/O Commands 00:14:33.475 ------------ 00:14:33.475 Flush (00h): Supported LBA-Change 00:14:33.475 Write (01h): Supported LBA-Change 00:14:33.475 Read (02h): Supported 00:14:33.475 Compare (05h): Supported 00:14:33.475 Write Zeroes (08h): Supported LBA-Change 00:14:33.475 Dataset Management (09h): Supported LBA-Change 00:14:33.475 Copy (19h): Supported LBA-Change 00:14:33.475 00:14:33.475 Error Log 00:14:33.475 ========= 00:14:33.475 00:14:33.475 Arbitration 00:14:33.475 =========== 00:14:33.475 Arbitration Burst: 1 00:14:33.475 00:14:33.475 Power Management 00:14:33.475 ================ 00:14:33.475 Number of Power States: 1 00:14:33.475 Current Power State: Power State #0 00:14:33.475 Power State #0: 00:14:33.475 Max Power: 0.00 W 00:14:33.475 Non-Operational State: Operational 00:14:33.475 Entry Latency: Not Reported 00:14:33.475 Exit Latency: Not Reported 00:14:33.475 Relative Read Throughput: 0 00:14:33.475 Relative Read Latency: 0 00:14:33.475 Relative Write Throughput: 0 00:14:33.475 Relative Write Latency: 0 00:14:33.475 Idle Power: Not Reported 00:14:33.475 Active Power: Not Reported 00:14:33.475 Non-Operational Permissive Mode: Not Supported 00:14:33.475 00:14:33.475 Health Information 00:14:33.475 ================== 00:14:33.475 Critical Warnings: 00:14:33.475 Available Spare Space: OK 00:14:33.475 Temperature: OK 00:14:33.475 Device Reliability: OK 00:14:33.475 Read Only: No 00:14:33.475 Volatile Memory Backup: OK 00:14:33.475 Current Temperature: 0 Kelvin (-273 Celsius) 00:14:33.475 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:14:33.475 Available Spare: 0% 00:14:33.475 Available Sp[2024-10-07 13:25:29.298714] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:14:33.475 [2024-10-07 13:25:29.298734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:14:33.475 [2024-10-07 13:25:29.298795] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:14:33.475 [2024-10-07 13:25:29.298830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:33.475 [2024-10-07 13:25:29.298842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:33.475 [2024-10-07 13:25:29.298852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:33.475 [2024-10-07 13:25:29.298861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:33.475 [2024-10-07 13:25:29.302499] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:14:33.475 [2024-10-07 13:25:29.302524] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:14:33.475 [2024-10-07 13:25:29.303199] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:33.475 [2024-10-07 13:25:29.303271] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:14:33.475 [2024-10-07 13:25:29.303284] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:14:33.475 [2024-10-07 13:25:29.304210] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:14:33.475 [2024-10-07 13:25:29.304234] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:14:33.475 [2024-10-07 13:25:29.304298] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:14:33.475 [2024-10-07 13:25:29.306251] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:14:33.475 are Threshold: 0% 00:14:33.475 Life Percentage Used: 0% 00:14:33.475 Data Units Read: 0 00:14:33.475 Data Units Written: 0 00:14:33.475 Host Read Commands: 0 00:14:33.475 Host Write Commands: 0 00:14:33.475 Controller Busy Time: 0 minutes 00:14:33.475 Power Cycles: 0 00:14:33.475 Power On Hours: 0 hours 00:14:33.475 Unsafe Shutdowns: 0 00:14:33.475 Unrecoverable Media Errors: 0 00:14:33.475 Lifetime Error Log Entries: 0 00:14:33.475 Warning Temperature Time: 0 minutes 00:14:33.475 Critical Temperature Time: 0 minutes 00:14:33.475 00:14:33.475 Number of Queues 00:14:33.475 ================ 00:14:33.475 Number of I/O Submission Queues: 127 00:14:33.475 Number of I/O Completion Queues: 127 00:14:33.475 00:14:33.475 Active Namespaces 00:14:33.475 ================= 00:14:33.475 Namespace ID:1 00:14:33.475 Error Recovery Timeout: Unlimited 00:14:33.475 Command Set Identifier: NVM (00h) 00:14:33.475 Deallocate: Supported 00:14:33.475 Deallocated/Unwritten Error: Not Supported 00:14:33.475 Deallocated Read Value: Unknown 00:14:33.475 Deallocate in Write Zeroes: Not Supported 00:14:33.475 Deallocated Guard Field: 0xFFFF 00:14:33.475 Flush: Supported 00:14:33.475 Reservation: Supported 00:14:33.475 Namespace Sharing Capabilities: Multiple Controllers 00:14:33.475 Size (in LBAs): 131072 (0GiB) 00:14:33.475 Capacity (in LBAs): 131072 (0GiB) 00:14:33.475 Utilization (in LBAs): 131072 (0GiB) 00:14:33.475 NGUID: B27DA7EBABD34D799EC7189772C78E37 00:14:33.475 UUID: b27da7eb-abd3-4d79-9ec7-189772c78e37 00:14:33.475 Thin Provisioning: Not Supported 00:14:33.475 Per-NS Atomic Units: Yes 00:14:33.475 Atomic Boundary Size (Normal): 0 00:14:33.475 Atomic Boundary Size (PFail): 0 00:14:33.475 Atomic Boundary Offset: 0 00:14:33.475 Maximum Single Source Range Length: 65535 00:14:33.475 Maximum Copy Length: 65535 00:14:33.475 Maximum Source Range Count: 1 00:14:33.475 NGUID/EUI64 Never Reused: No 00:14:33.475 Namespace Write Protected: No 00:14:33.475 Number of LBA Formats: 1 00:14:33.475 Current LBA Format: LBA Format #00 00:14:33.475 LBA Format #00: Data Size: 512 Metadata Size: 0 00:14:33.475 00:14:33.475 13:25:29 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:14:33.733 [2024-10-07 13:25:29.546416] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:38.993 Initializing NVMe Controllers 00:14:38.993 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:14:38.993 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:14:38.993 Initialization complete. Launching workers. 00:14:38.993 ======================================================== 00:14:38.993 Latency(us) 00:14:38.993 Device Information : IOPS MiB/s Average min max 00:14:38.993 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 31967.88 124.87 4003.30 1198.91 11466.51 00:14:38.993 ======================================================== 00:14:38.993 Total : 31967.88 124.87 4003.30 1198.91 11466.51 00:14:38.993 00:14:38.993 [2024-10-07 13:25:34.565572] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:38.993 13:25:34 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:14:38.993 [2024-10-07 13:25:34.808768] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:44.254 Initializing NVMe Controllers 00:14:44.254 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:14:44.254 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:14:44.254 Initialization complete. Launching workers. 00:14:44.254 ======================================================== 00:14:44.254 Latency(us) 00:14:44.254 Device Information : IOPS MiB/s Average min max 00:14:44.254 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16000.00 62.50 8008.38 4986.46 15979.87 00:14:44.254 ======================================================== 00:14:44.254 Total : 16000.00 62.50 8008.38 4986.46 15979.87 00:14:44.254 00:14:44.255 [2024-10-07 13:25:39.845630] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:44.255 13:25:39 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:14:44.255 [2024-10-07 13:25:40.061834] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:49.518 [2024-10-07 13:25:45.149878] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:49.518 Initializing NVMe Controllers 00:14:49.518 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:14:49.518 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:14:49.518 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:14:49.518 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:14:49.518 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:14:49.518 Initialization complete. Launching workers. 00:14:49.518 Starting thread on core 2 00:14:49.518 Starting thread on core 3 00:14:49.518 Starting thread on core 1 00:14:49.518 13:25:45 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:14:49.776 [2024-10-07 13:25:45.457934] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:53.057 [2024-10-07 13:25:48.520791] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:53.057 Initializing NVMe Controllers 00:14:53.057 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:14:53.057 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:14:53.057 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:14:53.057 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:14:53.057 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:14:53.057 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:14:53.057 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:14:53.057 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:14:53.057 Initialization complete. Launching workers. 00:14:53.057 Starting thread on core 1 with urgent priority queue 00:14:53.057 Starting thread on core 2 with urgent priority queue 00:14:53.057 Starting thread on core 3 with urgent priority queue 00:14:53.057 Starting thread on core 0 with urgent priority queue 00:14:53.057 SPDK bdev Controller (SPDK1 ) core 0: 5875.00 IO/s 17.02 secs/100000 ios 00:14:53.057 SPDK bdev Controller (SPDK1 ) core 1: 5557.00 IO/s 18.00 secs/100000 ios 00:14:53.057 SPDK bdev Controller (SPDK1 ) core 2: 5438.33 IO/s 18.39 secs/100000 ios 00:14:53.057 SPDK bdev Controller (SPDK1 ) core 3: 5231.00 IO/s 19.12 secs/100000 ios 00:14:53.057 ======================================================== 00:14:53.057 00:14:53.057 13:25:48 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:14:53.057 [2024-10-07 13:25:48.835026] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:53.057 Initializing NVMe Controllers 00:14:53.057 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:14:53.057 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:14:53.057 Namespace ID: 1 size: 0GB 00:14:53.057 Initialization complete. 00:14:53.057 INFO: using host memory buffer for IO 00:14:53.057 Hello world! 00:14:53.057 [2024-10-07 13:25:48.869635] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:53.057 13:25:48 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:14:53.315 [2024-10-07 13:25:49.170929] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:54.688 Initializing NVMe Controllers 00:14:54.688 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:14:54.688 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:14:54.688 Initialization complete. Launching workers. 00:14:54.688 submit (in ns) avg, min, max = 7761.6, 3531.1, 4017554.4 00:14:54.688 complete (in ns) avg, min, max = 23463.5, 2071.1, 4016488.9 00:14:54.688 00:14:54.688 Submit histogram 00:14:54.688 ================ 00:14:54.688 Range in us Cumulative Count 00:14:54.688 3.508 - 3.532: 0.0234% ( 3) 00:14:54.688 3.532 - 3.556: 0.5607% ( 69) 00:14:54.688 3.556 - 3.579: 2.0869% ( 196) 00:14:54.688 3.579 - 3.603: 5.1550% ( 394) 00:14:54.688 3.603 - 3.627: 10.6136% ( 701) 00:14:54.688 3.627 - 3.650: 19.1481% ( 1096) 00:14:54.688 3.650 - 3.674: 27.7371% ( 1103) 00:14:54.688 3.674 - 3.698: 34.9089% ( 921) 00:14:54.688 3.698 - 3.721: 41.1540% ( 802) 00:14:54.688 3.721 - 3.745: 46.4725% ( 683) 00:14:54.688 3.745 - 3.769: 50.7787% ( 553) 00:14:54.688 3.769 - 3.793: 54.4152% ( 467) 00:14:54.688 3.793 - 3.816: 57.7947% ( 434) 00:14:54.688 3.816 - 3.840: 60.9173% ( 401) 00:14:54.688 3.840 - 3.864: 65.2079% ( 551) 00:14:54.688 3.864 - 3.887: 69.9657% ( 611) 00:14:54.688 3.887 - 3.911: 74.7314% ( 612) 00:14:54.688 3.911 - 3.935: 78.9752% ( 545) 00:14:54.688 3.935 - 3.959: 81.8175% ( 365) 00:14:54.688 3.959 - 3.982: 84.1224% ( 296) 00:14:54.688 3.982 - 4.006: 86.1704% ( 263) 00:14:54.688 4.006 - 4.030: 87.7823% ( 207) 00:14:54.688 4.030 - 4.053: 88.7946% ( 130) 00:14:54.688 4.053 - 4.077: 89.8302% ( 133) 00:14:54.688 4.077 - 4.101: 90.9126% ( 139) 00:14:54.688 4.101 - 4.124: 92.1430% ( 158) 00:14:54.688 4.124 - 4.148: 93.1553% ( 130) 00:14:54.688 4.148 - 4.172: 93.9418% ( 101) 00:14:54.688 4.172 - 4.196: 94.3934% ( 58) 00:14:54.688 4.196 - 4.219: 94.8061% ( 53) 00:14:54.688 4.219 - 4.243: 95.2266% ( 54) 00:14:54.688 4.243 - 4.267: 95.5147% ( 37) 00:14:54.688 4.267 - 4.290: 95.8028% ( 37) 00:14:54.688 4.290 - 4.314: 95.9119% ( 14) 00:14:54.688 4.314 - 4.338: 96.0987% ( 24) 00:14:54.688 4.338 - 4.361: 96.2545% ( 20) 00:14:54.688 4.361 - 4.385: 96.3869% ( 17) 00:14:54.688 4.385 - 4.409: 96.4258% ( 5) 00:14:54.688 4.409 - 4.433: 96.4569% ( 4) 00:14:54.688 4.433 - 4.456: 96.4881% ( 4) 00:14:54.688 4.456 - 4.480: 96.5426% ( 7) 00:14:54.688 4.480 - 4.504: 96.5893% ( 6) 00:14:54.688 4.504 - 4.527: 96.6594% ( 9) 00:14:54.688 4.527 - 4.551: 96.6750% ( 2) 00:14:54.688 4.551 - 4.575: 96.6983% ( 3) 00:14:54.688 4.575 - 4.599: 96.7061% ( 1) 00:14:54.688 4.599 - 4.622: 96.7139% ( 1) 00:14:54.688 4.622 - 4.646: 96.7451% ( 4) 00:14:54.688 4.646 - 4.670: 96.7684% ( 3) 00:14:54.688 4.670 - 4.693: 96.7762% ( 1) 00:14:54.688 4.693 - 4.717: 96.7996% ( 3) 00:14:54.688 4.717 - 4.741: 96.8074% ( 1) 00:14:54.688 4.741 - 4.764: 96.8307% ( 3) 00:14:54.688 4.764 - 4.788: 96.8463% ( 2) 00:14:54.688 4.788 - 4.812: 96.8541% ( 1) 00:14:54.688 4.812 - 4.836: 96.8619% ( 1) 00:14:54.688 4.883 - 4.907: 96.8774% ( 2) 00:14:54.688 4.907 - 4.930: 96.9086% ( 4) 00:14:54.688 4.954 - 4.978: 96.9553% ( 6) 00:14:54.688 4.978 - 5.001: 97.0332% ( 10) 00:14:54.688 5.001 - 5.025: 97.0721% ( 5) 00:14:54.688 5.025 - 5.049: 97.1344% ( 8) 00:14:54.688 5.049 - 5.073: 97.2045% ( 9) 00:14:54.688 5.073 - 5.096: 97.2590% ( 7) 00:14:54.688 5.096 - 5.120: 97.3135% ( 7) 00:14:54.688 5.120 - 5.144: 97.3836% ( 9) 00:14:54.688 5.144 - 5.167: 97.4147% ( 4) 00:14:54.688 5.167 - 5.191: 97.4459% ( 4) 00:14:54.688 5.191 - 5.215: 97.4770% ( 4) 00:14:54.688 5.215 - 5.239: 97.5315% ( 7) 00:14:54.688 5.239 - 5.262: 97.5705% ( 5) 00:14:54.688 5.262 - 5.286: 97.5938% ( 3) 00:14:54.688 5.286 - 5.310: 97.6094% ( 2) 00:14:54.688 5.310 - 5.333: 97.6406% ( 4) 00:14:54.688 5.333 - 5.357: 97.6873% ( 6) 00:14:54.688 5.357 - 5.381: 97.7106% ( 3) 00:14:54.688 5.381 - 5.404: 97.7340% ( 3) 00:14:54.688 5.404 - 5.428: 97.7574% ( 3) 00:14:54.688 5.428 - 5.452: 97.7729% ( 2) 00:14:54.688 5.452 - 5.476: 97.7885% ( 2) 00:14:54.688 5.476 - 5.499: 97.7963% ( 1) 00:14:54.688 5.523 - 5.547: 97.8119% ( 2) 00:14:54.688 5.547 - 5.570: 97.8197% ( 1) 00:14:54.688 5.570 - 5.594: 97.8274% ( 1) 00:14:54.688 5.594 - 5.618: 97.8430% ( 2) 00:14:54.688 5.665 - 5.689: 97.8586% ( 2) 00:14:54.688 5.689 - 5.713: 97.8664% ( 1) 00:14:54.688 5.736 - 5.760: 97.8742% ( 1) 00:14:54.688 5.760 - 5.784: 97.8819% ( 1) 00:14:54.688 5.784 - 5.807: 97.8897% ( 1) 00:14:54.688 5.807 - 5.831: 97.9053% ( 2) 00:14:54.688 5.831 - 5.855: 97.9131% ( 1) 00:14:54.688 5.855 - 5.879: 97.9209% ( 1) 00:14:54.688 5.902 - 5.926: 97.9287% ( 1) 00:14:54.688 5.926 - 5.950: 97.9442% ( 2) 00:14:54.688 5.950 - 5.973: 97.9520% ( 1) 00:14:54.688 6.021 - 6.044: 97.9598% ( 1) 00:14:54.688 6.068 - 6.116: 97.9832% ( 3) 00:14:54.688 6.116 - 6.163: 97.9910% ( 1) 00:14:54.688 6.163 - 6.210: 97.9988% ( 1) 00:14:54.688 6.258 - 6.305: 98.0065% ( 1) 00:14:54.688 6.353 - 6.400: 98.0143% ( 1) 00:14:54.688 6.495 - 6.542: 98.0221% ( 1) 00:14:54.688 6.542 - 6.590: 98.0299% ( 1) 00:14:54.688 7.016 - 7.064: 98.0377% ( 1) 00:14:54.688 7.159 - 7.206: 98.0455% ( 1) 00:14:54.688 7.253 - 7.301: 98.0533% ( 1) 00:14:54.688 7.301 - 7.348: 98.0610% ( 1) 00:14:54.688 7.348 - 7.396: 98.0688% ( 1) 00:14:54.688 7.396 - 7.443: 98.0766% ( 1) 00:14:54.688 7.538 - 7.585: 98.0844% ( 1) 00:14:54.688 7.585 - 7.633: 98.0922% ( 1) 00:14:54.688 7.680 - 7.727: 98.1000% ( 1) 00:14:54.688 7.775 - 7.822: 98.1156% ( 2) 00:14:54.688 7.822 - 7.870: 98.1233% ( 1) 00:14:54.688 7.964 - 8.012: 98.1311% ( 1) 00:14:54.688 8.012 - 8.059: 98.1467% ( 2) 00:14:54.688 8.059 - 8.107: 98.1623% ( 2) 00:14:54.688 8.107 - 8.154: 98.1701% ( 1) 00:14:54.688 8.201 - 8.249: 98.1779% ( 1) 00:14:54.688 8.344 - 8.391: 98.1856% ( 1) 00:14:54.688 8.391 - 8.439: 98.1934% ( 1) 00:14:54.688 8.439 - 8.486: 98.2090% ( 2) 00:14:54.688 8.533 - 8.581: 98.2168% ( 1) 00:14:54.689 8.676 - 8.723: 98.2401% ( 3) 00:14:54.689 8.818 - 8.865: 98.2479% ( 1) 00:14:54.689 8.865 - 8.913: 98.2557% ( 1) 00:14:54.689 8.960 - 9.007: 98.2869% ( 4) 00:14:54.689 9.007 - 9.055: 98.3024% ( 2) 00:14:54.689 9.055 - 9.102: 98.3180% ( 2) 00:14:54.689 9.102 - 9.150: 98.3258% ( 1) 00:14:54.689 9.150 - 9.197: 98.3414% ( 2) 00:14:54.689 9.244 - 9.292: 98.3570% ( 2) 00:14:54.689 9.292 - 9.339: 98.3647% ( 1) 00:14:54.689 9.339 - 9.387: 98.3959% ( 4) 00:14:54.689 9.387 - 9.434: 98.4037% ( 1) 00:14:54.689 9.434 - 9.481: 98.4192% ( 2) 00:14:54.689 9.529 - 9.576: 98.4348% ( 2) 00:14:54.689 9.576 - 9.624: 98.4660% ( 4) 00:14:54.689 9.624 - 9.671: 98.4815% ( 2) 00:14:54.689 9.671 - 9.719: 98.4893% ( 1) 00:14:54.689 9.719 - 9.766: 98.4971% ( 1) 00:14:54.689 9.766 - 9.813: 98.5049% ( 1) 00:14:54.689 9.813 - 9.861: 98.5127% ( 1) 00:14:54.689 9.956 - 10.003: 98.5283% ( 2) 00:14:54.689 10.003 - 10.050: 98.5438% ( 2) 00:14:54.689 10.098 - 10.145: 98.5516% ( 1) 00:14:54.689 10.145 - 10.193: 98.5672% ( 2) 00:14:54.689 10.193 - 10.240: 98.5750% ( 1) 00:14:54.689 10.240 - 10.287: 98.5828% ( 1) 00:14:54.689 10.335 - 10.382: 98.5983% ( 2) 00:14:54.689 10.382 - 10.430: 98.6061% ( 1) 00:14:54.689 10.667 - 10.714: 98.6139% ( 1) 00:14:54.689 10.714 - 10.761: 98.6217% ( 1) 00:14:54.689 10.761 - 10.809: 98.6295% ( 1) 00:14:54.689 10.904 - 10.951: 98.6373% ( 1) 00:14:54.689 10.951 - 10.999: 98.6451% ( 1) 00:14:54.689 11.046 - 11.093: 98.6606% ( 2) 00:14:54.689 11.236 - 11.283: 98.6684% ( 1) 00:14:54.689 11.283 - 11.330: 98.6762% ( 1) 00:14:54.689 11.757 - 11.804: 98.6840% ( 1) 00:14:54.689 11.994 - 12.041: 98.6918% ( 1) 00:14:54.689 12.089 - 12.136: 98.6996% ( 1) 00:14:54.689 12.231 - 12.326: 98.7152% ( 2) 00:14:54.689 12.800 - 12.895: 98.7463% ( 4) 00:14:54.689 12.990 - 13.084: 98.7541% ( 1) 00:14:54.689 13.084 - 13.179: 98.7619% ( 1) 00:14:54.689 13.748 - 13.843: 98.7852% ( 3) 00:14:54.689 14.127 - 14.222: 98.8008% ( 2) 00:14:54.689 14.222 - 14.317: 98.8164% ( 2) 00:14:54.689 14.317 - 14.412: 98.8242% ( 1) 00:14:54.689 14.412 - 14.507: 98.8320% ( 1) 00:14:54.689 14.601 - 14.696: 98.8397% ( 1) 00:14:54.689 14.886 - 14.981: 98.8553% ( 2) 00:14:54.689 14.981 - 15.076: 98.8631% ( 1) 00:14:54.689 16.877 - 16.972: 98.8709% ( 1) 00:14:54.689 17.256 - 17.351: 98.8865% ( 2) 00:14:54.689 17.351 - 17.446: 98.8943% ( 1) 00:14:54.689 17.446 - 17.541: 98.9410% ( 6) 00:14:54.689 17.541 - 17.636: 98.9643% ( 3) 00:14:54.689 17.636 - 17.730: 99.0188% ( 7) 00:14:54.689 17.730 - 17.825: 99.0344% ( 2) 00:14:54.689 17.825 - 17.920: 99.0811% ( 6) 00:14:54.689 17.920 - 18.015: 99.1434% ( 8) 00:14:54.689 18.015 - 18.110: 99.2525% ( 14) 00:14:54.689 18.110 - 18.204: 99.2992% ( 6) 00:14:54.689 18.204 - 18.299: 99.4082% ( 14) 00:14:54.689 18.299 - 18.394: 99.4627% ( 7) 00:14:54.689 18.394 - 18.489: 99.5016% ( 5) 00:14:54.689 18.489 - 18.584: 99.5795% ( 10) 00:14:54.689 18.584 - 18.679: 99.6340% ( 7) 00:14:54.689 18.679 - 18.773: 99.6729% ( 5) 00:14:54.689 18.773 - 18.868: 99.7041% ( 4) 00:14:54.689 18.868 - 18.963: 99.7197% ( 2) 00:14:54.689 18.963 - 19.058: 99.7664% ( 6) 00:14:54.689 19.058 - 19.153: 99.7742% ( 1) 00:14:54.689 19.153 - 19.247: 99.7898% ( 2) 00:14:54.689 19.247 - 19.342: 99.7975% ( 1) 00:14:54.689 19.342 - 19.437: 99.8053% ( 1) 00:14:54.689 19.437 - 19.532: 99.8131% ( 1) 00:14:54.689 19.627 - 19.721: 99.8209% ( 1) 00:14:54.689 19.721 - 19.816: 99.8287% ( 1) 00:14:54.689 19.816 - 19.911: 99.8365% ( 1) 00:14:54.689 19.911 - 20.006: 99.8443% ( 1) 00:14:54.689 22.376 - 22.471: 99.8520% ( 1) 00:14:54.689 23.419 - 23.514: 99.8598% ( 1) 00:14:54.689 24.083 - 24.178: 99.8676% ( 1) 00:14:54.689 24.652 - 24.841: 99.8754% ( 1) 00:14:54.689 25.600 - 25.790: 99.8910% ( 2) 00:14:54.689 25.790 - 25.979: 99.9066% ( 2) 00:14:54.689 3980.705 - 4004.978: 99.9922% ( 11) 00:14:54.689 4004.978 - 4029.250: 100.0000% ( 1) 00:14:54.689 00:14:54.689 Complete histogram 00:14:54.689 ================== 00:14:54.689 Range in us Cumulative Count 00:14:54.689 2.062 - 2.074: 0.0779% ( 10) 00:14:54.689 2.074 - 2.086: 12.4903% ( 1594) 00:14:54.689 2.086 - 2.098: 39.1606% ( 3425) 00:14:54.689 2.098 - 2.110: 43.2487% ( 525) 00:14:54.689 2.110 - 2.121: 47.6951% ( 571) 00:14:54.689 2.121 - 2.133: 51.7754% ( 524) 00:14:54.689 2.133 - 2.145: 53.8701% ( 269) 00:14:54.689 2.145 - 2.157: 61.8829% ( 1029) 00:14:54.689 2.157 - 2.169: 68.9690% ( 910) 00:14:54.689 2.169 - 2.181: 70.4018% ( 184) 00:14:54.689 2.181 - 2.193: 72.3485% ( 250) 00:14:54.689 2.193 - 2.204: 73.8981% ( 199) 00:14:54.689 2.204 - 2.216: 74.7859% ( 114) 00:14:54.689 2.216 - 2.228: 79.9720% ( 666) 00:14:54.689 2.228 - 2.240: 85.7655% ( 744) 00:14:54.689 2.240 - 2.252: 88.5065% ( 352) 00:14:54.689 2.252 - 2.264: 90.5856% ( 267) 00:14:54.689 2.264 - 2.276: 91.7770% ( 153) 00:14:54.689 2.276 - 2.287: 92.2131% ( 56) 00:14:54.689 2.287 - 2.299: 92.8049% ( 76) 00:14:54.689 2.299 - 2.311: 93.3344% ( 68) 00:14:54.689 2.311 - 2.323: 94.4868% ( 148) 00:14:54.689 2.323 - 2.335: 94.9307% ( 57) 00:14:54.689 2.335 - 2.347: 95.0008% ( 9) 00:14:54.689 2.347 - 2.359: 95.0631% ( 8) 00:14:54.689 2.359 - 2.370: 95.1254% ( 8) 00:14:54.689 2.370 - 2.382: 95.2188% ( 12) 00:14:54.689 2.382 - 2.394: 95.5537% ( 43) 00:14:54.689 2.394 - 2.406: 96.0131% ( 59) 00:14:54.689 2.406 - 2.418: 96.3090% ( 38) 00:14:54.689 2.418 - 2.430: 96.4959% ( 24) 00:14:54.689 2.430 - 2.441: 96.6750% ( 23) 00:14:54.689 2.441 - 2.453: 96.7840% ( 14) 00:14:54.689 2.453 - 2.465: 96.9242% ( 18) 00:14:54.689 2.465 - 2.477: 97.0565% ( 17) 00:14:54.689 2.477 - 2.489: 97.1811% ( 16) 00:14:54.689 2.489 - 2.501: 97.3213% ( 18) 00:14:54.689 2.501 - 2.513: 97.3992% ( 10) 00:14:54.689 2.513 - 2.524: 97.4926% ( 12) 00:14:54.689 2.524 - 2.536: 97.6172% ( 16) 00:14:54.689 2.536 - 2.548: 97.7106% ( 12) 00:14:54.689 2.548 - 2.560: 97.7729% ( 8) 00:14:54.689 2.560 - 2.572: 97.8508% ( 10) 00:14:54.689 2.572 - 2.584: 97.8819% ( 4) 00:14:54.689 2.584 - 2.596: 97.9053% ( 3) 00:14:54.689 2.596 - 2.607: 97.9520% ( 6) 00:14:54.689 2.607 - 2.619: 97.9676% ( 2) 00:14:54.689 2.619 - 2.631: 97.9832% ( 2) 00:14:54.689 2.643 - 2.655: 97.9910% ( 1) 00:14:54.689 2.655 - 2.667: 98.0143% ( 3) 00:14:54.689 2.667 - 2.679: 98.0377% ( 3) 00:14:54.689 2.679 - 2.690: 98.0455% ( 1) 00:14:54.689 2.690 - 2.702: 98.0533% ( 1) 00:14:54.689 2.702 - 2.714: 98.0610% ( 1) 00:14:54.689 2.714 - 2.726: 98.0766% ( 2) 00:14:54.689 2.726 - 2.738: 98.0922% ( 2) 00:14:54.689 2.738 - 2.750: 98.1000% ( 1) 00:14:54.689 2.750 - 2.761: 98.1233% ( 3) 00:14:54.689 2.761 - 2.773: 98.1389% ( 2) 00:14:54.689 2.785 - 2.797: 98.1545% ( 2) 00:14:54.689 2.797 - 2.809: 98.1623% ( 1) 00:14:54.689 2.809 - 2.821: 98.1779% ( 2) 00:14:54.689 2.821 - 2.833: 98.1856% ( 1) 00:14:54.689 2.833 - 2.844: 98.1934% ( 1) 00:14:54.689 2.856 - 2.868: 98.2168% ( 3) 00:14:54.689 2.904 - 2.916: 98.2246% ( 1) 00:14:54.689 3.034 - 3.058: 98.2324% ( 1) 00:14:54.689 3.058 - 3.081: 98.2401% ( 1) 00:14:54.689 3.105 - 3.129: 98.2479% ( 1) 00:14:54.689 3.129 - 3.153: 98.2557% ( 1) 00:14:54.689 3.224 - 3.247: 98.2635% ( 1) 00:14:54.689 3.247 - 3.271: 98.2713% ( 1) 00:14:54.689 3.271 - 3.295: 98.2791% ( 1) 00:14:54.689 3.390 - 3.413: 98.2869% ( 1) 00:14:54.689 3.437 - 3.461: 98.2947% ( 1) 00:14:54.689 3.461 - 3.484: 98.3180% ( 3) 00:14:54.689 3.484 - 3.508: 98.3336% ( 2) 00:14:54.689 3.508 - 3.532: 98.3492% ( 2) 00:14:54.689 3.532 - 3.556: 98.3803% ( 4) 00:14:54.689 3.556 - 3.579: 98.3881% ( 1) 00:14:54.689 3.579 - 3.603: 98.4037% ( 2) 00:14:54.689 3.627 - 3.650: 98.4192% ( 2) 00:14:54.689 3.650 - 3.674: 98.4270% ( 1) 00:14:54.689 3.698 - 3.721: 98.4348% ( 1) 00:14:54.689 3.721 - 3.745: 98.4504% ( 2) 00:14:54.689 3.745 - 3.769: 98.4738% ( 3) 00:14:54.689 3.769 - 3.793: 98.4893% ( 2) 00:14:54.689 3.793 - 3.816: 98.4971% ( 1) 00:14:54.689 3.840 - 3.864: 98.5127% ( 2) 00:14:54.689 3.887 - 3.911: 98.5205% ( 1) 00:14:54.689 3.911 - 3.935: 98.5283% ( 1) 00:14:54.689 3.935 - 3.959: 98.5361% ( 1) 00:14:54.689 3.982 - 4.006: 98.5438% ( 1) 00:14:54.689 4.006 - 4.030: 98.5516% ( 1) 00:14:54.689 4.148 - 4.172: 98.5672% ( 2) 00:14:54.689 4.196 - 4.219: 98.5750% ( 1) 00:14:54.689 4.693 - 4.717: 98.5828% ( 1) 00:14:54.689 5.144 - 5.167: 98.5906% ( 1) 00:14:54.689 6.495 - 6.542: 98.5983% ( 1) 00:14:54.689 6.542 - 6.590: 98.6061% ( 1) 00:14:54.689 6.732 - 6.779: 98.6139% ( 1) 00:14:54.689 6.874 - 6.921: 98.6217% ( 1) 00:14:54.689 7.253 - 7.301: 98.6373% ( 2) 00:14:54.689 7.348 - 7.396: 98.6451% ( 1) 00:14:54.689 7.396 - 7.443: 98.6529% ( 1) 00:14:54.689 7.680 - 7.727: 98.6606% ( 1) 00:14:54.689 7.870 - 7.917: 98.6840% ( 3) 00:14:54.689 8.012 - 8.059: 98.6996% ( 2) 00:14:54.690 8.154 - 8.201: 98.7074% ( 1) 00:14:54.690 8.628 - 8.676: 98.7152% ( 1) 00:14:54.690 9.150 - 9.197: 98.7229% ( 1) 00:14:54.690 11.141 - 11.188: 98.7307% ( 1) 00:14:54.690 11.899 - 11.947: 98.7385% ( 1) 00:14:54.690 15.739 - 15.834: 98.7463% ( 1) 00:14:54.690 15.834 - 15.929: 98.7619% ( 2) 00:14:54.690 15.929 - 16.024: 98.7852% ( 3) 00:14:54.690 16.024 - 16.119: 98.8242% ( 5) 00:14:54.690 16.119 - 16.213: 98.8475% ( 3) 00:14:54.690 16.213 - 16.308: 98.8631% ( 2) 00:14:54.690 16.308 - 16.403: 98.9332% ( 9) 00:14:54.690 16.403 - 16.498: 99.0111% ( 10) 00:14:54.690 16.498 - 16.593: 99.0811% ( 9) 00:14:54.690 16.593 - 16.687: 99.1279% ( 6) 00:14:54.690 16.687 - 16.782: 99.1590% ( 4) 00:14:54.690 16.782 - 16.877: 99.1902% ( 4) 00:14:54.690 16.877 - 16.972: 99.2680% ( 10) 00:14:54.690 16.972 - 17.067: 99.3070%[2024-10-07 13:25:50.193207] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:54.690 ( 5) 00:14:54.690 17.067 - 17.161: 99.3147% ( 1) 00:14:54.690 17.256 - 17.351: 99.3225% ( 1) 00:14:54.690 17.351 - 17.446: 99.3537% ( 4) 00:14:54.690 17.446 - 17.541: 99.3615% ( 1) 00:14:54.690 17.541 - 17.636: 99.3693% ( 1) 00:14:54.690 17.636 - 17.730: 99.3848% ( 2) 00:14:54.690 17.730 - 17.825: 99.4004% ( 2) 00:14:54.690 17.825 - 17.920: 99.4082% ( 1) 00:14:54.690 18.015 - 18.110: 99.4160% ( 1) 00:14:54.690 18.204 - 18.299: 99.4238% ( 1) 00:14:54.690 20.764 - 20.859: 99.4316% ( 1) 00:14:54.690 21.144 - 21.239: 99.4393% ( 1) 00:14:54.690 21.333 - 21.428: 99.4471% ( 1) 00:14:54.690 21.428 - 21.523: 99.4549% ( 1) 00:14:54.690 24.462 - 24.652: 99.4627% ( 1) 00:14:54.690 29.203 - 29.393: 99.4705% ( 1) 00:14:54.690 3980.705 - 4004.978: 99.8988% ( 55) 00:14:54.690 4004.978 - 4029.250: 100.0000% ( 13) 00:14:54.690 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:14:54.690 [ 00:14:54.690 { 00:14:54.690 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:14:54.690 "subtype": "Discovery", 00:14:54.690 "listen_addresses": [], 00:14:54.690 "allow_any_host": true, 00:14:54.690 "hosts": [] 00:14:54.690 }, 00:14:54.690 { 00:14:54.690 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:14:54.690 "subtype": "NVMe", 00:14:54.690 "listen_addresses": [ 00:14:54.690 { 00:14:54.690 "trtype": "VFIOUSER", 00:14:54.690 "adrfam": "IPv4", 00:14:54.690 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:14:54.690 "trsvcid": "0" 00:14:54.690 } 00:14:54.690 ], 00:14:54.690 "allow_any_host": true, 00:14:54.690 "hosts": [], 00:14:54.690 "serial_number": "SPDK1", 00:14:54.690 "model_number": "SPDK bdev Controller", 00:14:54.690 "max_namespaces": 32, 00:14:54.690 "min_cntlid": 1, 00:14:54.690 "max_cntlid": 65519, 00:14:54.690 "namespaces": [ 00:14:54.690 { 00:14:54.690 "nsid": 1, 00:14:54.690 "bdev_name": "Malloc1", 00:14:54.690 "name": "Malloc1", 00:14:54.690 "nguid": "B27DA7EBABD34D799EC7189772C78E37", 00:14:54.690 "uuid": "b27da7eb-abd3-4d79-9ec7-189772c78e37" 00:14:54.690 } 00:14:54.690 ] 00:14:54.690 }, 00:14:54.690 { 00:14:54.690 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:14:54.690 "subtype": "NVMe", 00:14:54.690 "listen_addresses": [ 00:14:54.690 { 00:14:54.690 "trtype": "VFIOUSER", 00:14:54.690 "adrfam": "IPv4", 00:14:54.690 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:14:54.690 "trsvcid": "0" 00:14:54.690 } 00:14:54.690 ], 00:14:54.690 "allow_any_host": true, 00:14:54.690 "hosts": [], 00:14:54.690 "serial_number": "SPDK2", 00:14:54.690 "model_number": "SPDK bdev Controller", 00:14:54.690 "max_namespaces": 32, 00:14:54.690 "min_cntlid": 1, 00:14:54.690 "max_cntlid": 65519, 00:14:54.690 "namespaces": [ 00:14:54.690 { 00:14:54.690 "nsid": 1, 00:14:54.690 "bdev_name": "Malloc2", 00:14:54.690 "name": "Malloc2", 00:14:54.690 "nguid": "2219E94CC5BC4889B0AD3FCA7B4D200A", 00:14:54.690 "uuid": "2219e94c-c5bc-4889-b0ad-3fca7b4d200a" 00:14:54.690 } 00:14:54.690 ] 00:14:54.690 } 00:14:54.690 ] 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@34 -- # aerpid=617464 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1265 -- # local i=0 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1272 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1276 -- # return 0 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:14:54.690 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:14:54.948 [2024-10-07 13:25:50.728994] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: enabling controller 00:14:54.948 Malloc3 00:14:54.948 13:25:50 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:14:55.513 [2024-10-07 13:25:51.147137] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user1/1: disabling controller 00:14:55.513 13:25:51 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:14:55.513 Asynchronous Event Request test 00:14:55.513 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:14:55.513 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:14:55.513 Registering asynchronous event callbacks... 00:14:55.513 Starting namespace attribute notice tests for all controllers... 00:14:55.513 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:14:55.513 aer_cb - Changed Namespace 00:14:55.513 Cleaning up... 00:14:55.513 [ 00:14:55.513 { 00:14:55.513 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:14:55.513 "subtype": "Discovery", 00:14:55.513 "listen_addresses": [], 00:14:55.513 "allow_any_host": true, 00:14:55.513 "hosts": [] 00:14:55.513 }, 00:14:55.513 { 00:14:55.513 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:14:55.513 "subtype": "NVMe", 00:14:55.513 "listen_addresses": [ 00:14:55.513 { 00:14:55.513 "trtype": "VFIOUSER", 00:14:55.513 "adrfam": "IPv4", 00:14:55.513 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:14:55.513 "trsvcid": "0" 00:14:55.513 } 00:14:55.513 ], 00:14:55.513 "allow_any_host": true, 00:14:55.513 "hosts": [], 00:14:55.513 "serial_number": "SPDK1", 00:14:55.513 "model_number": "SPDK bdev Controller", 00:14:55.513 "max_namespaces": 32, 00:14:55.513 "min_cntlid": 1, 00:14:55.513 "max_cntlid": 65519, 00:14:55.513 "namespaces": [ 00:14:55.513 { 00:14:55.513 "nsid": 1, 00:14:55.513 "bdev_name": "Malloc1", 00:14:55.513 "name": "Malloc1", 00:14:55.513 "nguid": "B27DA7EBABD34D799EC7189772C78E37", 00:14:55.513 "uuid": "b27da7eb-abd3-4d79-9ec7-189772c78e37" 00:14:55.513 }, 00:14:55.513 { 00:14:55.513 "nsid": 2, 00:14:55.513 "bdev_name": "Malloc3", 00:14:55.513 "name": "Malloc3", 00:14:55.513 "nguid": "5C43418FD1E04E5EAE9DC1732D636370", 00:14:55.513 "uuid": "5c43418f-d1e0-4e5e-ae9d-c1732d636370" 00:14:55.513 } 00:14:55.513 ] 00:14:55.513 }, 00:14:55.513 { 00:14:55.513 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:14:55.513 "subtype": "NVMe", 00:14:55.513 "listen_addresses": [ 00:14:55.513 { 00:14:55.513 "trtype": "VFIOUSER", 00:14:55.513 "adrfam": "IPv4", 00:14:55.513 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:14:55.513 "trsvcid": "0" 00:14:55.513 } 00:14:55.513 ], 00:14:55.513 "allow_any_host": true, 00:14:55.513 "hosts": [], 00:14:55.513 "serial_number": "SPDK2", 00:14:55.513 "model_number": "SPDK bdev Controller", 00:14:55.513 "max_namespaces": 32, 00:14:55.513 "min_cntlid": 1, 00:14:55.513 "max_cntlid": 65519, 00:14:55.513 "namespaces": [ 00:14:55.513 { 00:14:55.513 "nsid": 1, 00:14:55.513 "bdev_name": "Malloc2", 00:14:55.513 "name": "Malloc2", 00:14:55.513 "nguid": "2219E94CC5BC4889B0AD3FCA7B4D200A", 00:14:55.513 "uuid": "2219e94c-c5bc-4889-b0ad-3fca7b4d200a" 00:14:55.513 } 00:14:55.513 ] 00:14:55.513 } 00:14:55.513 ] 00:14:55.513 13:25:51 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@44 -- # wait 617464 00:14:55.513 13:25:51 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:14:55.513 13:25:51 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:14:55.513 13:25:51 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:14:55.513 13:25:51 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:14:55.772 [2024-10-07 13:25:51.459753] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:55.772 [2024-10-07 13:25:51.459805] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid617603 ] 00:14:55.772 [2024-10-07 13:25:51.495071] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:14:55.772 [2024-10-07 13:25:51.503845] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:14:55.772 [2024-10-07 13:25:51.503885] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f3594935000 00:14:55.772 [2024-10-07 13:25:51.504841] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:55.772 [2024-10-07 13:25:51.505853] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:55.772 [2024-10-07 13:25:51.506848] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:55.772 [2024-10-07 13:25:51.507855] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:55.772 [2024-10-07 13:25:51.508862] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:55.772 [2024-10-07 13:25:51.509865] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:55.772 [2024-10-07 13:25:51.510872] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:14:55.773 [2024-10-07 13:25:51.511880] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:14:55.773 [2024-10-07 13:25:51.512889] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:14:55.773 [2024-10-07 13:25:51.512911] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f359492a000 00:14:55.773 [2024-10-07 13:25:51.514036] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:14:55.773 [2024-10-07 13:25:51.528811] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:14:55.773 [2024-10-07 13:25:51.528848] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:14:55.773 [2024-10-07 13:25:51.530945] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:14:55.773 [2024-10-07 13:25:51.531003] nvme_pcie_common.c: 134:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:14:55.773 [2024-10-07 13:25:51.531098] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:14:55.773 [2024-10-07 13:25:51.531125] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:14:55.773 [2024-10-07 13:25:51.531135] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:14:55.773 [2024-10-07 13:25:51.531949] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:14:55.773 [2024-10-07 13:25:51.531970] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:14:55.773 [2024-10-07 13:25:51.531983] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:14:55.773 [2024-10-07 13:25:51.536498] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:14:55.773 [2024-10-07 13:25:51.536520] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:14:55.773 [2024-10-07 13:25:51.536534] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:14:55.773 [2024-10-07 13:25:51.536989] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:14:55.773 [2024-10-07 13:25:51.537014] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:14:55.773 [2024-10-07 13:25:51.537993] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:14:55.773 [2024-10-07 13:25:51.538014] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:14:55.773 [2024-10-07 13:25:51.538023] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:14:55.773 [2024-10-07 13:25:51.538034] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:14:55.773 [2024-10-07 13:25:51.538144] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:14:55.773 [2024-10-07 13:25:51.538152] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:14:55.773 [2024-10-07 13:25:51.538160] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:14:55.773 [2024-10-07 13:25:51.539001] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:14:55.773 [2024-10-07 13:25:51.540010] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:14:55.773 [2024-10-07 13:25:51.541014] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:14:55.773 [2024-10-07 13:25:51.542011] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:14:55.773 [2024-10-07 13:25:51.542092] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:14:55.773 [2024-10-07 13:25:51.543041] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:14:55.773 [2024-10-07 13:25:51.543064] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:14:55.773 [2024-10-07 13:25:51.543074] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.543098] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:14:55.773 [2024-10-07 13:25:51.543112] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.543133] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:55.773 [2024-10-07 13:25:51.543144] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:55.773 [2024-10-07 13:25:51.543150] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:55.773 [2024-10-07 13:25:51.543170] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:55.773 [2024-10-07 13:25:51.547507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:14:55.773 [2024-10-07 13:25:51.547532] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:14:55.773 [2024-10-07 13:25:51.547542] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:14:55.773 [2024-10-07 13:25:51.547553] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:14:55.773 [2024-10-07 13:25:51.547563] nvme_ctrlr.c:2095:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:14:55.773 [2024-10-07 13:25:51.547571] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:14:55.773 [2024-10-07 13:25:51.547579] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:14:55.773 [2024-10-07 13:25:51.547587] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.547600] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.547617] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:14:55.773 [2024-10-07 13:25:51.555497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:14:55.773 [2024-10-07 13:25:51.555523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:14:55.773 [2024-10-07 13:25:51.555537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:14:55.773 [2024-10-07 13:25:51.555550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:14:55.773 [2024-10-07 13:25:51.555563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:14:55.773 [2024-10-07 13:25:51.555572] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.555590] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.555606] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:14:55.773 [2024-10-07 13:25:51.563499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:14:55.773 [2024-10-07 13:25:51.563519] nvme_ctrlr.c:3034:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:14:55.773 [2024-10-07 13:25:51.563529] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.563540] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.563554] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.563570] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:14:55.773 [2024-10-07 13:25:51.571515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:14:55.773 [2024-10-07 13:25:51.571591] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.571608] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.571622] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:14:55.773 [2024-10-07 13:25:51.571634] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:14:55.773 [2024-10-07 13:25:51.571641] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:55.773 [2024-10-07 13:25:51.571651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:14:55.773 [2024-10-07 13:25:51.579499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:14:55.773 [2024-10-07 13:25:51.579523] nvme_ctrlr.c:4722:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:14:55.773 [2024-10-07 13:25:51.579544] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.579560] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.579573] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:55.773 [2024-10-07 13:25:51.579581] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:55.773 [2024-10-07 13:25:51.579587] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:55.773 [2024-10-07 13:25:51.579597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:55.773 [2024-10-07 13:25:51.587498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:14:55.773 [2024-10-07 13:25:51.587527] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:14:55.773 [2024-10-07 13:25:51.587544] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.587558] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:14:55.774 [2024-10-07 13:25:51.587566] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:55.774 [2024-10-07 13:25:51.587572] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:55.774 [2024-10-07 13:25:51.587582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.595495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.595519] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.595532] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.595550] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.595562] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host behavior support feature (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.595570] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.595580] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.595588] nvme_ctrlr.c:3134:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:14:55.774 [2024-10-07 13:25:51.595599] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:14:55.774 [2024-10-07 13:25:51.595608] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:14:55.774 [2024-10-07 13:25:51.595634] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.603495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.603522] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.611499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.611524] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.619498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.619525] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.627498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.627531] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:14:55.774 [2024-10-07 13:25:51.627543] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:14:55.774 [2024-10-07 13:25:51.627549] nvme_pcie_common.c:1241:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:14:55.774 [2024-10-07 13:25:51.627555] nvme_pcie_common.c:1257:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:14:55.774 [2024-10-07 13:25:51.627561] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 2 00:14:55.774 [2024-10-07 13:25:51.627571] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:14:55.774 [2024-10-07 13:25:51.627583] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:14:55.774 [2024-10-07 13:25:51.627591] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:14:55.774 [2024-10-07 13:25:51.627597] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:55.774 [2024-10-07 13:25:51.627606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.627617] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:14:55.774 [2024-10-07 13:25:51.627625] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:14:55.774 [2024-10-07 13:25:51.627630] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:55.774 [2024-10-07 13:25:51.627639] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.627651] nvme_pcie_common.c:1204:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:14:55.774 [2024-10-07 13:25:51.627659] nvme_pcie_common.c:1232:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:14:55.774 [2024-10-07 13:25:51.627665] nvme_pcie_common.c:1292:nvme_pcie_qpair_build_contig_request: *DEBUG*: Number of PRP entries: 1 00:14:55.774 [2024-10-07 13:25:51.627674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:14:55.774 [2024-10-07 13:25:51.635497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.635525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.635544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:14:55.774 [2024-10-07 13:25:51.635556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:14:55.774 ===================================================== 00:14:55.774 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:14:55.774 ===================================================== 00:14:55.774 Controller Capabilities/Features 00:14:55.774 ================================ 00:14:55.774 Vendor ID: 4e58 00:14:55.774 Subsystem Vendor ID: 4e58 00:14:55.774 Serial Number: SPDK2 00:14:55.774 Model Number: SPDK bdev Controller 00:14:55.774 Firmware Version: 25.01 00:14:55.774 Recommended Arb Burst: 6 00:14:55.774 IEEE OUI Identifier: 8d 6b 50 00:14:55.774 Multi-path I/O 00:14:55.774 May have multiple subsystem ports: Yes 00:14:55.774 May have multiple controllers: Yes 00:14:55.774 Associated with SR-IOV VF: No 00:14:55.774 Max Data Transfer Size: 131072 00:14:55.774 Max Number of Namespaces: 32 00:14:55.774 Max Number of I/O Queues: 127 00:14:55.774 NVMe Specification Version (VS): 1.3 00:14:55.774 NVMe Specification Version (Identify): 1.3 00:14:55.774 Maximum Queue Entries: 256 00:14:55.774 Contiguous Queues Required: Yes 00:14:55.774 Arbitration Mechanisms Supported 00:14:55.774 Weighted Round Robin: Not Supported 00:14:55.774 Vendor Specific: Not Supported 00:14:55.774 Reset Timeout: 15000 ms 00:14:55.774 Doorbell Stride: 4 bytes 00:14:55.774 NVM Subsystem Reset: Not Supported 00:14:55.774 Command Sets Supported 00:14:55.774 NVM Command Set: Supported 00:14:55.774 Boot Partition: Not Supported 00:14:55.774 Memory Page Size Minimum: 4096 bytes 00:14:55.774 Memory Page Size Maximum: 4096 bytes 00:14:55.774 Persistent Memory Region: Not Supported 00:14:55.774 Optional Asynchronous Events Supported 00:14:55.774 Namespace Attribute Notices: Supported 00:14:55.774 Firmware Activation Notices: Not Supported 00:14:55.774 ANA Change Notices: Not Supported 00:14:55.774 PLE Aggregate Log Change Notices: Not Supported 00:14:55.774 LBA Status Info Alert Notices: Not Supported 00:14:55.774 EGE Aggregate Log Change Notices: Not Supported 00:14:55.774 Normal NVM Subsystem Shutdown event: Not Supported 00:14:55.774 Zone Descriptor Change Notices: Not Supported 00:14:55.774 Discovery Log Change Notices: Not Supported 00:14:55.774 Controller Attributes 00:14:55.774 128-bit Host Identifier: Supported 00:14:55.774 Non-Operational Permissive Mode: Not Supported 00:14:55.774 NVM Sets: Not Supported 00:14:55.774 Read Recovery Levels: Not Supported 00:14:55.774 Endurance Groups: Not Supported 00:14:55.774 Predictable Latency Mode: Not Supported 00:14:55.774 Traffic Based Keep ALive: Not Supported 00:14:55.774 Namespace Granularity: Not Supported 00:14:55.774 SQ Associations: Not Supported 00:14:55.774 UUID List: Not Supported 00:14:55.774 Multi-Domain Subsystem: Not Supported 00:14:55.774 Fixed Capacity Management: Not Supported 00:14:55.774 Variable Capacity Management: Not Supported 00:14:55.774 Delete Endurance Group: Not Supported 00:14:55.774 Delete NVM Set: Not Supported 00:14:55.774 Extended LBA Formats Supported: Not Supported 00:14:55.774 Flexible Data Placement Supported: Not Supported 00:14:55.774 00:14:55.774 Controller Memory Buffer Support 00:14:55.774 ================================ 00:14:55.774 Supported: No 00:14:55.774 00:14:55.774 Persistent Memory Region Support 00:14:55.774 ================================ 00:14:55.774 Supported: No 00:14:55.774 00:14:55.774 Admin Command Set Attributes 00:14:55.774 ============================ 00:14:55.774 Security Send/Receive: Not Supported 00:14:55.774 Format NVM: Not Supported 00:14:55.774 Firmware Activate/Download: Not Supported 00:14:55.774 Namespace Management: Not Supported 00:14:55.774 Device Self-Test: Not Supported 00:14:55.774 Directives: Not Supported 00:14:55.774 NVMe-MI: Not Supported 00:14:55.774 Virtualization Management: Not Supported 00:14:55.774 Doorbell Buffer Config: Not Supported 00:14:55.774 Get LBA Status Capability: Not Supported 00:14:55.774 Command & Feature Lockdown Capability: Not Supported 00:14:55.774 Abort Command Limit: 4 00:14:55.774 Async Event Request Limit: 4 00:14:55.774 Number of Firmware Slots: N/A 00:14:55.774 Firmware Slot 1 Read-Only: N/A 00:14:55.774 Firmware Activation Without Reset: N/A 00:14:55.774 Multiple Update Detection Support: N/A 00:14:55.774 Firmware Update Granularity: No Information Provided 00:14:55.774 Per-Namespace SMART Log: No 00:14:55.774 Asymmetric Namespace Access Log Page: Not Supported 00:14:55.774 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:14:55.774 Command Effects Log Page: Supported 00:14:55.774 Get Log Page Extended Data: Supported 00:14:55.774 Telemetry Log Pages: Not Supported 00:14:55.774 Persistent Event Log Pages: Not Supported 00:14:55.774 Supported Log Pages Log Page: May Support 00:14:55.774 Commands Supported & Effects Log Page: Not Supported 00:14:55.774 Feature Identifiers & Effects Log Page:May Support 00:14:55.775 NVMe-MI Commands & Effects Log Page: May Support 00:14:55.775 Data Area 4 for Telemetry Log: Not Supported 00:14:55.775 Error Log Page Entries Supported: 128 00:14:55.775 Keep Alive: Supported 00:14:55.775 Keep Alive Granularity: 10000 ms 00:14:55.775 00:14:55.775 NVM Command Set Attributes 00:14:55.775 ========================== 00:14:55.775 Submission Queue Entry Size 00:14:55.775 Max: 64 00:14:55.775 Min: 64 00:14:55.775 Completion Queue Entry Size 00:14:55.775 Max: 16 00:14:55.775 Min: 16 00:14:55.775 Number of Namespaces: 32 00:14:55.775 Compare Command: Supported 00:14:55.775 Write Uncorrectable Command: Not Supported 00:14:55.775 Dataset Management Command: Supported 00:14:55.775 Write Zeroes Command: Supported 00:14:55.775 Set Features Save Field: Not Supported 00:14:55.775 Reservations: Not Supported 00:14:55.775 Timestamp: Not Supported 00:14:55.775 Copy: Supported 00:14:55.775 Volatile Write Cache: Present 00:14:55.775 Atomic Write Unit (Normal): 1 00:14:55.775 Atomic Write Unit (PFail): 1 00:14:55.775 Atomic Compare & Write Unit: 1 00:14:55.775 Fused Compare & Write: Supported 00:14:55.775 Scatter-Gather List 00:14:55.775 SGL Command Set: Supported (Dword aligned) 00:14:55.775 SGL Keyed: Not Supported 00:14:55.775 SGL Bit Bucket Descriptor: Not Supported 00:14:55.775 SGL Metadata Pointer: Not Supported 00:14:55.775 Oversized SGL: Not Supported 00:14:55.775 SGL Metadata Address: Not Supported 00:14:55.775 SGL Offset: Not Supported 00:14:55.775 Transport SGL Data Block: Not Supported 00:14:55.775 Replay Protected Memory Block: Not Supported 00:14:55.775 00:14:55.775 Firmware Slot Information 00:14:55.775 ========================= 00:14:55.775 Active slot: 1 00:14:55.775 Slot 1 Firmware Revision: 25.01 00:14:55.775 00:14:55.775 00:14:55.775 Commands Supported and Effects 00:14:55.775 ============================== 00:14:55.775 Admin Commands 00:14:55.775 -------------- 00:14:55.775 Get Log Page (02h): Supported 00:14:55.775 Identify (06h): Supported 00:14:55.775 Abort (08h): Supported 00:14:55.775 Set Features (09h): Supported 00:14:55.775 Get Features (0Ah): Supported 00:14:55.775 Asynchronous Event Request (0Ch): Supported 00:14:55.775 Keep Alive (18h): Supported 00:14:55.775 I/O Commands 00:14:55.775 ------------ 00:14:55.775 Flush (00h): Supported LBA-Change 00:14:55.775 Write (01h): Supported LBA-Change 00:14:55.775 Read (02h): Supported 00:14:55.775 Compare (05h): Supported 00:14:55.775 Write Zeroes (08h): Supported LBA-Change 00:14:55.775 Dataset Management (09h): Supported LBA-Change 00:14:55.775 Copy (19h): Supported LBA-Change 00:14:55.775 00:14:55.775 Error Log 00:14:55.775 ========= 00:14:55.775 00:14:55.775 Arbitration 00:14:55.775 =========== 00:14:55.775 Arbitration Burst: 1 00:14:55.775 00:14:55.775 Power Management 00:14:55.775 ================ 00:14:55.775 Number of Power States: 1 00:14:55.775 Current Power State: Power State #0 00:14:55.775 Power State #0: 00:14:55.775 Max Power: 0.00 W 00:14:55.775 Non-Operational State: Operational 00:14:55.775 Entry Latency: Not Reported 00:14:55.775 Exit Latency: Not Reported 00:14:55.775 Relative Read Throughput: 0 00:14:55.775 Relative Read Latency: 0 00:14:55.775 Relative Write Throughput: 0 00:14:55.775 Relative Write Latency: 0 00:14:55.775 Idle Power: Not Reported 00:14:55.775 Active Power: Not Reported 00:14:55.775 Non-Operational Permissive Mode: Not Supported 00:14:55.775 00:14:55.775 Health Information 00:14:55.775 ================== 00:14:55.775 Critical Warnings: 00:14:55.775 Available Spare Space: OK 00:14:55.775 Temperature: OK 00:14:55.775 Device Reliability: OK 00:14:55.775 Read Only: No 00:14:55.775 Volatile Memory Backup: OK 00:14:55.775 Current Temperature: 0 Kelvin (-273 Celsius) 00:14:55.775 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:14:55.775 Available Spare: 0% 00:14:55.775 Available Sp[2024-10-07 13:25:51.635672] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:14:55.775 [2024-10-07 13:25:51.643514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:14:55.775 [2024-10-07 13:25:51.643565] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:14:55.775 [2024-10-07 13:25:51.643583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:55.775 [2024-10-07 13:25:51.643594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:55.775 [2024-10-07 13:25:51.643604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:55.775 [2024-10-07 13:25:51.643614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:55.775 [2024-10-07 13:25:51.643707] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:14:55.775 [2024-10-07 13:25:51.643729] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:14:55.775 [2024-10-07 13:25:51.644706] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:14:55.775 [2024-10-07 13:25:51.644793] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:14:55.775 [2024-10-07 13:25:51.644823] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:14:55.775 [2024-10-07 13:25:51.645715] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:14:55.775 [2024-10-07 13:25:51.645741] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:14:55.775 [2024-10-07 13:25:51.645816] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:14:55.775 [2024-10-07 13:25:51.648498] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:14:55.775 are Threshold: 0% 00:14:55.775 Life Percentage Used: 0% 00:14:55.775 Data Units Read: 0 00:14:55.775 Data Units Written: 0 00:14:55.775 Host Read Commands: 0 00:14:55.775 Host Write Commands: 0 00:14:55.775 Controller Busy Time: 0 minutes 00:14:55.775 Power Cycles: 0 00:14:55.775 Power On Hours: 0 hours 00:14:55.775 Unsafe Shutdowns: 0 00:14:55.775 Unrecoverable Media Errors: 0 00:14:55.775 Lifetime Error Log Entries: 0 00:14:55.775 Warning Temperature Time: 0 minutes 00:14:55.775 Critical Temperature Time: 0 minutes 00:14:55.775 00:14:55.775 Number of Queues 00:14:55.775 ================ 00:14:55.775 Number of I/O Submission Queues: 127 00:14:55.775 Number of I/O Completion Queues: 127 00:14:55.775 00:14:55.775 Active Namespaces 00:14:55.775 ================= 00:14:55.775 Namespace ID:1 00:14:55.775 Error Recovery Timeout: Unlimited 00:14:55.775 Command Set Identifier: NVM (00h) 00:14:55.775 Deallocate: Supported 00:14:55.775 Deallocated/Unwritten Error: Not Supported 00:14:55.775 Deallocated Read Value: Unknown 00:14:55.775 Deallocate in Write Zeroes: Not Supported 00:14:55.775 Deallocated Guard Field: 0xFFFF 00:14:55.775 Flush: Supported 00:14:55.775 Reservation: Supported 00:14:55.775 Namespace Sharing Capabilities: Multiple Controllers 00:14:55.775 Size (in LBAs): 131072 (0GiB) 00:14:55.775 Capacity (in LBAs): 131072 (0GiB) 00:14:55.775 Utilization (in LBAs): 131072 (0GiB) 00:14:55.775 NGUID: 2219E94CC5BC4889B0AD3FCA7B4D200A 00:14:55.775 UUID: 2219e94c-c5bc-4889-b0ad-3fca7b4d200a 00:14:55.775 Thin Provisioning: Not Supported 00:14:55.775 Per-NS Atomic Units: Yes 00:14:55.775 Atomic Boundary Size (Normal): 0 00:14:55.775 Atomic Boundary Size (PFail): 0 00:14:55.775 Atomic Boundary Offset: 0 00:14:55.775 Maximum Single Source Range Length: 65535 00:14:55.775 Maximum Copy Length: 65535 00:14:55.775 Maximum Source Range Count: 1 00:14:55.775 NGUID/EUI64 Never Reused: No 00:14:55.775 Namespace Write Protected: No 00:14:55.775 Number of LBA Formats: 1 00:14:55.775 Current LBA Format: LBA Format #00 00:14:55.775 LBA Format #00: Data Size: 512 Metadata Size: 0 00:14:55.775 00:14:55.775 13:25:51 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:14:56.032 [2024-10-07 13:25:51.880329] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:01.360 Initializing NVMe Controllers 00:15:01.360 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:01.360 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:01.360 Initialization complete. Launching workers. 00:15:01.360 ======================================================== 00:15:01.360 Latency(us) 00:15:01.360 Device Information : IOPS MiB/s Average min max 00:15:01.360 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 32788.03 128.08 3903.17 1173.56 10712.03 00:15:01.360 ======================================================== 00:15:01.360 Total : 32788.03 128.08 3903.17 1173.56 10712.03 00:15:01.360 00:15:01.360 [2024-10-07 13:25:56.982883] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:01.360 13:25:57 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:01.360 [2024-10-07 13:25:57.217554] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:06.622 Initializing NVMe Controllers 00:15:06.622 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:06.622 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:06.622 Initialization complete. Launching workers. 00:15:06.622 ======================================================== 00:15:06.622 Latency(us) 00:15:06.622 Device Information : IOPS MiB/s Average min max 00:15:06.622 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 27282.87 106.57 4690.81 1299.41 8465.94 00:15:06.622 ======================================================== 00:15:06.622 Total : 27282.87 106.57 4690.81 1299.41 8465.94 00:15:06.622 00:15:06.622 [2024-10-07 13:26:02.241358] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:06.622 13:26:02 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:06.622 [2024-10-07 13:26:02.452315] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:11.890 [2024-10-07 13:26:07.589647] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:11.890 Initializing NVMe Controllers 00:15:11.890 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:11.890 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:11.890 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:11.890 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:11.890 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:11.890 Initialization complete. Launching workers. 00:15:11.890 Starting thread on core 2 00:15:11.890 Starting thread on core 3 00:15:11.890 Starting thread on core 1 00:15:11.890 13:26:07 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:12.148 [2024-10-07 13:26:07.908835] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:15.432 [2024-10-07 13:26:10.987735] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:15.432 Initializing NVMe Controllers 00:15:15.432 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:15.432 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:15.432 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:15.432 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:15.432 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:15.432 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:15.432 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:15.432 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:15.432 Initialization complete. Launching workers. 00:15:15.432 Starting thread on core 1 with urgent priority queue 00:15:15.432 Starting thread on core 2 with urgent priority queue 00:15:15.432 Starting thread on core 3 with urgent priority queue 00:15:15.432 Starting thread on core 0 with urgent priority queue 00:15:15.432 SPDK bdev Controller (SPDK2 ) core 0: 6070.67 IO/s 16.47 secs/100000 ios 00:15:15.432 SPDK bdev Controller (SPDK2 ) core 1: 4843.67 IO/s 20.65 secs/100000 ios 00:15:15.432 SPDK bdev Controller (SPDK2 ) core 2: 6166.33 IO/s 16.22 secs/100000 ios 00:15:15.432 SPDK bdev Controller (SPDK2 ) core 3: 5031.33 IO/s 19.88 secs/100000 ios 00:15:15.432 ======================================================== 00:15:15.432 00:15:15.432 13:26:11 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:15.432 [2024-10-07 13:26:11.285063] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:15.432 Initializing NVMe Controllers 00:15:15.432 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:15.432 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:15.432 Namespace ID: 1 size: 0GB 00:15:15.432 Initialization complete. 00:15:15.432 INFO: using host memory buffer for IO 00:15:15.432 Hello world! 00:15:15.432 [2024-10-07 13:26:11.294275] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:15.432 13:26:11 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:15.689 [2024-10-07 13:26:11.586334] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:17.063 Initializing NVMe Controllers 00:15:17.063 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:17.063 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:17.063 Initialization complete. Launching workers. 00:15:17.063 submit (in ns) avg, min, max = 8599.5, 3500.0, 4017005.6 00:15:17.063 complete (in ns) avg, min, max = 28632.3, 2061.1, 4019352.2 00:15:17.063 00:15:17.063 Submit histogram 00:15:17.063 ================ 00:15:17.063 Range in us Cumulative Count 00:15:17.063 3.484 - 3.508: 0.0233% ( 3) 00:15:17.063 3.508 - 3.532: 0.8786% ( 110) 00:15:17.063 3.532 - 3.556: 2.3948% ( 195) 00:15:17.063 3.556 - 3.579: 5.9327% ( 455) 00:15:17.063 3.579 - 3.603: 12.0364% ( 785) 00:15:17.063 3.603 - 3.627: 21.7946% ( 1255) 00:15:17.063 3.627 - 3.650: 31.9182% ( 1302) 00:15:17.063 3.650 - 3.674: 40.3934% ( 1090) 00:15:17.063 3.674 - 3.698: 46.8393% ( 829) 00:15:17.063 3.698 - 3.721: 52.5853% ( 739) 00:15:17.063 3.721 - 3.745: 56.9862% ( 566) 00:15:17.063 3.745 - 3.769: 60.6562% ( 472) 00:15:17.063 3.769 - 3.793: 63.5254% ( 369) 00:15:17.063 3.793 - 3.816: 66.4801% ( 380) 00:15:17.063 3.816 - 3.840: 70.2123% ( 480) 00:15:17.063 3.840 - 3.864: 74.9786% ( 613) 00:15:17.063 3.864 - 3.887: 79.2318% ( 547) 00:15:17.063 3.887 - 3.911: 82.4430% ( 413) 00:15:17.063 3.911 - 3.935: 85.3122% ( 369) 00:15:17.063 3.935 - 3.959: 87.2405% ( 248) 00:15:17.063 3.959 - 3.982: 88.7334% ( 192) 00:15:17.063 3.982 - 4.006: 90.1019% ( 176) 00:15:17.063 4.006 - 4.030: 91.0038% ( 116) 00:15:17.063 4.030 - 4.053: 91.9680% ( 124) 00:15:17.063 4.053 - 4.077: 92.9632% ( 128) 00:15:17.063 4.077 - 4.101: 93.8652% ( 116) 00:15:17.063 4.101 - 4.124: 94.6427% ( 100) 00:15:17.063 4.124 - 4.148: 95.1637% ( 67) 00:15:17.063 4.148 - 4.172: 95.5602% ( 51) 00:15:17.063 4.172 - 4.196: 95.8868% ( 42) 00:15:17.063 4.196 - 4.219: 96.1123% ( 29) 00:15:17.063 4.219 - 4.243: 96.3067% ( 25) 00:15:17.064 4.243 - 4.267: 96.4933% ( 24) 00:15:17.064 4.267 - 4.290: 96.6721% ( 23) 00:15:17.064 4.290 - 4.314: 96.8198% ( 19) 00:15:17.064 4.314 - 4.338: 96.9365% ( 15) 00:15:17.064 4.338 - 4.361: 97.0453% ( 14) 00:15:17.064 4.361 - 4.385: 97.1309% ( 11) 00:15:17.064 4.385 - 4.409: 97.2242% ( 12) 00:15:17.064 4.409 - 4.433: 97.2864% ( 8) 00:15:17.064 4.433 - 4.456: 97.3097% ( 3) 00:15:17.064 4.456 - 4.480: 97.3641% ( 7) 00:15:17.064 4.480 - 4.504: 97.3952% ( 4) 00:15:17.064 4.504 - 4.527: 97.4108% ( 2) 00:15:17.064 4.527 - 4.551: 97.4341% ( 3) 00:15:17.064 4.551 - 4.575: 97.4497% ( 2) 00:15:17.064 4.575 - 4.599: 97.4652% ( 2) 00:15:17.064 4.670 - 4.693: 97.4963% ( 4) 00:15:17.064 4.693 - 4.717: 97.5352% ( 5) 00:15:17.064 4.717 - 4.741: 97.5430% ( 1) 00:15:17.064 4.741 - 4.764: 97.5585% ( 2) 00:15:17.064 4.764 - 4.788: 97.6052% ( 6) 00:15:17.064 4.788 - 4.812: 97.6363% ( 4) 00:15:17.064 4.812 - 4.836: 97.7062% ( 9) 00:15:17.064 4.836 - 4.859: 97.7607% ( 7) 00:15:17.064 4.859 - 4.883: 97.8229% ( 8) 00:15:17.064 4.883 - 4.907: 97.8695% ( 6) 00:15:17.064 4.907 - 4.930: 97.9551% ( 11) 00:15:17.064 4.930 - 4.954: 97.9862% ( 4) 00:15:17.064 4.954 - 4.978: 98.0173% ( 4) 00:15:17.064 4.978 - 5.001: 98.1106% ( 12) 00:15:17.064 5.001 - 5.025: 98.1572% ( 6) 00:15:17.064 5.025 - 5.049: 98.1883% ( 4) 00:15:17.064 5.049 - 5.073: 98.2194% ( 4) 00:15:17.064 5.073 - 5.096: 98.2272% ( 1) 00:15:17.064 5.096 - 5.120: 98.2583% ( 4) 00:15:17.064 5.120 - 5.144: 98.2894% ( 4) 00:15:17.064 5.144 - 5.167: 98.3127% ( 3) 00:15:17.064 5.167 - 5.191: 98.3283% ( 2) 00:15:17.064 5.191 - 5.215: 98.3516% ( 3) 00:15:17.064 5.215 - 5.239: 98.3672% ( 2) 00:15:17.064 5.239 - 5.262: 98.3983% ( 4) 00:15:17.064 5.357 - 5.381: 98.4060% ( 1) 00:15:17.064 5.381 - 5.404: 98.4216% ( 2) 00:15:17.064 5.428 - 5.452: 98.4294% ( 1) 00:15:17.064 5.452 - 5.476: 98.4449% ( 2) 00:15:17.064 5.499 - 5.523: 98.4605% ( 2) 00:15:17.064 5.594 - 5.618: 98.4760% ( 2) 00:15:17.064 5.760 - 5.784: 98.4916% ( 2) 00:15:17.064 5.807 - 5.831: 98.4993% ( 1) 00:15:17.064 5.855 - 5.879: 98.5071% ( 1) 00:15:17.064 6.044 - 6.068: 98.5149% ( 1) 00:15:17.064 6.353 - 6.400: 98.5227% ( 1) 00:15:17.064 6.590 - 6.637: 98.5382% ( 2) 00:15:17.064 6.827 - 6.874: 98.5460% ( 1) 00:15:17.064 7.301 - 7.348: 98.5538% ( 1) 00:15:17.064 7.538 - 7.585: 98.5615% ( 1) 00:15:17.064 7.775 - 7.822: 98.5771% ( 2) 00:15:17.064 7.917 - 7.964: 98.5849% ( 1) 00:15:17.064 8.107 - 8.154: 98.5926% ( 1) 00:15:17.064 8.154 - 8.201: 98.6004% ( 1) 00:15:17.064 8.296 - 8.344: 98.6160% ( 2) 00:15:17.064 8.439 - 8.486: 98.6315% ( 2) 00:15:17.064 8.723 - 8.770: 98.6393% ( 1) 00:15:17.064 8.770 - 8.818: 98.6471% ( 1) 00:15:17.064 8.818 - 8.865: 98.6704% ( 3) 00:15:17.064 8.865 - 8.913: 98.6859% ( 2) 00:15:17.064 8.913 - 8.960: 98.6937% ( 1) 00:15:17.064 9.102 - 9.150: 98.7015% ( 1) 00:15:17.064 9.197 - 9.244: 98.7093% ( 1) 00:15:17.064 9.244 - 9.292: 98.7248% ( 2) 00:15:17.064 9.292 - 9.339: 98.7326% ( 1) 00:15:17.064 9.624 - 9.671: 98.7404% ( 1) 00:15:17.064 9.671 - 9.719: 98.7482% ( 1) 00:15:17.064 9.719 - 9.766: 98.7559% ( 1) 00:15:17.064 9.766 - 9.813: 98.7637% ( 1) 00:15:17.064 9.861 - 9.908: 98.7793% ( 2) 00:15:17.064 9.956 - 10.003: 98.7870% ( 1) 00:15:17.064 10.003 - 10.050: 98.7948% ( 1) 00:15:17.064 10.050 - 10.098: 98.8026% ( 1) 00:15:17.064 10.145 - 10.193: 98.8104% ( 1) 00:15:17.064 10.287 - 10.335: 98.8181% ( 1) 00:15:17.064 10.335 - 10.382: 98.8259% ( 1) 00:15:17.064 10.809 - 10.856: 98.8337% ( 1) 00:15:17.064 10.904 - 10.951: 98.8415% ( 1) 00:15:17.064 11.330 - 11.378: 98.8492% ( 1) 00:15:17.064 11.852 - 11.899: 98.8570% ( 1) 00:15:17.064 12.516 - 12.610: 98.8726% ( 2) 00:15:17.064 12.895 - 12.990: 98.8803% ( 1) 00:15:17.064 13.748 - 13.843: 98.8881% ( 1) 00:15:17.064 14.033 - 14.127: 98.8959% ( 1) 00:15:17.064 14.412 - 14.507: 98.9037% ( 1) 00:15:17.064 14.601 - 14.696: 98.9114% ( 1) 00:15:17.064 15.170 - 15.265: 98.9192% ( 1) 00:15:17.064 17.161 - 17.256: 98.9425% ( 3) 00:15:17.064 17.256 - 17.351: 98.9814% ( 5) 00:15:17.064 17.351 - 17.446: 99.0047% ( 3) 00:15:17.064 17.446 - 17.541: 99.0281% ( 3) 00:15:17.064 17.541 - 17.636: 99.0436% ( 2) 00:15:17.064 17.636 - 17.730: 99.0669% ( 3) 00:15:17.064 17.730 - 17.825: 99.1214% ( 7) 00:15:17.064 17.825 - 17.920: 99.1525% ( 4) 00:15:17.064 17.920 - 18.015: 99.1991% ( 6) 00:15:17.064 18.015 - 18.110: 99.2380% ( 5) 00:15:17.064 18.110 - 18.204: 99.3235% ( 11) 00:15:17.064 18.204 - 18.299: 99.3780% ( 7) 00:15:17.064 18.299 - 18.394: 99.4324% ( 7) 00:15:17.064 18.394 - 18.489: 99.5179% ( 11) 00:15:17.064 18.489 - 18.584: 99.6190% ( 13) 00:15:17.064 18.584 - 18.679: 99.6579% ( 5) 00:15:17.064 18.679 - 18.773: 99.7045% ( 6) 00:15:17.064 18.773 - 18.868: 99.7512% ( 6) 00:15:17.064 18.868 - 18.963: 99.7823% ( 4) 00:15:17.064 18.963 - 19.058: 99.8212% ( 5) 00:15:17.064 19.153 - 19.247: 99.8367% ( 2) 00:15:17.064 19.437 - 19.532: 99.8445% ( 1) 00:15:17.064 20.290 - 20.385: 99.8523% ( 1) 00:15:17.064 23.230 - 23.324: 99.8600% ( 1) 00:15:17.064 23.799 - 23.893: 99.8678% ( 1) 00:15:17.064 24.083 - 24.178: 99.8756% ( 1) 00:15:17.064 27.307 - 27.496: 99.8834% ( 1) 00:15:17.064 3980.705 - 4004.978: 99.9767% ( 12) 00:15:17.064 4004.978 - 4029.250: 100.0000% ( 3) 00:15:17.064 00:15:17.064 Complete histogram 00:15:17.064 ================== 00:15:17.064 Range in us Cumulative Count 00:15:17.064 2.050 - 2.062: 0.0078% ( 1) 00:15:17.064 2.062 - 2.074: 5.3029% ( 681) 00:15:17.064 2.074 - 2.086: 41.0310% ( 4595) 00:15:17.064 2.086 - 2.098: 48.9775% ( 1022) 00:15:17.064 2.098 - 2.110: 52.2743% ( 424) 00:15:17.064 2.110 - 2.121: 59.2256% ( 894) 00:15:17.064 2.121 - 2.133: 61.2005% ( 254) 00:15:17.064 2.133 - 2.145: 67.0477% ( 752) 00:15:17.064 2.145 - 2.157: 75.9894% ( 1150) 00:15:17.064 2.157 - 2.169: 77.4434% ( 187) 00:15:17.064 2.169 - 2.181: 79.3173% ( 241) 00:15:17.064 2.181 - 2.193: 81.4167% ( 270) 00:15:17.064 2.193 - 2.204: 82.1320% ( 92) 00:15:17.064 2.204 - 2.216: 84.1614% ( 261) 00:15:17.064 2.216 - 2.228: 88.1502% ( 513) 00:15:17.064 2.228 - 2.240: 89.8764% ( 222) 00:15:17.064 2.240 - 2.252: 92.0535% ( 280) 00:15:17.064 2.252 - 2.264: 93.4297% ( 177) 00:15:17.064 2.264 - 2.276: 93.7252% ( 38) 00:15:17.064 2.276 - 2.287: 94.0285% ( 39) 00:15:17.064 2.287 - 2.299: 94.2617% ( 30) 00:15:17.064 2.299 - 2.311: 94.6505% ( 50) 00:15:17.064 2.311 - 2.323: 95.3503% ( 90) 00:15:17.064 2.323 - 2.335: 95.5291% ( 23) 00:15:17.064 2.335 - 2.347: 95.5524% ( 3) 00:15:17.064 2.347 - 2.359: 95.5835% ( 4) 00:15:17.064 2.359 - 2.370: 95.6146% ( 4) 00:15:17.064 2.370 - 2.382: 95.6769% ( 8) 00:15:17.064 2.382 - 2.394: 95.8246% ( 19) 00:15:17.064 2.394 - 2.406: 96.0734% ( 32) 00:15:17.064 2.406 - 2.418: 96.1900% ( 15) 00:15:17.064 2.418 - 2.430: 96.4233% ( 30) 00:15:17.064 2.430 - 2.441: 96.6177% ( 25) 00:15:17.064 2.441 - 2.453: 96.7887% ( 22) 00:15:17.064 2.453 - 2.465: 96.9754% ( 24) 00:15:17.064 2.465 - 2.477: 97.1931% ( 28) 00:15:17.064 2.477 - 2.489: 97.3175% ( 16) 00:15:17.064 2.489 - 2.501: 97.4730% ( 20) 00:15:17.064 2.501 - 2.513: 97.6285% ( 20) 00:15:17.064 2.513 - 2.524: 97.7840% ( 20) 00:15:17.064 2.524 - 2.536: 97.9162% ( 17) 00:15:17.064 2.536 - 2.548: 98.0017% ( 11) 00:15:17.064 2.548 - 2.560: 98.1183% ( 15) 00:15:17.064 2.560 - 2.572: 98.2039% ( 11) 00:15:17.064 2.572 - 2.584: 98.2272% ( 3) 00:15:17.064 2.584 - 2.596: 98.2739% ( 6) 00:15:17.064 2.596 - 2.607: 98.2972% ( 3) 00:15:17.064 2.619 - 2.631: 98.3050% ( 1) 00:15:17.064 2.631 - 2.643: 98.3127% ( 1) 00:15:17.064 2.643 - 2.655: 98.3205% ( 1) 00:15:17.064 2.702 - 2.714: 98.3283% ( 1) 00:15:17.064 2.714 - 2.726: 98.3516% ( 3) 00:15:17.064 2.726 - 2.738: 98.3749% ( 3) 00:15:17.064 2.738 - 2.750: 98.3983% ( 3) 00:15:17.064 2.797 - 2.809: 98.4060% ( 1) 00:15:17.064 2.809 - 2.821: 98.4138% ( 1) 00:15:17.064 2.821 - 2.833: 98.4216% ( 1) 00:15:17.064 2.833 - 2.844: 98.4294% ( 1) 00:15:17.064 2.844 - 2.856: 98.4371% ( 1) 00:15:17.064 2.868 - 2.880: 98.4449% ( 1) 00:15:17.064 2.916 - 2.927: 98.4527% ( 1) 00:15:17.064 2.963 - 2.975: 98.4605% ( 1) 00:15:17.064 3.390 - 3.413: 98.4682% ( 1) 00:15:17.065 3.413 - 3.437: 98.4760% ( 1) 00:15:17.065 3.484 - 3.508: 98.4838% ( 1) 00:15:17.065 3.508 - 3.532: 98.4916% ( 1) 00:15:17.065 3.532 - 3.556: 98.5071% ( 2) 00:15:17.065 3.556 - 3.579: 98.5227% ( 2) 00:15:17.065 3.603 - 3.627: 98.5304% ( 1) 00:15:17.065 3.627 - 3.650: 98.5460% ( 2) 00:15:17.065 3.674 - 3.698: 98.5538% ( 1) 00:15:17.065 3.745 - 3.769: 98.5615% ( 1) 00:15:17.065 3.769 - 3.793: 98.5693% ( 1) 00:15:17.065 3.793 - 3.816: 98.5771% ( 1) 00:15:17.065 3.816 - 3.840: 98.5849% ( 1) 00:15:17.065 3.840 - 3.864: 98.6004% ( 2) 00:15:17.065 3.864 - 3.887: 98.6082% ( 1) 00:15:17.065 3.887 - 3.911: 98.6237% ( 2) 00:15:17.065 3.935 - 3.959: 98.6393% ( 2) 00:15:17.065 3.982 - 4.006: 98.6471% ( 1) 00:15:17.065 4.124 - 4.148: 98.6548% ( 1) 00:15:17.065 6.044 - 6.068: 98.6626% ( 1) 00:15:17.065 6.210 - 6.258: 98.6704% ( 1) 00:15:17.065 6.305 - 6.353: 98.6782% ( 1) 00:15:17.065 6.400 - 6.447: 98.6859% ( 1) 00:15:17.065 6.495 - 6.542: 98.6937% ( 1) 00:15:17.065 6.590 - 6.637: 98.7015% ( 1) 00:15:17.065 6.827 - 6.874: 98.7093% ( 1) 00:15:17.065 6.874 - 6.921: 98.7171% ( 1) 00:15:17.065 6.921 - 6.969: 98.7326% ( 2) 00:15:17.065 7.538 - 7.585: 98.7404% ( 1) 00:15:17.065 7.633 - 7.680: 98.7482% ( 1) 00:15:17.065 7.870 - 7.917: 98.7559% ( 1) 00:15:17.065 7.917 - 7.964: 98.7637% ( 1) 00:15:17.065 8.107 - 8.154: 98.7715% ( 1) 00:15:17.065 9.055 - 9.102: 98.7793% ( 1) 00:15:17.065 9.339 - 9.387: 98.7870% ( 1) 00:15:17.065 9.576 - 9.624: 98.7948% ( 1) 00:15:17.065 14.412 - 14.507: 9[2024-10-07 13:26:12.682251] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:17.065 8.8026% ( 1) 00:15:17.065 15.550 - 15.644: 98.8104% ( 1) 00:15:17.065 15.644 - 15.739: 98.8415% ( 4) 00:15:17.065 15.739 - 15.834: 98.8492% ( 1) 00:15:17.065 15.834 - 15.929: 98.8803% ( 4) 00:15:17.065 15.929 - 16.024: 98.9192% ( 5) 00:15:17.065 16.024 - 16.119: 98.9270% ( 1) 00:15:17.065 16.119 - 16.213: 98.9425% ( 2) 00:15:17.065 16.213 - 16.308: 98.9892% ( 6) 00:15:17.065 16.308 - 16.403: 99.0281% ( 5) 00:15:17.065 16.403 - 16.498: 99.0669% ( 5) 00:15:17.065 16.498 - 16.593: 99.0825% ( 2) 00:15:17.065 16.593 - 16.687: 99.1136% ( 4) 00:15:17.065 16.687 - 16.782: 99.1447% ( 4) 00:15:17.065 16.782 - 16.877: 99.1680% ( 3) 00:15:17.065 16.877 - 16.972: 99.2225% ( 7) 00:15:17.065 16.972 - 17.067: 99.2380% ( 2) 00:15:17.065 17.067 - 17.161: 99.2458% ( 1) 00:15:17.065 17.161 - 17.256: 99.2613% ( 2) 00:15:17.065 17.351 - 17.446: 99.2691% ( 1) 00:15:17.065 17.446 - 17.541: 99.2924% ( 3) 00:15:17.065 17.920 - 18.015: 99.3002% ( 1) 00:15:17.065 18.110 - 18.204: 99.3080% ( 1) 00:15:17.065 18.394 - 18.489: 99.3158% ( 1) 00:15:17.065 21.618 - 21.713: 99.3235% ( 1) 00:15:17.065 21.713 - 21.807: 99.3313% ( 1) 00:15:17.065 22.945 - 23.040: 99.3391% ( 1) 00:15:17.065 3519.526 - 3543.799: 99.3469% ( 1) 00:15:17.065 3980.705 - 4004.978: 99.8756% ( 68) 00:15:17.065 4004.978 - 4029.250: 100.0000% ( 16) 00:15:17.065 00:15:17.065 13:26:12 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:17.065 13:26:12 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:17.065 13:26:12 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:17.065 13:26:12 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:17.065 13:26:12 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:17.323 [ 00:15:17.323 { 00:15:17.323 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:17.323 "subtype": "Discovery", 00:15:17.323 "listen_addresses": [], 00:15:17.323 "allow_any_host": true, 00:15:17.323 "hosts": [] 00:15:17.323 }, 00:15:17.323 { 00:15:17.323 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:17.323 "subtype": "NVMe", 00:15:17.323 "listen_addresses": [ 00:15:17.323 { 00:15:17.323 "trtype": "VFIOUSER", 00:15:17.323 "adrfam": "IPv4", 00:15:17.323 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:17.323 "trsvcid": "0" 00:15:17.323 } 00:15:17.323 ], 00:15:17.323 "allow_any_host": true, 00:15:17.323 "hosts": [], 00:15:17.323 "serial_number": "SPDK1", 00:15:17.323 "model_number": "SPDK bdev Controller", 00:15:17.323 "max_namespaces": 32, 00:15:17.323 "min_cntlid": 1, 00:15:17.323 "max_cntlid": 65519, 00:15:17.323 "namespaces": [ 00:15:17.323 { 00:15:17.323 "nsid": 1, 00:15:17.323 "bdev_name": "Malloc1", 00:15:17.323 "name": "Malloc1", 00:15:17.323 "nguid": "B27DA7EBABD34D799EC7189772C78E37", 00:15:17.323 "uuid": "b27da7eb-abd3-4d79-9ec7-189772c78e37" 00:15:17.323 }, 00:15:17.323 { 00:15:17.323 "nsid": 2, 00:15:17.323 "bdev_name": "Malloc3", 00:15:17.323 "name": "Malloc3", 00:15:17.323 "nguid": "5C43418FD1E04E5EAE9DC1732D636370", 00:15:17.323 "uuid": "5c43418f-d1e0-4e5e-ae9d-c1732d636370" 00:15:17.323 } 00:15:17.323 ] 00:15:17.323 }, 00:15:17.323 { 00:15:17.323 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:17.323 "subtype": "NVMe", 00:15:17.323 "listen_addresses": [ 00:15:17.323 { 00:15:17.323 "trtype": "VFIOUSER", 00:15:17.323 "adrfam": "IPv4", 00:15:17.323 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:17.323 "trsvcid": "0" 00:15:17.323 } 00:15:17.323 ], 00:15:17.323 "allow_any_host": true, 00:15:17.323 "hosts": [], 00:15:17.323 "serial_number": "SPDK2", 00:15:17.323 "model_number": "SPDK bdev Controller", 00:15:17.323 "max_namespaces": 32, 00:15:17.323 "min_cntlid": 1, 00:15:17.323 "max_cntlid": 65519, 00:15:17.323 "namespaces": [ 00:15:17.323 { 00:15:17.323 "nsid": 1, 00:15:17.323 "bdev_name": "Malloc2", 00:15:17.323 "name": "Malloc2", 00:15:17.323 "nguid": "2219E94CC5BC4889B0AD3FCA7B4D200A", 00:15:17.323 "uuid": "2219e94c-c5bc-4889-b0ad-3fca7b4d200a" 00:15:17.323 } 00:15:17.323 ] 00:15:17.323 } 00:15:17.323 ] 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@34 -- # aerpid=620119 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1265 -- # local i=0 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1272 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1276 -- # return 0 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:17.323 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:17.323 [2024-10-07 13:26:13.228012] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: enabling controller 00:15:17.581 Malloc4 00:15:17.581 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:15:17.839 [2024-10-07 13:26:13.629003] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user/domain/vfio-user2/2: disabling controller 00:15:17.839 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:17.839 Asynchronous Event Request test 00:15:17.839 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:17.839 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:17.839 Registering asynchronous event callbacks... 00:15:17.839 Starting namespace attribute notice tests for all controllers... 00:15:17.839 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:17.839 aer_cb - Changed Namespace 00:15:17.839 Cleaning up... 00:15:18.096 [ 00:15:18.096 { 00:15:18.096 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:18.096 "subtype": "Discovery", 00:15:18.096 "listen_addresses": [], 00:15:18.096 "allow_any_host": true, 00:15:18.096 "hosts": [] 00:15:18.096 }, 00:15:18.096 { 00:15:18.096 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:18.096 "subtype": "NVMe", 00:15:18.096 "listen_addresses": [ 00:15:18.096 { 00:15:18.096 "trtype": "VFIOUSER", 00:15:18.096 "adrfam": "IPv4", 00:15:18.096 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:18.096 "trsvcid": "0" 00:15:18.096 } 00:15:18.096 ], 00:15:18.096 "allow_any_host": true, 00:15:18.096 "hosts": [], 00:15:18.096 "serial_number": "SPDK1", 00:15:18.096 "model_number": "SPDK bdev Controller", 00:15:18.096 "max_namespaces": 32, 00:15:18.096 "min_cntlid": 1, 00:15:18.096 "max_cntlid": 65519, 00:15:18.096 "namespaces": [ 00:15:18.096 { 00:15:18.096 "nsid": 1, 00:15:18.096 "bdev_name": "Malloc1", 00:15:18.096 "name": "Malloc1", 00:15:18.096 "nguid": "B27DA7EBABD34D799EC7189772C78E37", 00:15:18.096 "uuid": "b27da7eb-abd3-4d79-9ec7-189772c78e37" 00:15:18.096 }, 00:15:18.096 { 00:15:18.096 "nsid": 2, 00:15:18.096 "bdev_name": "Malloc3", 00:15:18.097 "name": "Malloc3", 00:15:18.097 "nguid": "5C43418FD1E04E5EAE9DC1732D636370", 00:15:18.097 "uuid": "5c43418f-d1e0-4e5e-ae9d-c1732d636370" 00:15:18.097 } 00:15:18.097 ] 00:15:18.097 }, 00:15:18.097 { 00:15:18.097 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:18.097 "subtype": "NVMe", 00:15:18.097 "listen_addresses": [ 00:15:18.097 { 00:15:18.097 "trtype": "VFIOUSER", 00:15:18.097 "adrfam": "IPv4", 00:15:18.097 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:18.097 "trsvcid": "0" 00:15:18.097 } 00:15:18.097 ], 00:15:18.097 "allow_any_host": true, 00:15:18.097 "hosts": [], 00:15:18.097 "serial_number": "SPDK2", 00:15:18.097 "model_number": "SPDK bdev Controller", 00:15:18.097 "max_namespaces": 32, 00:15:18.097 "min_cntlid": 1, 00:15:18.097 "max_cntlid": 65519, 00:15:18.097 "namespaces": [ 00:15:18.097 { 00:15:18.097 "nsid": 1, 00:15:18.097 "bdev_name": "Malloc2", 00:15:18.097 "name": "Malloc2", 00:15:18.097 "nguid": "2219E94CC5BC4889B0AD3FCA7B4D200A", 00:15:18.097 "uuid": "2219e94c-c5bc-4889-b0ad-3fca7b4d200a" 00:15:18.097 }, 00:15:18.097 { 00:15:18.097 "nsid": 2, 00:15:18.097 "bdev_name": "Malloc4", 00:15:18.097 "name": "Malloc4", 00:15:18.097 "nguid": "FFF440BF3F2F481AA3C0BB67191FB3CD", 00:15:18.097 "uuid": "fff440bf-3f2f-481a-a3c0-bb67191fb3cd" 00:15:18.097 } 00:15:18.097 ] 00:15:18.097 } 00:15:18.097 ] 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@44 -- # wait 620119 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@95 -- # killprocess 614505 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@950 -- # '[' -z 614505 ']' 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@954 -- # kill -0 614505 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@955 -- # uname 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 614505 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@968 -- # echo 'killing process with pid 614505' 00:15:18.097 killing process with pid 614505 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@969 -- # kill 614505 00:15:18.097 13:26:13 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@974 -- # wait 614505 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=620271 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 620271' 00:15:18.661 Process pid: 620271 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 620271 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@831 -- # '[' -z 620271 ']' 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:18.661 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:18.661 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@10 -- # set +x 00:15:18.661 [2024-10-07 13:26:14.394881] thread.c:2964:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:15:18.661 [2024-10-07 13:26:14.395931] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:18.661 [2024-10-07 13:26:14.396004] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:18.661 [2024-10-07 13:26:14.453339] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:18.661 [2024-10-07 13:26:14.551973] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:18.661 [2024-10-07 13:26:14.552048] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:18.661 [2024-10-07 13:26:14.552072] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:18.661 [2024-10-07 13:26:14.552082] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:18.662 [2024-10-07 13:26:14.552091] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:18.662 [2024-10-07 13:26:14.553636] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:18.662 [2024-10-07 13:26:14.553703] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:15:18.662 [2024-10-07 13:26:14.553770] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:15:18.662 [2024-10-07 13:26:14.553767] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:15:18.920 [2024-10-07 13:26:14.646785] thread.c:2115:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_000) to intr mode from intr mode. 00:15:18.920 [2024-10-07 13:26:14.646984] thread.c:2115:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_001) to intr mode from intr mode. 00:15:18.920 [2024-10-07 13:26:14.647297] thread.c:2115:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_002) to intr mode from intr mode. 00:15:18.920 [2024-10-07 13:26:14.648015] thread.c:2115:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:15:18.920 [2024-10-07 13:26:14.648266] thread.c:2115:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_003) to intr mode from intr mode. 00:15:18.920 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:18.920 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@864 -- # return 0 00:15:18.920 13:26:14 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:19.854 13:26:15 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:15:20.112 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:20.112 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:20.112 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:20.112 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:20.112 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:20.678 Malloc1 00:15:20.678 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:20.936 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:21.194 13:26:16 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:21.451 13:26:17 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:21.451 13:26:17 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:21.451 13:26:17 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:21.709 Malloc2 00:15:21.709 13:26:17 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:21.966 13:26:17 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:22.242 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@95 -- # killprocess 620271 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@950 -- # '[' -z 620271 ']' 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@954 -- # kill -0 620271 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@955 -- # uname 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 620271 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@968 -- # echo 'killing process with pid 620271' 00:15:22.500 killing process with pid 620271 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@969 -- # kill 620271 00:15:22.500 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@974 -- # wait 620271 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:23.068 00:15:23.068 real 0m53.553s 00:15:23.068 user 3m26.364s 00:15:23.068 sys 0m3.948s 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user -- common/autotest_common.sh@10 -- # set +x 00:15:23.068 ************************************ 00:15:23.068 END TEST nvmf_vfio_user 00:15:23.068 ************************************ 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@32 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:23.068 ************************************ 00:15:23.068 START TEST nvmf_vfio_user_nvme_compliance 00:15:23.068 ************************************ 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:15:23.068 * Looking for test storage... 00:15:23.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1681 -- # lcov --version 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@336 -- # IFS=.-: 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@336 -- # read -ra ver1 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@337 -- # IFS=.-: 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@337 -- # read -ra ver2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@338 -- # local 'op=<' 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@340 -- # ver1_l=2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@341 -- # ver2_l=1 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@344 -- # case "$op" in 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@345 -- # : 1 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@365 -- # decimal 1 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@353 -- # local d=1 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@355 -- # echo 1 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@365 -- # ver1[v]=1 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@366 -- # decimal 2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@353 -- # local d=2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@355 -- # echo 2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@366 -- # ver2[v]=2 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@368 -- # return 0 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:23.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.068 --rc genhtml_branch_coverage=1 00:15:23.068 --rc genhtml_function_coverage=1 00:15:23.068 --rc genhtml_legend=1 00:15:23.068 --rc geninfo_all_blocks=1 00:15:23.068 --rc geninfo_unexecuted_blocks=1 00:15:23.068 00:15:23.068 ' 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:23.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.068 --rc genhtml_branch_coverage=1 00:15:23.068 --rc genhtml_function_coverage=1 00:15:23.068 --rc genhtml_legend=1 00:15:23.068 --rc geninfo_all_blocks=1 00:15:23.068 --rc geninfo_unexecuted_blocks=1 00:15:23.068 00:15:23.068 ' 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:23.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.068 --rc genhtml_branch_coverage=1 00:15:23.068 --rc genhtml_function_coverage=1 00:15:23.068 --rc genhtml_legend=1 00:15:23.068 --rc geninfo_all_blocks=1 00:15:23.068 --rc geninfo_unexecuted_blocks=1 00:15:23.068 00:15:23.068 ' 00:15:23.068 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:23.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.068 --rc genhtml_branch_coverage=1 00:15:23.068 --rc genhtml_function_coverage=1 00:15:23.068 --rc genhtml_legend=1 00:15:23.068 --rc geninfo_all_blocks=1 00:15:23.068 --rc geninfo_unexecuted_blocks=1 00:15:23.068 00:15:23.068 ' 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@7 -- # uname -s 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@15 -- # shopt -s extglob 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- paths/export.sh@5 -- # export PATH 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@51 -- # : 0 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:23.069 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@20 -- # nvmfpid=620878 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@21 -- # echo 'Process pid: 620878' 00:15:23.069 Process pid: 620878 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@24 -- # waitforlisten 620878 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@831 -- # '[' -z 620878 ']' 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:23.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:23.069 13:26:18 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@10 -- # set +x 00:15:23.069 [2024-10-07 13:26:18.959419] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:23.069 [2024-10-07 13:26:18.959522] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:23.327 [2024-10-07 13:26:19.035845] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:23.327 [2024-10-07 13:26:19.145519] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:23.327 [2024-10-07 13:26:19.145582] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:23.327 [2024-10-07 13:26:19.145605] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:23.327 [2024-10-07 13:26:19.145616] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:23.327 [2024-10-07 13:26:19.145627] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:23.327 [2024-10-07 13:26:19.146504] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:23.327 [2024-10-07 13:26:19.146562] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:15:23.327 [2024-10-07 13:26:19.146565] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:15:23.584 13:26:19 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:23.584 13:26:19 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@864 -- # return 0 00:15:23.584 13:26:19 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@26 -- # sleep 1 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@10 -- # set +x 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@10 -- # set +x 00:15:24.517 malloc0 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.517 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@10 -- # set +x 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@10 -- # set +x 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@10 -- # set +x 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.518 13:26:20 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:15:24.775 00:15:24.775 00:15:24.775 CUnit - A unit testing framework for C - Version 2.1-3 00:15:24.775 http://cunit.sourceforge.net/ 00:15:24.775 00:15:24.775 00:15:24.775 Suite: nvme_compliance 00:15:24.775 Test: admin_identify_ctrlr_verify_dptr ...[2024-10-07 13:26:20.510112] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:24.775 [2024-10-07 13:26:20.511669] vfio_user.c: 804:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:15:24.775 [2024-10-07 13:26:20.511697] vfio_user.c:5507:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:15:24.775 [2024-10-07 13:26:20.511710] vfio_user.c:5600:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:15:24.775 [2024-10-07 13:26:20.515146] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:24.775 passed 00:15:24.775 Test: admin_identify_ctrlr_verify_fused ...[2024-10-07 13:26:20.599762] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:24.775 [2024-10-07 13:26:20.602796] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:24.776 passed 00:15:24.776 Test: admin_identify_ns ...[2024-10-07 13:26:20.690095] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.033 [2024-10-07 13:26:20.750504] ctrlr.c:2750:_nvmf_ctrlr_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:15:25.033 [2024-10-07 13:26:20.758502] ctrlr.c:2750:_nvmf_ctrlr_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:15:25.033 [2024-10-07 13:26:20.779629] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.033 passed 00:15:25.033 Test: admin_get_features_mandatory_features ...[2024-10-07 13:26:20.863286] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.033 [2024-10-07 13:26:20.866307] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.033 passed 00:15:25.033 Test: admin_get_features_optional_features ...[2024-10-07 13:26:20.950898] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.033 [2024-10-07 13:26:20.953917] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.290 passed 00:15:25.290 Test: admin_set_features_number_of_queues ...[2024-10-07 13:26:21.038146] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.290 [2024-10-07 13:26:21.144603] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.290 passed 00:15:25.548 Test: admin_get_log_page_mandatory_logs ...[2024-10-07 13:26:21.226797] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.548 [2024-10-07 13:26:21.229829] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.548 passed 00:15:25.548 Test: admin_get_log_page_with_lpo ...[2024-10-07 13:26:21.312021] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.548 [2024-10-07 13:26:21.379501] ctrlr.c:2697:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:15:25.548 [2024-10-07 13:26:21.392602] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.548 passed 00:15:25.548 Test: fabric_property_get ...[2024-10-07 13:26:21.476215] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.548 [2024-10-07 13:26:21.477516] vfio_user.c:5600:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x7f failed 00:15:25.548 [2024-10-07 13:26:21.479230] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.806 passed 00:15:25.806 Test: admin_delete_io_sq_use_admin_qid ...[2024-10-07 13:26:21.564829] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.806 [2024-10-07 13:26:21.566136] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:15:25.806 [2024-10-07 13:26:21.567852] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:25.806 passed 00:15:25.806 Test: admin_delete_io_sq_delete_sq_twice ...[2024-10-07 13:26:21.650373] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:25.806 [2024-10-07 13:26:21.735500] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:26.064 [2024-10-07 13:26:21.751496] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:26.064 [2024-10-07 13:26:21.753618] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:26.064 passed 00:15:26.064 Test: admin_delete_io_cq_use_admin_qid ...[2024-10-07 13:26:21.839120] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:26.064 [2024-10-07 13:26:21.840392] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:15:26.064 [2024-10-07 13:26:21.842137] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:26.064 passed 00:15:26.064 Test: admin_delete_io_cq_delete_cq_first ...[2024-10-07 13:26:21.925344] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:26.321 [2024-10-07 13:26:22.006496] vfio_user.c:2319:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:15:26.321 [2024-10-07 13:26:22.030499] vfio_user.c:2309:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:15:26.321 [2024-10-07 13:26:22.035614] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:26.321 passed 00:15:26.321 Test: admin_create_io_cq_verify_iv_pc ...[2024-10-07 13:26:22.118748] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:26.321 [2024-10-07 13:26:22.120086] vfio_user.c:2158:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:15:26.321 [2024-10-07 13:26:22.120124] vfio_user.c:2152:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:15:26.321 [2024-10-07 13:26:22.121765] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:26.321 passed 00:15:26.321 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-10-07 13:26:22.206974] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:26.579 [2024-10-07 13:26:22.298499] vfio_user.c:2240:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:15:26.579 [2024-10-07 13:26:22.305498] vfio_user.c:2240:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:15:26.579 [2024-10-07 13:26:22.313495] vfio_user.c:2038:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:15:26.579 [2024-10-07 13:26:22.321499] vfio_user.c:2038:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:15:26.579 [2024-10-07 13:26:22.350601] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:26.579 passed 00:15:26.579 Test: admin_create_io_sq_verify_pc ...[2024-10-07 13:26:22.433244] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:26.579 [2024-10-07 13:26:22.449512] vfio_user.c:2051:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:15:26.579 [2024-10-07 13:26:22.467577] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:26.579 passed 00:15:26.836 Test: admin_create_io_qp_max_qps ...[2024-10-07 13:26:22.550142] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:27.770 [2024-10-07 13:26:23.649503] nvme_ctrlr.c:5504:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:15:28.334 [2024-10-07 13:26:24.032158] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:28.334 passed 00:15:28.334 Test: admin_create_io_sq_shared_cq ...[2024-10-07 13:26:24.115494] vfio_user.c:2836:enable_ctrlr: *NOTICE*: /var/run/vfio-user: enabling controller 00:15:28.334 [2024-10-07 13:26:24.249497] vfio_user.c:2319:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:15:28.591 [2024-10-07 13:26:24.286574] vfio_user.c:2798:disable_ctrlr: *NOTICE*: /var/run/vfio-user: disabling controller 00:15:28.591 passed 00:15:28.591 00:15:28.591 Run Summary: Type Total Ran Passed Failed Inactive 00:15:28.591 suites 1 1 n/a 0 0 00:15:28.591 tests 18 18 18 0 0 00:15:28.592 asserts 360 360 360 0 n/a 00:15:28.592 00:15:28.592 Elapsed time = 1.566 seconds 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@42 -- # killprocess 620878 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@950 -- # '[' -z 620878 ']' 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@954 -- # kill -0 620878 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@955 -- # uname 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 620878 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@968 -- # echo 'killing process with pid 620878' 00:15:28.592 killing process with pid 620878 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@969 -- # kill 620878 00:15:28.592 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@974 -- # wait 620878 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:15:28.850 00:15:28.850 real 0m5.925s 00:15:28.850 user 0m16.454s 00:15:28.850 sys 0m0.548s 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_nvme_compliance -- common/autotest_common.sh@10 -- # set +x 00:15:28.850 ************************************ 00:15:28.850 END TEST nvmf_vfio_user_nvme_compliance 00:15:28.850 ************************************ 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@33 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:28.850 ************************************ 00:15:28.850 START TEST nvmf_vfio_user_fuzz 00:15:28.850 ************************************ 00:15:28.850 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:15:28.850 * Looking for test storage... 00:15:29.109 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1681 -- # lcov --version 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@336 -- # IFS=.-: 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@336 -- # read -ra ver1 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@337 -- # IFS=.-: 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@337 -- # read -ra ver2 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@338 -- # local 'op=<' 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@340 -- # ver1_l=2 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@341 -- # ver2_l=1 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@344 -- # case "$op" in 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@345 -- # : 1 00:15:29.109 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@365 -- # decimal 1 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@353 -- # local d=1 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@355 -- # echo 1 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@365 -- # ver1[v]=1 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@366 -- # decimal 2 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@353 -- # local d=2 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@355 -- # echo 2 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@366 -- # ver2[v]=2 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@368 -- # return 0 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:29.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.110 --rc genhtml_branch_coverage=1 00:15:29.110 --rc genhtml_function_coverage=1 00:15:29.110 --rc genhtml_legend=1 00:15:29.110 --rc geninfo_all_blocks=1 00:15:29.110 --rc geninfo_unexecuted_blocks=1 00:15:29.110 00:15:29.110 ' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:29.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.110 --rc genhtml_branch_coverage=1 00:15:29.110 --rc genhtml_function_coverage=1 00:15:29.110 --rc genhtml_legend=1 00:15:29.110 --rc geninfo_all_blocks=1 00:15:29.110 --rc geninfo_unexecuted_blocks=1 00:15:29.110 00:15:29.110 ' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:29.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.110 --rc genhtml_branch_coverage=1 00:15:29.110 --rc genhtml_function_coverage=1 00:15:29.110 --rc genhtml_legend=1 00:15:29.110 --rc geninfo_all_blocks=1 00:15:29.110 --rc geninfo_unexecuted_blocks=1 00:15:29.110 00:15:29.110 ' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:29.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:29.110 --rc genhtml_branch_coverage=1 00:15:29.110 --rc genhtml_function_coverage=1 00:15:29.110 --rc genhtml_legend=1 00:15:29.110 --rc geninfo_all_blocks=1 00:15:29.110 --rc geninfo_unexecuted_blocks=1 00:15:29.110 00:15:29.110 ' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@7 -- # uname -s 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@15 -- # shopt -s extglob 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- paths/export.sh@5 -- # export PATH 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@51 -- # : 0 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:29.110 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=621610 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 621610' 00:15:29.110 Process pid: 621610 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 621610 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@831 -- # '[' -z 621610 ']' 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:29.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:29.110 13:26:24 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:15:29.369 13:26:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:29.369 13:26:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@864 -- # return 0 00:15:29.369 13:26:25 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:15:30.301 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:15:30.301 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.301 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:15:30.559 malloc0 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:15:30.559 13:26:26 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:02.620 Fuzzing completed. Shutting down the fuzz application 00:16:02.620 00:16:02.620 Dumping successful admin opcodes: 00:16:02.620 8, 9, 10, 24, 00:16:02.620 Dumping successful io opcodes: 00:16:02.620 0, 00:16:02.620 NS: 0x200003a1ef00 I/O qp, Total commands completed: 654770, total successful commands: 2544, random_seed: 41302720 00:16:02.620 NS: 0x200003a1ef00 admin qp, Total commands completed: 93687, total successful commands: 759, random_seed: 2886898496 00:16:02.620 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@46 -- # killprocess 621610 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@950 -- # '[' -z 621610 ']' 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@954 -- # kill -0 621610 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@955 -- # uname 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 621610 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@968 -- # echo 'killing process with pid 621610' 00:16:02.621 killing process with pid 621610 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@969 -- # kill 621610 00:16:02.621 13:26:56 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@974 -- # wait 621610 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:02.621 00:16:02.621 real 0m32.423s 00:16:02.621 user 0m30.397s 00:16:02.621 sys 0m29.768s 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@1126 -- # xtrace_disable 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_vfio_user_fuzz -- common/autotest_common.sh@10 -- # set +x 00:16:02.621 ************************************ 00:16:02.621 END TEST nvmf_vfio_user_fuzz 00:16:02.621 ************************************ 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@37 -- # run_test nvmf_auth_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/auth.sh --transport=tcp 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:16:02.621 ************************************ 00:16:02.621 START TEST nvmf_auth_target 00:16:02.621 ************************************ 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/auth.sh --transport=tcp 00:16:02.621 * Looking for test storage... 00:16:02.621 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lcov --version 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # IFS=.-: 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # read -ra ver1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # IFS=.-: 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # read -ra ver2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@338 -- # local 'op=<' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@340 -- # ver1_l=2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@341 -- # ver2_l=1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@344 -- # case "$op" in 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@345 -- # : 1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # decimal 1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # ver1[v]=1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # decimal 2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # ver2[v]=2 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # return 0 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:16:02.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.621 --rc genhtml_branch_coverage=1 00:16:02.621 --rc genhtml_function_coverage=1 00:16:02.621 --rc genhtml_legend=1 00:16:02.621 --rc geninfo_all_blocks=1 00:16:02.621 --rc geninfo_unexecuted_blocks=1 00:16:02.621 00:16:02.621 ' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:16:02.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.621 --rc genhtml_branch_coverage=1 00:16:02.621 --rc genhtml_function_coverage=1 00:16:02.621 --rc genhtml_legend=1 00:16:02.621 --rc geninfo_all_blocks=1 00:16:02.621 --rc geninfo_unexecuted_blocks=1 00:16:02.621 00:16:02.621 ' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:16:02.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.621 --rc genhtml_branch_coverage=1 00:16:02.621 --rc genhtml_function_coverage=1 00:16:02.621 --rc genhtml_legend=1 00:16:02.621 --rc geninfo_all_blocks=1 00:16:02.621 --rc geninfo_unexecuted_blocks=1 00:16:02.621 00:16:02.621 ' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:16:02.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.621 --rc genhtml_branch_coverage=1 00:16:02.621 --rc genhtml_function_coverage=1 00:16:02.621 --rc genhtml_legend=1 00:16:02.621 --rc geninfo_all_blocks=1 00:16:02.621 --rc geninfo_unexecuted_blocks=1 00:16:02.621 00:16:02.621 ' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # uname -s 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@15 -- # shopt -s extglob 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@5 -- # export PATH 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@51 -- # : 0 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:16:02.621 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:16:02.622 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@14 -- # dhgroups=("null" "ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@15 -- # subnqn=nqn.2024-03.io.spdk:cnode0 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@16 -- # hostnqn=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@17 -- # hostsock=/var/tmp/host.sock 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # keys=() 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # ckeys=() 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@86 -- # nvmftestinit 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@309 -- # xtrace_disable 00:16:02.622 13:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@315 -- # pci_devs=() 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@315 -- # local -a pci_devs 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@316 -- # pci_net_devs=() 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@317 -- # pci_drivers=() 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@317 -- # local -A pci_drivers 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@319 -- # net_devs=() 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@319 -- # local -ga net_devs 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@320 -- # e810=() 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@320 -- # local -ga e810 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@321 -- # x722=() 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@321 -- # local -ga x722 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@322 -- # mlx=() 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@322 -- # local -ga mlx 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:16:03.998 Found 0000:84:00.0 (0x8086 - 0x159b) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:16:03.998 Found 0000:84:00.1 (0x8086 - 0x159b) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@416 -- # [[ up == up ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:16:03.998 Found net devices under 0000:84:00.0: cvl_0_0 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@416 -- # [[ up == up ]] 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:16:03.998 Found net devices under 0000:84:00.1: cvl_0_1 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:16:03.998 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@440 -- # is_hw=yes 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:16:03.999 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:03.999 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:16:03.999 00:16:03.999 --- 10.0.0.2 ping statistics --- 00:16:03.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.999 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:03.999 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:03.999 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:16:03.999 00:16:03.999 --- 10.0.0.1 ping statistics --- 00:16:03.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.999 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@448 -- # return 0 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@87 -- # nvmfappstart -L nvmf_auth 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=627204 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvmf_auth 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 627204 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 627204 ']' 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:03.999 13:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@89 -- # hostpid=627248 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 2 -r /var/tmp/host.sock -L nvme_auth 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@91 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key null 48 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=null 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=46fda977f35ceb95c8e65a979eddfaf4a388e4adbfa54a1f 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-null.XXX 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-null.v1z 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 46fda977f35ceb95c8e65a979eddfaf4a388e4adbfa54a1f 0 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 46fda977f35ceb95c8e65a979eddfaf4a388e4adbfa54a1f 0 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=46fda977f35ceb95c8e65a979eddfaf4a388e4adbfa54a1f 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=0 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-null.v1z 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-null.v1z 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # keys[0]=/tmp/spdk.key-null.v1z 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key sha512 64 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=3cef6442150b3a268b521be71aa8f3b49b4f627b9c69f81712c16e45e4611abd 00:16:04.257 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.wqc 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 3cef6442150b3a268b521be71aa8f3b49b4f627b9c69f81712c16e45e4611abd 3 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 3cef6442150b3a268b521be71aa8f3b49b4f627b9c69f81712c16e45e4611abd 3 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=3cef6442150b3a268b521be71aa8f3b49b4f627b9c69f81712c16e45e4611abd 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.wqc 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.wqc 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # ckeys[0]=/tmp/spdk.key-sha512.wqc 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha256 32 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=14e143e356eb6071aaada1606a9cc132 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.J0r 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 14e143e356eb6071aaada1606a9cc132 1 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 14e143e356eb6071aaada1606a9cc132 1 00:16:04.516 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=14e143e356eb6071aaada1606a9cc132 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.J0r 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.J0r 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # keys[1]=/tmp/spdk.key-sha256.J0r 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha384 48 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=693b3928759f8c1c18ec2529c4dc31f9aa2fa51f93f56379 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.Zcn 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 693b3928759f8c1c18ec2529c4dc31f9aa2fa51f93f56379 2 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 693b3928759f8c1c18ec2529c4dc31f9aa2fa51f93f56379 2 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=693b3928759f8c1c18ec2529c4dc31f9aa2fa51f93f56379 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.Zcn 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.Zcn 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # ckeys[1]=/tmp/spdk.key-sha384.Zcn 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha384 48 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=0cda7a2b1684faf5d97976228c7cc890e52d70ad74da539e 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.3AX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 0cda7a2b1684faf5d97976228c7cc890e52d70ad74da539e 2 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 0cda7a2b1684faf5d97976228c7cc890e52d70ad74da539e 2 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=0cda7a2b1684faf5d97976228c7cc890e52d70ad74da539e 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.3AX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.3AX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # keys[2]=/tmp/spdk.key-sha384.3AX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha256 32 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=cb650ff6dd9ce68ce2ab54fd551c3def 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.Hef 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key cb650ff6dd9ce68ce2ab54fd551c3def 1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 cb650ff6dd9ce68ce2ab54fd551c3def 1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=cb650ff6dd9ce68ce2ab54fd551c3def 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.Hef 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.Hef 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # ckeys[2]=/tmp/spdk.key-sha256.Hef 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # gen_dhchap_key sha512 64 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=ccf4f7e6e1e2dbddd99bef8e36ef0a2628cce010ef4050164b040343943727d5 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.aIq 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key ccf4f7e6e1e2dbddd99bef8e36ef0a2628cce010ef4050164b040343943727d5 3 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 ccf4f7e6e1e2dbddd99bef8e36ef0a2628cce010ef4050164b040343943727d5 3 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=ccf4f7e6e1e2dbddd99bef8e36ef0a2628cce010ef4050164b040343943727d5 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:16:04.517 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.aIq 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.aIq 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # keys[3]=/tmp/spdk.key-sha512.aIq 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # ckeys[3]= 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@99 -- # waitforlisten 627204 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 627204 ']' 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:04.775 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:04.775 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@100 -- # waitforlisten 627248 /var/tmp/host.sock 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 627248 ']' 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/host.sock 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock...' 00:16:05.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock... 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:05.033 13:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@101 -- # rpc_cmd 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.v1z 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key0 /tmp/spdk.key-null.v1z 00:16:05.290 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key0 /tmp/spdk.key-null.v1z 00:16:05.549 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha512.wqc ]] 00:16:05.549 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.wqc 00:16:05.549 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.549 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.549 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.549 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey0 /tmp/spdk.key-sha512.wqc 00:16:05.549 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey0 /tmp/spdk.key-sha512.wqc 00:16:05.848 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:05.848 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.J0r 00:16:05.848 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.848 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.848 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.848 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key1 /tmp/spdk.key-sha256.J0r 00:16:05.848 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key1 /tmp/spdk.key-sha256.J0r 00:16:06.134 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha384.Zcn ]] 00:16:06.134 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.Zcn 00:16:06.134 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.134 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.134 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.134 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey1 /tmp/spdk.key-sha384.Zcn 00:16:06.134 13:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey1 /tmp/spdk.key-sha384.Zcn 00:16:06.392 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:06.392 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.3AX 00:16:06.392 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.392 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.392 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.392 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key2 /tmp/spdk.key-sha384.3AX 00:16:06.392 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key2 /tmp/spdk.key-sha384.3AX 00:16:06.649 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha256.Hef ]] 00:16:06.649 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.Hef 00:16:06.649 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.649 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.649 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.649 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey2 /tmp/spdk.key-sha256.Hef 00:16:06.650 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey2 /tmp/spdk.key-sha256.Hef 00:16:06.907 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:06.907 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.aIq 00:16:06.907 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.907 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.907 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.907 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key3 /tmp/spdk.key-sha512.aIq 00:16:06.907 13:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key3 /tmp/spdk.key-sha512.aIq 00:16:07.471 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n '' ]] 00:16:07.471 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:16:07.471 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:07.471 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:07.471 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 0 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:07.472 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:08.036 00:16:08.037 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:08.037 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:08.037 13:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:08.294 { 00:16:08.294 "cntlid": 1, 00:16:08.294 "qid": 0, 00:16:08.294 "state": "enabled", 00:16:08.294 "thread": "nvmf_tgt_poll_group_000", 00:16:08.294 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:08.294 "listen_address": { 00:16:08.294 "trtype": "TCP", 00:16:08.294 "adrfam": "IPv4", 00:16:08.294 "traddr": "10.0.0.2", 00:16:08.294 "trsvcid": "4420" 00:16:08.294 }, 00:16:08.294 "peer_address": { 00:16:08.294 "trtype": "TCP", 00:16:08.294 "adrfam": "IPv4", 00:16:08.294 "traddr": "10.0.0.1", 00:16:08.294 "trsvcid": "55940" 00:16:08.294 }, 00:16:08.294 "auth": { 00:16:08.294 "state": "completed", 00:16:08.294 "digest": "sha256", 00:16:08.294 "dhgroup": "null" 00:16:08.294 } 00:16:08.294 } 00:16:08.294 ]' 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:08.294 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:08.551 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:08.551 13:27:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:09.483 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:09.483 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:09.739 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 1 00:16:09.739 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:09.739 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:09.739 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:09.739 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:09.740 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:10.303 00:16:10.303 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:10.303 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:10.304 13:27:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:10.304 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:10.304 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:10.304 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:10.304 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:10.561 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:10.561 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:10.561 { 00:16:10.561 "cntlid": 3, 00:16:10.561 "qid": 0, 00:16:10.561 "state": "enabled", 00:16:10.561 "thread": "nvmf_tgt_poll_group_000", 00:16:10.561 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:10.561 "listen_address": { 00:16:10.561 "trtype": "TCP", 00:16:10.561 "adrfam": "IPv4", 00:16:10.561 "traddr": "10.0.0.2", 00:16:10.561 "trsvcid": "4420" 00:16:10.561 }, 00:16:10.561 "peer_address": { 00:16:10.561 "trtype": "TCP", 00:16:10.561 "adrfam": "IPv4", 00:16:10.561 "traddr": "10.0.0.1", 00:16:10.561 "trsvcid": "55970" 00:16:10.561 }, 00:16:10.561 "auth": { 00:16:10.561 "state": "completed", 00:16:10.561 "digest": "sha256", 00:16:10.561 "dhgroup": "null" 00:16:10.561 } 00:16:10.561 } 00:16:10.561 ]' 00:16:10.561 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:10.561 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:10.561 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:10.562 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:10.562 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:10.562 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:10.562 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:10.562 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:10.819 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:10.819 13:27:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:11.753 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:11.753 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 2 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:12.010 13:27:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:12.268 00:16:12.268 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:12.268 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:12.268 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:12.525 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:12.525 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:12.525 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:12.525 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:12.525 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:12.525 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:12.525 { 00:16:12.525 "cntlid": 5, 00:16:12.525 "qid": 0, 00:16:12.525 "state": "enabled", 00:16:12.525 "thread": "nvmf_tgt_poll_group_000", 00:16:12.525 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:12.525 "listen_address": { 00:16:12.525 "trtype": "TCP", 00:16:12.525 "adrfam": "IPv4", 00:16:12.525 "traddr": "10.0.0.2", 00:16:12.525 "trsvcid": "4420" 00:16:12.525 }, 00:16:12.525 "peer_address": { 00:16:12.525 "trtype": "TCP", 00:16:12.525 "adrfam": "IPv4", 00:16:12.525 "traddr": "10.0.0.1", 00:16:12.525 "trsvcid": "55992" 00:16:12.525 }, 00:16:12.525 "auth": { 00:16:12.525 "state": "completed", 00:16:12.525 "digest": "sha256", 00:16:12.525 "dhgroup": "null" 00:16:12.525 } 00:16:12.525 } 00:16:12.525 ]' 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:12.782 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:13.040 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:13.040 13:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:13.971 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:13.971 13:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:14.228 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 3 00:16:14.228 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:14.228 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:14.228 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:14.228 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:14.228 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:14.229 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:16:14.229 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.229 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:14.229 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.229 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:14.229 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:14.229 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:14.486 00:16:14.486 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:14.486 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:14.486 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:15.051 { 00:16:15.051 "cntlid": 7, 00:16:15.051 "qid": 0, 00:16:15.051 "state": "enabled", 00:16:15.051 "thread": "nvmf_tgt_poll_group_000", 00:16:15.051 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:15.051 "listen_address": { 00:16:15.051 "trtype": "TCP", 00:16:15.051 "adrfam": "IPv4", 00:16:15.051 "traddr": "10.0.0.2", 00:16:15.051 "trsvcid": "4420" 00:16:15.051 }, 00:16:15.051 "peer_address": { 00:16:15.051 "trtype": "TCP", 00:16:15.051 "adrfam": "IPv4", 00:16:15.051 "traddr": "10.0.0.1", 00:16:15.051 "trsvcid": "56008" 00:16:15.051 }, 00:16:15.051 "auth": { 00:16:15.051 "state": "completed", 00:16:15.051 "digest": "sha256", 00:16:15.051 "dhgroup": "null" 00:16:15.051 } 00:16:15.051 } 00:16:15.051 ]' 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:15.051 13:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:15.308 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:15.308 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:16.240 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:16.240 13:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 0 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:16.498 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:16.756 00:16:16.756 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:16.756 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:16.756 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:17.013 { 00:16:17.013 "cntlid": 9, 00:16:17.013 "qid": 0, 00:16:17.013 "state": "enabled", 00:16:17.013 "thread": "nvmf_tgt_poll_group_000", 00:16:17.013 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:17.013 "listen_address": { 00:16:17.013 "trtype": "TCP", 00:16:17.013 "adrfam": "IPv4", 00:16:17.013 "traddr": "10.0.0.2", 00:16:17.013 "trsvcid": "4420" 00:16:17.013 }, 00:16:17.013 "peer_address": { 00:16:17.013 "trtype": "TCP", 00:16:17.013 "adrfam": "IPv4", 00:16:17.013 "traddr": "10.0.0.1", 00:16:17.013 "trsvcid": "56036" 00:16:17.013 }, 00:16:17.013 "auth": { 00:16:17.013 "state": "completed", 00:16:17.013 "digest": "sha256", 00:16:17.013 "dhgroup": "ffdhe2048" 00:16:17.013 } 00:16:17.013 } 00:16:17.013 ]' 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:17.013 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:17.270 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:17.270 13:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:17.270 13:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:17.270 13:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:17.270 13:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:17.527 13:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:17.527 13:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:18.460 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:18.460 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 1 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:18.717 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:18.974 00:16:18.974 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:18.974 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:18.974 13:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:19.252 { 00:16:19.252 "cntlid": 11, 00:16:19.252 "qid": 0, 00:16:19.252 "state": "enabled", 00:16:19.252 "thread": "nvmf_tgt_poll_group_000", 00:16:19.252 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:19.252 "listen_address": { 00:16:19.252 "trtype": "TCP", 00:16:19.252 "adrfam": "IPv4", 00:16:19.252 "traddr": "10.0.0.2", 00:16:19.252 "trsvcid": "4420" 00:16:19.252 }, 00:16:19.252 "peer_address": { 00:16:19.252 "trtype": "TCP", 00:16:19.252 "adrfam": "IPv4", 00:16:19.252 "traddr": "10.0.0.1", 00:16:19.252 "trsvcid": "39136" 00:16:19.252 }, 00:16:19.252 "auth": { 00:16:19.252 "state": "completed", 00:16:19.252 "digest": "sha256", 00:16:19.252 "dhgroup": "ffdhe2048" 00:16:19.252 } 00:16:19.252 } 00:16:19.252 ]' 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:19.252 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:19.509 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:19.509 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:19.509 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:19.509 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:19.509 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:19.766 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:19.766 13:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:20.698 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:20.698 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 2 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:20.956 13:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:21.213 00:16:21.213 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:21.213 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:21.213 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:21.471 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:21.471 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:21.471 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.471 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:21.471 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.471 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:21.471 { 00:16:21.471 "cntlid": 13, 00:16:21.471 "qid": 0, 00:16:21.471 "state": "enabled", 00:16:21.471 "thread": "nvmf_tgt_poll_group_000", 00:16:21.471 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:21.471 "listen_address": { 00:16:21.471 "trtype": "TCP", 00:16:21.471 "adrfam": "IPv4", 00:16:21.471 "traddr": "10.0.0.2", 00:16:21.471 "trsvcid": "4420" 00:16:21.471 }, 00:16:21.471 "peer_address": { 00:16:21.471 "trtype": "TCP", 00:16:21.471 "adrfam": "IPv4", 00:16:21.471 "traddr": "10.0.0.1", 00:16:21.471 "trsvcid": "39154" 00:16:21.471 }, 00:16:21.471 "auth": { 00:16:21.471 "state": "completed", 00:16:21.471 "digest": "sha256", 00:16:21.471 "dhgroup": "ffdhe2048" 00:16:21.471 } 00:16:21.471 } 00:16:21.471 ]' 00:16:21.471 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:21.729 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:21.729 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:21.729 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:21.729 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:21.729 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:21.729 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:21.729 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:21.986 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:21.986 13:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:22.919 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:22.919 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 3 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:23.176 13:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:23.434 00:16:23.434 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:23.434 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:23.434 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:23.691 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:23.691 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:23.691 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.691 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:23.691 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.691 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:23.691 { 00:16:23.691 "cntlid": 15, 00:16:23.691 "qid": 0, 00:16:23.691 "state": "enabled", 00:16:23.691 "thread": "nvmf_tgt_poll_group_000", 00:16:23.691 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:23.691 "listen_address": { 00:16:23.691 "trtype": "TCP", 00:16:23.691 "adrfam": "IPv4", 00:16:23.691 "traddr": "10.0.0.2", 00:16:23.691 "trsvcid": "4420" 00:16:23.691 }, 00:16:23.691 "peer_address": { 00:16:23.691 "trtype": "TCP", 00:16:23.691 "adrfam": "IPv4", 00:16:23.691 "traddr": "10.0.0.1", 00:16:23.691 "trsvcid": "39170" 00:16:23.691 }, 00:16:23.691 "auth": { 00:16:23.691 "state": "completed", 00:16:23.691 "digest": "sha256", 00:16:23.691 "dhgroup": "ffdhe2048" 00:16:23.691 } 00:16:23.691 } 00:16:23.691 ]' 00:16:23.691 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:23.947 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:23.947 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:23.947 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:23.947 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:23.947 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:23.947 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:23.947 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:24.204 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:24.204 13:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:25.135 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:25.135 13:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 0 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:25.392 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:25.649 00:16:25.649 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:25.649 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:25.649 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:25.907 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:25.907 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:25.907 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:25.907 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:25.907 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:25.907 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:25.907 { 00:16:25.907 "cntlid": 17, 00:16:25.907 "qid": 0, 00:16:25.907 "state": "enabled", 00:16:25.907 "thread": "nvmf_tgt_poll_group_000", 00:16:25.907 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:25.907 "listen_address": { 00:16:25.907 "trtype": "TCP", 00:16:25.907 "adrfam": "IPv4", 00:16:25.907 "traddr": "10.0.0.2", 00:16:25.907 "trsvcid": "4420" 00:16:25.907 }, 00:16:25.907 "peer_address": { 00:16:25.907 "trtype": "TCP", 00:16:25.907 "adrfam": "IPv4", 00:16:25.907 "traddr": "10.0.0.1", 00:16:25.907 "trsvcid": "39186" 00:16:25.907 }, 00:16:25.907 "auth": { 00:16:25.907 "state": "completed", 00:16:25.907 "digest": "sha256", 00:16:25.907 "dhgroup": "ffdhe3072" 00:16:25.907 } 00:16:25.907 } 00:16:25.907 ]' 00:16:25.907 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:26.164 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:26.164 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:26.164 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:26.164 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:26.164 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:26.164 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:26.164 13:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:26.421 13:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:26.421 13:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:27.353 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:27.353 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 1 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:27.611 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:27.869 00:16:27.869 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:27.869 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:27.869 13:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:28.126 { 00:16:28.126 "cntlid": 19, 00:16:28.126 "qid": 0, 00:16:28.126 "state": "enabled", 00:16:28.126 "thread": "nvmf_tgt_poll_group_000", 00:16:28.126 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:28.126 "listen_address": { 00:16:28.126 "trtype": "TCP", 00:16:28.126 "adrfam": "IPv4", 00:16:28.126 "traddr": "10.0.0.2", 00:16:28.126 "trsvcid": "4420" 00:16:28.126 }, 00:16:28.126 "peer_address": { 00:16:28.126 "trtype": "TCP", 00:16:28.126 "adrfam": "IPv4", 00:16:28.126 "traddr": "10.0.0.1", 00:16:28.126 "trsvcid": "46816" 00:16:28.126 }, 00:16:28.126 "auth": { 00:16:28.126 "state": "completed", 00:16:28.126 "digest": "sha256", 00:16:28.126 "dhgroup": "ffdhe3072" 00:16:28.126 } 00:16:28.126 } 00:16:28.126 ]' 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:28.126 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:28.383 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:28.383 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:28.383 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:28.384 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:28.384 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:28.384 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:28.641 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:28.641 13:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:29.574 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:29.574 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:29.831 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 2 00:16:29.831 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:29.831 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:29.832 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:30.089 00:16:30.089 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:30.089 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:30.089 13:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:30.347 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:30.347 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:30.347 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.347 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:30.347 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.347 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:30.347 { 00:16:30.347 "cntlid": 21, 00:16:30.347 "qid": 0, 00:16:30.347 "state": "enabled", 00:16:30.347 "thread": "nvmf_tgt_poll_group_000", 00:16:30.347 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:30.347 "listen_address": { 00:16:30.347 "trtype": "TCP", 00:16:30.347 "adrfam": "IPv4", 00:16:30.347 "traddr": "10.0.0.2", 00:16:30.347 "trsvcid": "4420" 00:16:30.347 }, 00:16:30.347 "peer_address": { 00:16:30.347 "trtype": "TCP", 00:16:30.347 "adrfam": "IPv4", 00:16:30.347 "traddr": "10.0.0.1", 00:16:30.347 "trsvcid": "46842" 00:16:30.347 }, 00:16:30.347 "auth": { 00:16:30.347 "state": "completed", 00:16:30.347 "digest": "sha256", 00:16:30.347 "dhgroup": "ffdhe3072" 00:16:30.347 } 00:16:30.347 } 00:16:30.347 ]' 00:16:30.347 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:30.605 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:30.605 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:30.605 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:30.605 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:30.605 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:30.605 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:30.605 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:30.862 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:30.862 13:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:31.794 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:31.794 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 3 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:32.051 13:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:32.308 00:16:32.308 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:32.308 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:32.308 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:32.572 { 00:16:32.572 "cntlid": 23, 00:16:32.572 "qid": 0, 00:16:32.572 "state": "enabled", 00:16:32.572 "thread": "nvmf_tgt_poll_group_000", 00:16:32.572 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:32.572 "listen_address": { 00:16:32.572 "trtype": "TCP", 00:16:32.572 "adrfam": "IPv4", 00:16:32.572 "traddr": "10.0.0.2", 00:16:32.572 "trsvcid": "4420" 00:16:32.572 }, 00:16:32.572 "peer_address": { 00:16:32.572 "trtype": "TCP", 00:16:32.572 "adrfam": "IPv4", 00:16:32.572 "traddr": "10.0.0.1", 00:16:32.572 "trsvcid": "46864" 00:16:32.572 }, 00:16:32.572 "auth": { 00:16:32.572 "state": "completed", 00:16:32.572 "digest": "sha256", 00:16:32.572 "dhgroup": "ffdhe3072" 00:16:32.572 } 00:16:32.572 } 00:16:32.572 ]' 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:32.572 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:32.834 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:32.834 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:32.834 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:32.834 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:32.834 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:33.098 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:33.099 13:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:34.092 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:34.092 13:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 0 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:34.348 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:34.605 00:16:34.605 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:34.605 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:34.605 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:34.863 { 00:16:34.863 "cntlid": 25, 00:16:34.863 "qid": 0, 00:16:34.863 "state": "enabled", 00:16:34.863 "thread": "nvmf_tgt_poll_group_000", 00:16:34.863 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:34.863 "listen_address": { 00:16:34.863 "trtype": "TCP", 00:16:34.863 "adrfam": "IPv4", 00:16:34.863 "traddr": "10.0.0.2", 00:16:34.863 "trsvcid": "4420" 00:16:34.863 }, 00:16:34.863 "peer_address": { 00:16:34.863 "trtype": "TCP", 00:16:34.863 "adrfam": "IPv4", 00:16:34.863 "traddr": "10.0.0.1", 00:16:34.863 "trsvcid": "46884" 00:16:34.863 }, 00:16:34.863 "auth": { 00:16:34.863 "state": "completed", 00:16:34.863 "digest": "sha256", 00:16:34.863 "dhgroup": "ffdhe4096" 00:16:34.863 } 00:16:34.863 } 00:16:34.863 ]' 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:34.863 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:35.120 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:35.120 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:35.120 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:35.120 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:35.120 13:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:35.397 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:35.397 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:36.328 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:36.328 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:36.328 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:36.328 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:36.329 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:36.329 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:36.329 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:36.329 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:36.329 13:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 1 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:36.587 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:36.844 00:16:36.844 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:36.844 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:36.844 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:37.102 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:37.102 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:37.102 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.102 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:37.102 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.102 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:37.102 { 00:16:37.102 "cntlid": 27, 00:16:37.102 "qid": 0, 00:16:37.102 "state": "enabled", 00:16:37.102 "thread": "nvmf_tgt_poll_group_000", 00:16:37.102 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:37.102 "listen_address": { 00:16:37.102 "trtype": "TCP", 00:16:37.102 "adrfam": "IPv4", 00:16:37.102 "traddr": "10.0.0.2", 00:16:37.102 "trsvcid": "4420" 00:16:37.102 }, 00:16:37.102 "peer_address": { 00:16:37.102 "trtype": "TCP", 00:16:37.102 "adrfam": "IPv4", 00:16:37.102 "traddr": "10.0.0.1", 00:16:37.102 "trsvcid": "46908" 00:16:37.102 }, 00:16:37.102 "auth": { 00:16:37.102 "state": "completed", 00:16:37.102 "digest": "sha256", 00:16:37.102 "dhgroup": "ffdhe4096" 00:16:37.102 } 00:16:37.102 } 00:16:37.102 ]' 00:16:37.102 13:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:37.102 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:37.102 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:37.359 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:37.359 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:37.359 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:37.359 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:37.359 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:37.616 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:37.616 13:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:38.548 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:38.548 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 2 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:38.806 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:39.063 00:16:39.063 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:39.063 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:39.063 13:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:39.321 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:39.321 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:39.321 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.321 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:39.321 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.321 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:39.321 { 00:16:39.321 "cntlid": 29, 00:16:39.321 "qid": 0, 00:16:39.321 "state": "enabled", 00:16:39.321 "thread": "nvmf_tgt_poll_group_000", 00:16:39.321 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:39.321 "listen_address": { 00:16:39.321 "trtype": "TCP", 00:16:39.321 "adrfam": "IPv4", 00:16:39.321 "traddr": "10.0.0.2", 00:16:39.321 "trsvcid": "4420" 00:16:39.321 }, 00:16:39.321 "peer_address": { 00:16:39.321 "trtype": "TCP", 00:16:39.321 "adrfam": "IPv4", 00:16:39.321 "traddr": "10.0.0.1", 00:16:39.321 "trsvcid": "39024" 00:16:39.321 }, 00:16:39.321 "auth": { 00:16:39.321 "state": "completed", 00:16:39.321 "digest": "sha256", 00:16:39.321 "dhgroup": "ffdhe4096" 00:16:39.321 } 00:16:39.321 } 00:16:39.321 ]' 00:16:39.321 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:39.578 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:39.578 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:39.578 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:39.578 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:39.578 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:39.578 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:39.578 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:39.835 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:39.835 13:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:40.767 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:40.767 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 3 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:41.025 13:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:41.282 00:16:41.282 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:41.282 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:41.282 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:41.539 { 00:16:41.539 "cntlid": 31, 00:16:41.539 "qid": 0, 00:16:41.539 "state": "enabled", 00:16:41.539 "thread": "nvmf_tgt_poll_group_000", 00:16:41.539 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:41.539 "listen_address": { 00:16:41.539 "trtype": "TCP", 00:16:41.539 "adrfam": "IPv4", 00:16:41.539 "traddr": "10.0.0.2", 00:16:41.539 "trsvcid": "4420" 00:16:41.539 }, 00:16:41.539 "peer_address": { 00:16:41.539 "trtype": "TCP", 00:16:41.539 "adrfam": "IPv4", 00:16:41.539 "traddr": "10.0.0.1", 00:16:41.539 "trsvcid": "39052" 00:16:41.539 }, 00:16:41.539 "auth": { 00:16:41.539 "state": "completed", 00:16:41.539 "digest": "sha256", 00:16:41.539 "dhgroup": "ffdhe4096" 00:16:41.539 } 00:16:41.539 } 00:16:41.539 ]' 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:41.539 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:41.797 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:41.797 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:41.797 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:41.797 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:41.797 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:42.054 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:42.054 13:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:42.997 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:42.997 13:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 0 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:43.254 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:43.819 00:16:43.819 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:43.819 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:43.819 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:44.076 { 00:16:44.076 "cntlid": 33, 00:16:44.076 "qid": 0, 00:16:44.076 "state": "enabled", 00:16:44.076 "thread": "nvmf_tgt_poll_group_000", 00:16:44.076 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:44.076 "listen_address": { 00:16:44.076 "trtype": "TCP", 00:16:44.076 "adrfam": "IPv4", 00:16:44.076 "traddr": "10.0.0.2", 00:16:44.076 "trsvcid": "4420" 00:16:44.076 }, 00:16:44.076 "peer_address": { 00:16:44.076 "trtype": "TCP", 00:16:44.076 "adrfam": "IPv4", 00:16:44.076 "traddr": "10.0.0.1", 00:16:44.076 "trsvcid": "39084" 00:16:44.076 }, 00:16:44.076 "auth": { 00:16:44.076 "state": "completed", 00:16:44.076 "digest": "sha256", 00:16:44.076 "dhgroup": "ffdhe6144" 00:16:44.076 } 00:16:44.076 } 00:16:44.076 ]' 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:44.076 13:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:44.334 13:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:44.334 13:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:45.265 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:45.265 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 1 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:45.522 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:45.779 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:45.779 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:45.779 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:45.779 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:46.343 00:16:46.343 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:46.343 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:46.343 13:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:46.343 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:46.343 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:46.343 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:46.343 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:46.343 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:46.343 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:46.343 { 00:16:46.343 "cntlid": 35, 00:16:46.343 "qid": 0, 00:16:46.343 "state": "enabled", 00:16:46.343 "thread": "nvmf_tgt_poll_group_000", 00:16:46.343 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:46.343 "listen_address": { 00:16:46.343 "trtype": "TCP", 00:16:46.343 "adrfam": "IPv4", 00:16:46.343 "traddr": "10.0.0.2", 00:16:46.343 "trsvcid": "4420" 00:16:46.343 }, 00:16:46.343 "peer_address": { 00:16:46.343 "trtype": "TCP", 00:16:46.343 "adrfam": "IPv4", 00:16:46.343 "traddr": "10.0.0.1", 00:16:46.343 "trsvcid": "39114" 00:16:46.343 }, 00:16:46.343 "auth": { 00:16:46.343 "state": "completed", 00:16:46.343 "digest": "sha256", 00:16:46.343 "dhgroup": "ffdhe6144" 00:16:46.343 } 00:16:46.343 } 00:16:46.343 ]' 00:16:46.343 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:46.601 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:46.601 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:46.601 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:46.601 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:46.601 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:46.601 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:46.601 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:46.858 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:46.858 13:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:47.790 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:47.790 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 2 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:48.047 13:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:48.612 00:16:48.612 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:48.612 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:48.612 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:48.870 { 00:16:48.870 "cntlid": 37, 00:16:48.870 "qid": 0, 00:16:48.870 "state": "enabled", 00:16:48.870 "thread": "nvmf_tgt_poll_group_000", 00:16:48.870 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:48.870 "listen_address": { 00:16:48.870 "trtype": "TCP", 00:16:48.870 "adrfam": "IPv4", 00:16:48.870 "traddr": "10.0.0.2", 00:16:48.870 "trsvcid": "4420" 00:16:48.870 }, 00:16:48.870 "peer_address": { 00:16:48.870 "trtype": "TCP", 00:16:48.870 "adrfam": "IPv4", 00:16:48.870 "traddr": "10.0.0.1", 00:16:48.870 "trsvcid": "45938" 00:16:48.870 }, 00:16:48.870 "auth": { 00:16:48.870 "state": "completed", 00:16:48.870 "digest": "sha256", 00:16:48.870 "dhgroup": "ffdhe6144" 00:16:48.870 } 00:16:48.870 } 00:16:48.870 ]' 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:48.870 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:49.127 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:49.127 13:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:50.059 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:50.059 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:50.059 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:50.059 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.059 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:50.059 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.059 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:50.059 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:50.060 13:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 3 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:50.317 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:50.318 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:50.882 00:16:50.882 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:50.882 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:50.882 13:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:51.141 { 00:16:51.141 "cntlid": 39, 00:16:51.141 "qid": 0, 00:16:51.141 "state": "enabled", 00:16:51.141 "thread": "nvmf_tgt_poll_group_000", 00:16:51.141 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:51.141 "listen_address": { 00:16:51.141 "trtype": "TCP", 00:16:51.141 "adrfam": "IPv4", 00:16:51.141 "traddr": "10.0.0.2", 00:16:51.141 "trsvcid": "4420" 00:16:51.141 }, 00:16:51.141 "peer_address": { 00:16:51.141 "trtype": "TCP", 00:16:51.141 "adrfam": "IPv4", 00:16:51.141 "traddr": "10.0.0.1", 00:16:51.141 "trsvcid": "45964" 00:16:51.141 }, 00:16:51.141 "auth": { 00:16:51.141 "state": "completed", 00:16:51.141 "digest": "sha256", 00:16:51.141 "dhgroup": "ffdhe6144" 00:16:51.141 } 00:16:51.141 } 00:16:51.141 ]' 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:51.141 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:51.399 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:51.399 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:51.399 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:51.399 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:51.399 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:51.656 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:51.656 13:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:52.594 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:52.594 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 0 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:52.852 13:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:53.783 00:16:53.783 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:53.783 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:53.783 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:53.783 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:53.784 { 00:16:53.784 "cntlid": 41, 00:16:53.784 "qid": 0, 00:16:53.784 "state": "enabled", 00:16:53.784 "thread": "nvmf_tgt_poll_group_000", 00:16:53.784 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:53.784 "listen_address": { 00:16:53.784 "trtype": "TCP", 00:16:53.784 "adrfam": "IPv4", 00:16:53.784 "traddr": "10.0.0.2", 00:16:53.784 "trsvcid": "4420" 00:16:53.784 }, 00:16:53.784 "peer_address": { 00:16:53.784 "trtype": "TCP", 00:16:53.784 "adrfam": "IPv4", 00:16:53.784 "traddr": "10.0.0.1", 00:16:53.784 "trsvcid": "45980" 00:16:53.784 }, 00:16:53.784 "auth": { 00:16:53.784 "state": "completed", 00:16:53.784 "digest": "sha256", 00:16:53.784 "dhgroup": "ffdhe8192" 00:16:53.784 } 00:16:53.784 } 00:16:53.784 ]' 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:53.784 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:54.041 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:16:54.041 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:54.041 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:54.041 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:54.041 13:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:54.299 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:54.299 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:55.231 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:55.231 13:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 1 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:55.488 13:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:56.421 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:56.421 { 00:16:56.421 "cntlid": 43, 00:16:56.421 "qid": 0, 00:16:56.421 "state": "enabled", 00:16:56.421 "thread": "nvmf_tgt_poll_group_000", 00:16:56.421 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:56.421 "listen_address": { 00:16:56.421 "trtype": "TCP", 00:16:56.421 "adrfam": "IPv4", 00:16:56.421 "traddr": "10.0.0.2", 00:16:56.421 "trsvcid": "4420" 00:16:56.421 }, 00:16:56.421 "peer_address": { 00:16:56.421 "trtype": "TCP", 00:16:56.421 "adrfam": "IPv4", 00:16:56.421 "traddr": "10.0.0.1", 00:16:56.421 "trsvcid": "46006" 00:16:56.421 }, 00:16:56.421 "auth": { 00:16:56.421 "state": "completed", 00:16:56.421 "digest": "sha256", 00:16:56.421 "dhgroup": "ffdhe8192" 00:16:56.421 } 00:16:56.421 } 00:16:56.421 ]' 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:56.421 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:56.678 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:16:56.678 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:56.678 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:56.678 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:56.678 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:56.936 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:56.936 13:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:57.869 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:57.869 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 2 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:58.127 13:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:59.059 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:59.059 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:59.059 { 00:16:59.059 "cntlid": 45, 00:16:59.059 "qid": 0, 00:16:59.059 "state": "enabled", 00:16:59.059 "thread": "nvmf_tgt_poll_group_000", 00:16:59.059 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:16:59.059 "listen_address": { 00:16:59.060 "trtype": "TCP", 00:16:59.060 "adrfam": "IPv4", 00:16:59.060 "traddr": "10.0.0.2", 00:16:59.060 "trsvcid": "4420" 00:16:59.060 }, 00:16:59.060 "peer_address": { 00:16:59.060 "trtype": "TCP", 00:16:59.060 "adrfam": "IPv4", 00:16:59.060 "traddr": "10.0.0.1", 00:16:59.060 "trsvcid": "41900" 00:16:59.060 }, 00:16:59.060 "auth": { 00:16:59.060 "state": "completed", 00:16:59.060 "digest": "sha256", 00:16:59.060 "dhgroup": "ffdhe8192" 00:16:59.060 } 00:16:59.060 } 00:16:59.060 ]' 00:16:59.060 13:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:59.317 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:59.317 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:59.317 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:16:59.317 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:59.317 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:59.317 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:59.317 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:59.575 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:16:59.575 13:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:00.508 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:17:00.508 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 3 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:00.765 13:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:01.697 00:17:01.698 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:01.698 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:01.698 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:01.955 { 00:17:01.955 "cntlid": 47, 00:17:01.955 "qid": 0, 00:17:01.955 "state": "enabled", 00:17:01.955 "thread": "nvmf_tgt_poll_group_000", 00:17:01.955 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:01.955 "listen_address": { 00:17:01.955 "trtype": "TCP", 00:17:01.955 "adrfam": "IPv4", 00:17:01.955 "traddr": "10.0.0.2", 00:17:01.955 "trsvcid": "4420" 00:17:01.955 }, 00:17:01.955 "peer_address": { 00:17:01.955 "trtype": "TCP", 00:17:01.955 "adrfam": "IPv4", 00:17:01.955 "traddr": "10.0.0.1", 00:17:01.955 "trsvcid": "41928" 00:17:01.955 }, 00:17:01.955 "auth": { 00:17:01.955 "state": "completed", 00:17:01.955 "digest": "sha256", 00:17:01.955 "dhgroup": "ffdhe8192" 00:17:01.955 } 00:17:01.955 } 00:17:01.955 ]' 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:01.955 13:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:02.213 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:02.213 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:03.145 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:03.145 13:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 0 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:03.403 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:03.967 00:17:03.967 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:03.967 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:03.967 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:04.247 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:04.247 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:04.247 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.247 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:04.247 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.247 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:04.247 { 00:17:04.247 "cntlid": 49, 00:17:04.247 "qid": 0, 00:17:04.247 "state": "enabled", 00:17:04.247 "thread": "nvmf_tgt_poll_group_000", 00:17:04.247 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:04.247 "listen_address": { 00:17:04.247 "trtype": "TCP", 00:17:04.247 "adrfam": "IPv4", 00:17:04.247 "traddr": "10.0.0.2", 00:17:04.247 "trsvcid": "4420" 00:17:04.247 }, 00:17:04.247 "peer_address": { 00:17:04.247 "trtype": "TCP", 00:17:04.247 "adrfam": "IPv4", 00:17:04.247 "traddr": "10.0.0.1", 00:17:04.247 "trsvcid": "41970" 00:17:04.247 }, 00:17:04.247 "auth": { 00:17:04.247 "state": "completed", 00:17:04.247 "digest": "sha384", 00:17:04.247 "dhgroup": "null" 00:17:04.247 } 00:17:04.247 } 00:17:04.247 ]' 00:17:04.247 13:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:04.247 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:04.247 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:04.247 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:04.247 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:04.247 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:04.247 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:04.247 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:04.562 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:04.562 13:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:05.517 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:05.517 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 1 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:05.775 13:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:06.343 00:17:06.343 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:06.343 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:06.343 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:06.343 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:06.343 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:06.343 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.343 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:06.602 { 00:17:06.602 "cntlid": 51, 00:17:06.602 "qid": 0, 00:17:06.602 "state": "enabled", 00:17:06.602 "thread": "nvmf_tgt_poll_group_000", 00:17:06.602 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:06.602 "listen_address": { 00:17:06.602 "trtype": "TCP", 00:17:06.602 "adrfam": "IPv4", 00:17:06.602 "traddr": "10.0.0.2", 00:17:06.602 "trsvcid": "4420" 00:17:06.602 }, 00:17:06.602 "peer_address": { 00:17:06.602 "trtype": "TCP", 00:17:06.602 "adrfam": "IPv4", 00:17:06.602 "traddr": "10.0.0.1", 00:17:06.602 "trsvcid": "41992" 00:17:06.602 }, 00:17:06.602 "auth": { 00:17:06.602 "state": "completed", 00:17:06.602 "digest": "sha384", 00:17:06.602 "dhgroup": "null" 00:17:06.602 } 00:17:06.602 } 00:17:06.602 ]' 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:06.602 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:06.859 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:06.859 13:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:07.791 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:07.791 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:07.791 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:07.791 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.791 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:07.791 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.791 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:07.792 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:07.792 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 2 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.049 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:08.050 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:08.050 13:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:08.307 00:17:08.307 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:08.307 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:08.307 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:08.564 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:08.564 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:08.564 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.564 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:08.564 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.564 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:08.564 { 00:17:08.564 "cntlid": 53, 00:17:08.564 "qid": 0, 00:17:08.564 "state": "enabled", 00:17:08.564 "thread": "nvmf_tgt_poll_group_000", 00:17:08.565 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:08.565 "listen_address": { 00:17:08.565 "trtype": "TCP", 00:17:08.565 "adrfam": "IPv4", 00:17:08.565 "traddr": "10.0.0.2", 00:17:08.565 "trsvcid": "4420" 00:17:08.565 }, 00:17:08.565 "peer_address": { 00:17:08.565 "trtype": "TCP", 00:17:08.565 "adrfam": "IPv4", 00:17:08.565 "traddr": "10.0.0.1", 00:17:08.565 "trsvcid": "35760" 00:17:08.565 }, 00:17:08.565 "auth": { 00:17:08.565 "state": "completed", 00:17:08.565 "digest": "sha384", 00:17:08.565 "dhgroup": "null" 00:17:08.565 } 00:17:08.565 } 00:17:08.565 ]' 00:17:08.565 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:08.822 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:08.822 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:08.822 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:08.823 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:08.823 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:08.823 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:08.823 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:09.081 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:09.081 13:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:10.013 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:10.013 13:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 3 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:10.271 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:10.836 00:17:10.836 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:10.836 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:10.836 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:10.836 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:10.836 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:10.836 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.836 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:11.093 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.093 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:11.093 { 00:17:11.093 "cntlid": 55, 00:17:11.093 "qid": 0, 00:17:11.093 "state": "enabled", 00:17:11.093 "thread": "nvmf_tgt_poll_group_000", 00:17:11.093 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:11.093 "listen_address": { 00:17:11.093 "trtype": "TCP", 00:17:11.093 "adrfam": "IPv4", 00:17:11.093 "traddr": "10.0.0.2", 00:17:11.093 "trsvcid": "4420" 00:17:11.093 }, 00:17:11.093 "peer_address": { 00:17:11.093 "trtype": "TCP", 00:17:11.093 "adrfam": "IPv4", 00:17:11.094 "traddr": "10.0.0.1", 00:17:11.094 "trsvcid": "35788" 00:17:11.094 }, 00:17:11.094 "auth": { 00:17:11.094 "state": "completed", 00:17:11.094 "digest": "sha384", 00:17:11.094 "dhgroup": "null" 00:17:11.094 } 00:17:11.094 } 00:17:11.094 ]' 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:11.094 13:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:11.351 13:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:11.351 13:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:12.284 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:12.284 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:12.284 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:12.284 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:12.285 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:12.285 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:12.285 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:12.285 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:12.285 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:12.285 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:12.544 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 0 00:17:12.544 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:12.544 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:12.544 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:12.544 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:12.544 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:12.545 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:12.545 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:12.545 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:12.545 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:12.545 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:12.545 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:12.545 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:12.802 00:17:12.802 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:12.802 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:12.802 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:13.060 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:13.060 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:13.060 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.060 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:13.060 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.060 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:13.060 { 00:17:13.060 "cntlid": 57, 00:17:13.060 "qid": 0, 00:17:13.060 "state": "enabled", 00:17:13.060 "thread": "nvmf_tgt_poll_group_000", 00:17:13.060 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:13.060 "listen_address": { 00:17:13.060 "trtype": "TCP", 00:17:13.060 "adrfam": "IPv4", 00:17:13.060 "traddr": "10.0.0.2", 00:17:13.060 "trsvcid": "4420" 00:17:13.060 }, 00:17:13.060 "peer_address": { 00:17:13.060 "trtype": "TCP", 00:17:13.060 "adrfam": "IPv4", 00:17:13.060 "traddr": "10.0.0.1", 00:17:13.060 "trsvcid": "35828" 00:17:13.060 }, 00:17:13.060 "auth": { 00:17:13.060 "state": "completed", 00:17:13.060 "digest": "sha384", 00:17:13.060 "dhgroup": "ffdhe2048" 00:17:13.060 } 00:17:13.060 } 00:17:13.060 ]' 00:17:13.060 13:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:13.319 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:13.319 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:13.319 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:13.319 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:13.319 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:13.319 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:13.319 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:13.577 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:13.577 13:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:14.510 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:14.510 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 1 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:14.768 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:15.333 00:17:15.333 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:15.333 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:15.333 13:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:15.591 { 00:17:15.591 "cntlid": 59, 00:17:15.591 "qid": 0, 00:17:15.591 "state": "enabled", 00:17:15.591 "thread": "nvmf_tgt_poll_group_000", 00:17:15.591 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:15.591 "listen_address": { 00:17:15.591 "trtype": "TCP", 00:17:15.591 "adrfam": "IPv4", 00:17:15.591 "traddr": "10.0.0.2", 00:17:15.591 "trsvcid": "4420" 00:17:15.591 }, 00:17:15.591 "peer_address": { 00:17:15.591 "trtype": "TCP", 00:17:15.591 "adrfam": "IPv4", 00:17:15.591 "traddr": "10.0.0.1", 00:17:15.591 "trsvcid": "35858" 00:17:15.591 }, 00:17:15.591 "auth": { 00:17:15.591 "state": "completed", 00:17:15.591 "digest": "sha384", 00:17:15.591 "dhgroup": "ffdhe2048" 00:17:15.591 } 00:17:15.591 } 00:17:15.591 ]' 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:15.591 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:15.849 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:15.849 13:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:16.786 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:16.786 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 2 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:17.043 13:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:17.301 00:17:17.301 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:17.301 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:17.301 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:17.559 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:17.559 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:17.559 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.559 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:17.817 { 00:17:17.817 "cntlid": 61, 00:17:17.817 "qid": 0, 00:17:17.817 "state": "enabled", 00:17:17.817 "thread": "nvmf_tgt_poll_group_000", 00:17:17.817 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:17.817 "listen_address": { 00:17:17.817 "trtype": "TCP", 00:17:17.817 "adrfam": "IPv4", 00:17:17.817 "traddr": "10.0.0.2", 00:17:17.817 "trsvcid": "4420" 00:17:17.817 }, 00:17:17.817 "peer_address": { 00:17:17.817 "trtype": "TCP", 00:17:17.817 "adrfam": "IPv4", 00:17:17.817 "traddr": "10.0.0.1", 00:17:17.817 "trsvcid": "52682" 00:17:17.817 }, 00:17:17.817 "auth": { 00:17:17.817 "state": "completed", 00:17:17.817 "digest": "sha384", 00:17:17.817 "dhgroup": "ffdhe2048" 00:17:17.817 } 00:17:17.817 } 00:17:17.817 ]' 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:17.817 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:18.074 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:18.074 13:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:19.008 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:19.008 13:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 3 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:19.266 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:19.525 00:17:19.525 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:19.525 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:19.525 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:20.090 { 00:17:20.090 "cntlid": 63, 00:17:20.090 "qid": 0, 00:17:20.090 "state": "enabled", 00:17:20.090 "thread": "nvmf_tgt_poll_group_000", 00:17:20.090 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:20.090 "listen_address": { 00:17:20.090 "trtype": "TCP", 00:17:20.090 "adrfam": "IPv4", 00:17:20.090 "traddr": "10.0.0.2", 00:17:20.090 "trsvcid": "4420" 00:17:20.090 }, 00:17:20.090 "peer_address": { 00:17:20.090 "trtype": "TCP", 00:17:20.090 "adrfam": "IPv4", 00:17:20.090 "traddr": "10.0.0.1", 00:17:20.090 "trsvcid": "52712" 00:17:20.090 }, 00:17:20.090 "auth": { 00:17:20.090 "state": "completed", 00:17:20.090 "digest": "sha384", 00:17:20.090 "dhgroup": "ffdhe2048" 00:17:20.090 } 00:17:20.090 } 00:17:20.090 ]' 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:20.090 13:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:20.347 13:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:20.347 13:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:21.280 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:21.280 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 0 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:21.537 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:21.795 00:17:21.795 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:21.795 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:21.795 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:22.052 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:22.052 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:22.052 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.052 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:22.311 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.311 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:22.311 { 00:17:22.311 "cntlid": 65, 00:17:22.311 "qid": 0, 00:17:22.311 "state": "enabled", 00:17:22.311 "thread": "nvmf_tgt_poll_group_000", 00:17:22.311 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:22.311 "listen_address": { 00:17:22.311 "trtype": "TCP", 00:17:22.311 "adrfam": "IPv4", 00:17:22.311 "traddr": "10.0.0.2", 00:17:22.311 "trsvcid": "4420" 00:17:22.311 }, 00:17:22.311 "peer_address": { 00:17:22.311 "trtype": "TCP", 00:17:22.311 "adrfam": "IPv4", 00:17:22.311 "traddr": "10.0.0.1", 00:17:22.311 "trsvcid": "52744" 00:17:22.311 }, 00:17:22.311 "auth": { 00:17:22.311 "state": "completed", 00:17:22.311 "digest": "sha384", 00:17:22.311 "dhgroup": "ffdhe3072" 00:17:22.311 } 00:17:22.311 } 00:17:22.311 ]' 00:17:22.311 13:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:22.311 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:22.311 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:22.311 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:22.311 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:22.311 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:22.311 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:22.311 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:22.570 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:22.570 13:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:23.501 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:23.501 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 1 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:23.760 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:24.018 00:17:24.275 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:24.275 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:24.276 13:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:24.533 { 00:17:24.533 "cntlid": 67, 00:17:24.533 "qid": 0, 00:17:24.533 "state": "enabled", 00:17:24.533 "thread": "nvmf_tgt_poll_group_000", 00:17:24.533 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:24.533 "listen_address": { 00:17:24.533 "trtype": "TCP", 00:17:24.533 "adrfam": "IPv4", 00:17:24.533 "traddr": "10.0.0.2", 00:17:24.533 "trsvcid": "4420" 00:17:24.533 }, 00:17:24.533 "peer_address": { 00:17:24.533 "trtype": "TCP", 00:17:24.533 "adrfam": "IPv4", 00:17:24.533 "traddr": "10.0.0.1", 00:17:24.533 "trsvcid": "52778" 00:17:24.533 }, 00:17:24.533 "auth": { 00:17:24.533 "state": "completed", 00:17:24.533 "digest": "sha384", 00:17:24.533 "dhgroup": "ffdhe3072" 00:17:24.533 } 00:17:24.533 } 00:17:24.533 ]' 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:24.533 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:24.791 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:24.791 13:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:25.722 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:25.722 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:25.723 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:25.723 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:25.723 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:25.723 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:25.723 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:25.723 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:25.723 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 2 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:25.980 13:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:26.238 00:17:26.495 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:26.495 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:26.495 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:26.752 { 00:17:26.752 "cntlid": 69, 00:17:26.752 "qid": 0, 00:17:26.752 "state": "enabled", 00:17:26.752 "thread": "nvmf_tgt_poll_group_000", 00:17:26.752 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:26.752 "listen_address": { 00:17:26.752 "trtype": "TCP", 00:17:26.752 "adrfam": "IPv4", 00:17:26.752 "traddr": "10.0.0.2", 00:17:26.752 "trsvcid": "4420" 00:17:26.752 }, 00:17:26.752 "peer_address": { 00:17:26.752 "trtype": "TCP", 00:17:26.752 "adrfam": "IPv4", 00:17:26.752 "traddr": "10.0.0.1", 00:17:26.752 "trsvcid": "52794" 00:17:26.752 }, 00:17:26.752 "auth": { 00:17:26.752 "state": "completed", 00:17:26.752 "digest": "sha384", 00:17:26.752 "dhgroup": "ffdhe3072" 00:17:26.752 } 00:17:26.752 } 00:17:26.752 ]' 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:26.752 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:27.010 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:27.010 13:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:27.942 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:27.942 13:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 3 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:28.199 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:28.457 00:17:28.457 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:28.457 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:28.457 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:29.022 { 00:17:29.022 "cntlid": 71, 00:17:29.022 "qid": 0, 00:17:29.022 "state": "enabled", 00:17:29.022 "thread": "nvmf_tgt_poll_group_000", 00:17:29.022 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:29.022 "listen_address": { 00:17:29.022 "trtype": "TCP", 00:17:29.022 "adrfam": "IPv4", 00:17:29.022 "traddr": "10.0.0.2", 00:17:29.022 "trsvcid": "4420" 00:17:29.022 }, 00:17:29.022 "peer_address": { 00:17:29.022 "trtype": "TCP", 00:17:29.022 "adrfam": "IPv4", 00:17:29.022 "traddr": "10.0.0.1", 00:17:29.022 "trsvcid": "48166" 00:17:29.022 }, 00:17:29.022 "auth": { 00:17:29.022 "state": "completed", 00:17:29.022 "digest": "sha384", 00:17:29.022 "dhgroup": "ffdhe3072" 00:17:29.022 } 00:17:29.022 } 00:17:29.022 ]' 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:29.022 13:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:29.280 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:29.280 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:30.212 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:30.212 13:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 0 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:30.470 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:30.728 00:17:30.728 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:30.728 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:30.728 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:31.293 { 00:17:31.293 "cntlid": 73, 00:17:31.293 "qid": 0, 00:17:31.293 "state": "enabled", 00:17:31.293 "thread": "nvmf_tgt_poll_group_000", 00:17:31.293 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:31.293 "listen_address": { 00:17:31.293 "trtype": "TCP", 00:17:31.293 "adrfam": "IPv4", 00:17:31.293 "traddr": "10.0.0.2", 00:17:31.293 "trsvcid": "4420" 00:17:31.293 }, 00:17:31.293 "peer_address": { 00:17:31.293 "trtype": "TCP", 00:17:31.293 "adrfam": "IPv4", 00:17:31.293 "traddr": "10.0.0.1", 00:17:31.293 "trsvcid": "48190" 00:17:31.293 }, 00:17:31.293 "auth": { 00:17:31.293 "state": "completed", 00:17:31.293 "digest": "sha384", 00:17:31.293 "dhgroup": "ffdhe4096" 00:17:31.293 } 00:17:31.293 } 00:17:31.293 ]' 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:31.293 13:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:31.293 13:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:31.293 13:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:31.293 13:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:31.293 13:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:31.293 13:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:31.551 13:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:31.551 13:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:32.498 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:32.498 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 1 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:32.756 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:33.013 00:17:33.013 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:33.013 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:33.013 13:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:33.271 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:33.271 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:33.271 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.271 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:33.271 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.271 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:33.271 { 00:17:33.271 "cntlid": 75, 00:17:33.271 "qid": 0, 00:17:33.271 "state": "enabled", 00:17:33.271 "thread": "nvmf_tgt_poll_group_000", 00:17:33.271 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:33.271 "listen_address": { 00:17:33.271 "trtype": "TCP", 00:17:33.271 "adrfam": "IPv4", 00:17:33.271 "traddr": "10.0.0.2", 00:17:33.271 "trsvcid": "4420" 00:17:33.271 }, 00:17:33.271 "peer_address": { 00:17:33.271 "trtype": "TCP", 00:17:33.271 "adrfam": "IPv4", 00:17:33.271 "traddr": "10.0.0.1", 00:17:33.271 "trsvcid": "48204" 00:17:33.271 }, 00:17:33.271 "auth": { 00:17:33.271 "state": "completed", 00:17:33.271 "digest": "sha384", 00:17:33.271 "dhgroup": "ffdhe4096" 00:17:33.271 } 00:17:33.271 } 00:17:33.271 ]' 00:17:33.271 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:33.530 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:33.530 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:33.530 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:33.530 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:33.530 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:33.530 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:33.530 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:33.828 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:33.828 13:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:34.795 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 2 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.795 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:35.053 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.053 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:35.053 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:35.053 13:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:35.310 00:17:35.311 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:35.311 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:35.311 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:35.568 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:35.568 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:35.568 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.568 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:35.568 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.568 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:35.568 { 00:17:35.568 "cntlid": 77, 00:17:35.568 "qid": 0, 00:17:35.568 "state": "enabled", 00:17:35.568 "thread": "nvmf_tgt_poll_group_000", 00:17:35.568 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:35.568 "listen_address": { 00:17:35.568 "trtype": "TCP", 00:17:35.568 "adrfam": "IPv4", 00:17:35.568 "traddr": "10.0.0.2", 00:17:35.568 "trsvcid": "4420" 00:17:35.568 }, 00:17:35.568 "peer_address": { 00:17:35.568 "trtype": "TCP", 00:17:35.568 "adrfam": "IPv4", 00:17:35.568 "traddr": "10.0.0.1", 00:17:35.568 "trsvcid": "48228" 00:17:35.568 }, 00:17:35.568 "auth": { 00:17:35.568 "state": "completed", 00:17:35.568 "digest": "sha384", 00:17:35.568 "dhgroup": "ffdhe4096" 00:17:35.568 } 00:17:35.568 } 00:17:35.568 ]' 00:17:35.568 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:35.825 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:35.825 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:35.825 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:35.826 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:35.826 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:35.826 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:35.826 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:36.083 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:36.083 13:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:37.014 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:37.014 13:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 3 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:37.272 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:37.529 00:17:37.529 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:37.529 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:37.529 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:38.093 { 00:17:38.093 "cntlid": 79, 00:17:38.093 "qid": 0, 00:17:38.093 "state": "enabled", 00:17:38.093 "thread": "nvmf_tgt_poll_group_000", 00:17:38.093 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:38.093 "listen_address": { 00:17:38.093 "trtype": "TCP", 00:17:38.093 "adrfam": "IPv4", 00:17:38.093 "traddr": "10.0.0.2", 00:17:38.093 "trsvcid": "4420" 00:17:38.093 }, 00:17:38.093 "peer_address": { 00:17:38.093 "trtype": "TCP", 00:17:38.093 "adrfam": "IPv4", 00:17:38.093 "traddr": "10.0.0.1", 00:17:38.093 "trsvcid": "33770" 00:17:38.093 }, 00:17:38.093 "auth": { 00:17:38.093 "state": "completed", 00:17:38.093 "digest": "sha384", 00:17:38.093 "dhgroup": "ffdhe4096" 00:17:38.093 } 00:17:38.093 } 00:17:38.093 ]' 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:38.093 13:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:38.351 13:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:38.351 13:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:39.283 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:39.283 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:39.283 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:39.283 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:39.283 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:39.283 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:39.283 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:39.284 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:39.284 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:39.284 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 0 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:39.541 13:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:40.106 00:17:40.106 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:40.106 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:40.106 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:40.671 { 00:17:40.671 "cntlid": 81, 00:17:40.671 "qid": 0, 00:17:40.671 "state": "enabled", 00:17:40.671 "thread": "nvmf_tgt_poll_group_000", 00:17:40.671 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:40.671 "listen_address": { 00:17:40.671 "trtype": "TCP", 00:17:40.671 "adrfam": "IPv4", 00:17:40.671 "traddr": "10.0.0.2", 00:17:40.671 "trsvcid": "4420" 00:17:40.671 }, 00:17:40.671 "peer_address": { 00:17:40.671 "trtype": "TCP", 00:17:40.671 "adrfam": "IPv4", 00:17:40.671 "traddr": "10.0.0.1", 00:17:40.671 "trsvcid": "33796" 00:17:40.671 }, 00:17:40.671 "auth": { 00:17:40.671 "state": "completed", 00:17:40.671 "digest": "sha384", 00:17:40.671 "dhgroup": "ffdhe6144" 00:17:40.671 } 00:17:40.671 } 00:17:40.671 ]' 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:40.671 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:40.672 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:40.672 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:40.929 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:40.929 13:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:41.860 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:41.860 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 1 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:42.117 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.118 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:42.118 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.118 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:42.118 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:42.118 13:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:42.682 00:17:42.682 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:42.682 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:42.682 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:42.939 { 00:17:42.939 "cntlid": 83, 00:17:42.939 "qid": 0, 00:17:42.939 "state": "enabled", 00:17:42.939 "thread": "nvmf_tgt_poll_group_000", 00:17:42.939 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:42.939 "listen_address": { 00:17:42.939 "trtype": "TCP", 00:17:42.939 "adrfam": "IPv4", 00:17:42.939 "traddr": "10.0.0.2", 00:17:42.939 "trsvcid": "4420" 00:17:42.939 }, 00:17:42.939 "peer_address": { 00:17:42.939 "trtype": "TCP", 00:17:42.939 "adrfam": "IPv4", 00:17:42.939 "traddr": "10.0.0.1", 00:17:42.939 "trsvcid": "33820" 00:17:42.939 }, 00:17:42.939 "auth": { 00:17:42.939 "state": "completed", 00:17:42.939 "digest": "sha384", 00:17:42.939 "dhgroup": "ffdhe6144" 00:17:42.939 } 00:17:42.939 } 00:17:42.939 ]' 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:42.939 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:43.197 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:43.197 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:43.197 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:43.197 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:43.197 13:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:43.455 13:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:43.455 13:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:44.386 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:44.386 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 2 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:44.643 13:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:45.209 00:17:45.209 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:45.209 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:45.209 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:45.467 { 00:17:45.467 "cntlid": 85, 00:17:45.467 "qid": 0, 00:17:45.467 "state": "enabled", 00:17:45.467 "thread": "nvmf_tgt_poll_group_000", 00:17:45.467 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:45.467 "listen_address": { 00:17:45.467 "trtype": "TCP", 00:17:45.467 "adrfam": "IPv4", 00:17:45.467 "traddr": "10.0.0.2", 00:17:45.467 "trsvcid": "4420" 00:17:45.467 }, 00:17:45.467 "peer_address": { 00:17:45.467 "trtype": "TCP", 00:17:45.467 "adrfam": "IPv4", 00:17:45.467 "traddr": "10.0.0.1", 00:17:45.467 "trsvcid": "33836" 00:17:45.467 }, 00:17:45.467 "auth": { 00:17:45.467 "state": "completed", 00:17:45.467 "digest": "sha384", 00:17:45.467 "dhgroup": "ffdhe6144" 00:17:45.467 } 00:17:45.467 } 00:17:45.467 ]' 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:45.467 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:45.725 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:45.725 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:45.725 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:45.725 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:45.725 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:45.982 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:45.982 13:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:46.912 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:46.912 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 3 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:47.169 13:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:47.734 00:17:47.734 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:47.734 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:47.734 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:48.006 { 00:17:48.006 "cntlid": 87, 00:17:48.006 "qid": 0, 00:17:48.006 "state": "enabled", 00:17:48.006 "thread": "nvmf_tgt_poll_group_000", 00:17:48.006 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:48.006 "listen_address": { 00:17:48.006 "trtype": "TCP", 00:17:48.006 "adrfam": "IPv4", 00:17:48.006 "traddr": "10.0.0.2", 00:17:48.006 "trsvcid": "4420" 00:17:48.006 }, 00:17:48.006 "peer_address": { 00:17:48.006 "trtype": "TCP", 00:17:48.006 "adrfam": "IPv4", 00:17:48.006 "traddr": "10.0.0.1", 00:17:48.006 "trsvcid": "54784" 00:17:48.006 }, 00:17:48.006 "auth": { 00:17:48.006 "state": "completed", 00:17:48.006 "digest": "sha384", 00:17:48.006 "dhgroup": "ffdhe6144" 00:17:48.006 } 00:17:48.006 } 00:17:48.006 ]' 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:48.006 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:48.263 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:48.263 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:48.263 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:48.263 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:48.263 13:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:48.522 13:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:48.522 13:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:49.455 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:49.455 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 0 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:49.713 13:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:50.647 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:50.647 { 00:17:50.647 "cntlid": 89, 00:17:50.647 "qid": 0, 00:17:50.647 "state": "enabled", 00:17:50.647 "thread": "nvmf_tgt_poll_group_000", 00:17:50.647 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:50.647 "listen_address": { 00:17:50.647 "trtype": "TCP", 00:17:50.647 "adrfam": "IPv4", 00:17:50.647 "traddr": "10.0.0.2", 00:17:50.647 "trsvcid": "4420" 00:17:50.647 }, 00:17:50.647 "peer_address": { 00:17:50.647 "trtype": "TCP", 00:17:50.647 "adrfam": "IPv4", 00:17:50.647 "traddr": "10.0.0.1", 00:17:50.647 "trsvcid": "54820" 00:17:50.647 }, 00:17:50.647 "auth": { 00:17:50.647 "state": "completed", 00:17:50.647 "digest": "sha384", 00:17:50.647 "dhgroup": "ffdhe8192" 00:17:50.647 } 00:17:50.647 } 00:17:50.647 ]' 00:17:50.647 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:50.905 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:50.905 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:50.905 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:50.905 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:50.905 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:50.905 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:50.905 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:51.162 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:51.162 13:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:52.094 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:52.094 13:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 1 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:52.352 13:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:53.283 00:17:53.283 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:53.283 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:53.283 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:53.540 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:53.540 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:53.540 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:53.540 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:53.540 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:53.540 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:53.540 { 00:17:53.540 "cntlid": 91, 00:17:53.540 "qid": 0, 00:17:53.540 "state": "enabled", 00:17:53.540 "thread": "nvmf_tgt_poll_group_000", 00:17:53.540 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:53.540 "listen_address": { 00:17:53.540 "trtype": "TCP", 00:17:53.540 "adrfam": "IPv4", 00:17:53.540 "traddr": "10.0.0.2", 00:17:53.540 "trsvcid": "4420" 00:17:53.541 }, 00:17:53.541 "peer_address": { 00:17:53.541 "trtype": "TCP", 00:17:53.541 "adrfam": "IPv4", 00:17:53.541 "traddr": "10.0.0.1", 00:17:53.541 "trsvcid": "54850" 00:17:53.541 }, 00:17:53.541 "auth": { 00:17:53.541 "state": "completed", 00:17:53.541 "digest": "sha384", 00:17:53.541 "dhgroup": "ffdhe8192" 00:17:53.541 } 00:17:53.541 } 00:17:53.541 ]' 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:53.541 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:53.798 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:53.798 13:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:54.733 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:54.733 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 2 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:54.991 13:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:55.925 00:17:55.925 13:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:55.925 13:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:55.925 13:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:56.182 { 00:17:56.182 "cntlid": 93, 00:17:56.182 "qid": 0, 00:17:56.182 "state": "enabled", 00:17:56.182 "thread": "nvmf_tgt_poll_group_000", 00:17:56.182 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:56.182 "listen_address": { 00:17:56.182 "trtype": "TCP", 00:17:56.182 "adrfam": "IPv4", 00:17:56.182 "traddr": "10.0.0.2", 00:17:56.182 "trsvcid": "4420" 00:17:56.182 }, 00:17:56.182 "peer_address": { 00:17:56.182 "trtype": "TCP", 00:17:56.182 "adrfam": "IPv4", 00:17:56.182 "traddr": "10.0.0.1", 00:17:56.182 "trsvcid": "54876" 00:17:56.182 }, 00:17:56.182 "auth": { 00:17:56.182 "state": "completed", 00:17:56.182 "digest": "sha384", 00:17:56.182 "dhgroup": "ffdhe8192" 00:17:56.182 } 00:17:56.182 } 00:17:56.182 ]' 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:56.182 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:56.440 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:56.440 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:56.440 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:56.440 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:56.440 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:56.698 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:56.698 13:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:17:57.630 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:57.630 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:57.630 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:17:57.630 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:57.630 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:57.630 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.630 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:57.630 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:57.631 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 3 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:57.888 13:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:58.820 00:17:58.820 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:58.820 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:58.820 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:59.078 { 00:17:59.078 "cntlid": 95, 00:17:59.078 "qid": 0, 00:17:59.078 "state": "enabled", 00:17:59.078 "thread": "nvmf_tgt_poll_group_000", 00:17:59.078 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:17:59.078 "listen_address": { 00:17:59.078 "trtype": "TCP", 00:17:59.078 "adrfam": "IPv4", 00:17:59.078 "traddr": "10.0.0.2", 00:17:59.078 "trsvcid": "4420" 00:17:59.078 }, 00:17:59.078 "peer_address": { 00:17:59.078 "trtype": "TCP", 00:17:59.078 "adrfam": "IPv4", 00:17:59.078 "traddr": "10.0.0.1", 00:17:59.078 "trsvcid": "52512" 00:17:59.078 }, 00:17:59.078 "auth": { 00:17:59.078 "state": "completed", 00:17:59.078 "digest": "sha384", 00:17:59.078 "dhgroup": "ffdhe8192" 00:17:59.078 } 00:17:59.078 } 00:17:59.078 ]' 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:59.078 13:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:59.336 13:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:17:59.336 13:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:00.269 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:00.269 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 0 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:00.526 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:01.091 00:18:01.091 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:01.091 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:01.091 13:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:01.091 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:01.091 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:01.091 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:01.091 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:01.349 { 00:18:01.349 "cntlid": 97, 00:18:01.349 "qid": 0, 00:18:01.349 "state": "enabled", 00:18:01.349 "thread": "nvmf_tgt_poll_group_000", 00:18:01.349 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:01.349 "listen_address": { 00:18:01.349 "trtype": "TCP", 00:18:01.349 "adrfam": "IPv4", 00:18:01.349 "traddr": "10.0.0.2", 00:18:01.349 "trsvcid": "4420" 00:18:01.349 }, 00:18:01.349 "peer_address": { 00:18:01.349 "trtype": "TCP", 00:18:01.349 "adrfam": "IPv4", 00:18:01.349 "traddr": "10.0.0.1", 00:18:01.349 "trsvcid": "52530" 00:18:01.349 }, 00:18:01.349 "auth": { 00:18:01.349 "state": "completed", 00:18:01.349 "digest": "sha512", 00:18:01.349 "dhgroup": "null" 00:18:01.349 } 00:18:01.349 } 00:18:01.349 ]' 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:01.349 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:01.607 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:01.607 13:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:02.538 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:02.538 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 1 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:02.796 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:03.054 00:18:03.054 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:03.054 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:03.054 13:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:03.311 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:03.311 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:03.311 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:03.311 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:03.311 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:03.311 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:03.311 { 00:18:03.311 "cntlid": 99, 00:18:03.311 "qid": 0, 00:18:03.311 "state": "enabled", 00:18:03.311 "thread": "nvmf_tgt_poll_group_000", 00:18:03.311 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:03.311 "listen_address": { 00:18:03.311 "trtype": "TCP", 00:18:03.311 "adrfam": "IPv4", 00:18:03.311 "traddr": "10.0.0.2", 00:18:03.311 "trsvcid": "4420" 00:18:03.311 }, 00:18:03.311 "peer_address": { 00:18:03.311 "trtype": "TCP", 00:18:03.311 "adrfam": "IPv4", 00:18:03.311 "traddr": "10.0.0.1", 00:18:03.311 "trsvcid": "52558" 00:18:03.311 }, 00:18:03.311 "auth": { 00:18:03.311 "state": "completed", 00:18:03.311 "digest": "sha512", 00:18:03.312 "dhgroup": "null" 00:18:03.312 } 00:18:03.312 } 00:18:03.312 ]' 00:18:03.312 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:03.312 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:03.312 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:03.570 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:03.570 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:03.570 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:03.570 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:03.570 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:03.827 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:03.827 13:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:04.811 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:04.811 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 2 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:05.069 13:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:05.326 00:18:05.326 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:05.326 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:05.326 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:05.583 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:05.583 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:05.583 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.584 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:05.584 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.584 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:05.584 { 00:18:05.584 "cntlid": 101, 00:18:05.584 "qid": 0, 00:18:05.584 "state": "enabled", 00:18:05.584 "thread": "nvmf_tgt_poll_group_000", 00:18:05.584 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:05.584 "listen_address": { 00:18:05.584 "trtype": "TCP", 00:18:05.584 "adrfam": "IPv4", 00:18:05.584 "traddr": "10.0.0.2", 00:18:05.584 "trsvcid": "4420" 00:18:05.584 }, 00:18:05.584 "peer_address": { 00:18:05.584 "trtype": "TCP", 00:18:05.584 "adrfam": "IPv4", 00:18:05.584 "traddr": "10.0.0.1", 00:18:05.584 "trsvcid": "52580" 00:18:05.584 }, 00:18:05.584 "auth": { 00:18:05.584 "state": "completed", 00:18:05.584 "digest": "sha512", 00:18:05.584 "dhgroup": "null" 00:18:05.584 } 00:18:05.584 } 00:18:05.584 ]' 00:18:05.584 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:05.584 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:05.584 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:05.841 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:05.841 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:05.841 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:05.841 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:05.841 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:06.099 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:06.099 13:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:07.032 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 3 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:07.032 13:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:07.600 00:18:07.600 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:07.600 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:07.600 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:07.860 { 00:18:07.860 "cntlid": 103, 00:18:07.860 "qid": 0, 00:18:07.860 "state": "enabled", 00:18:07.860 "thread": "nvmf_tgt_poll_group_000", 00:18:07.860 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:07.860 "listen_address": { 00:18:07.860 "trtype": "TCP", 00:18:07.860 "adrfam": "IPv4", 00:18:07.860 "traddr": "10.0.0.2", 00:18:07.860 "trsvcid": "4420" 00:18:07.860 }, 00:18:07.860 "peer_address": { 00:18:07.860 "trtype": "TCP", 00:18:07.860 "adrfam": "IPv4", 00:18:07.860 "traddr": "10.0.0.1", 00:18:07.860 "trsvcid": "58278" 00:18:07.860 }, 00:18:07.860 "auth": { 00:18:07.860 "state": "completed", 00:18:07.860 "digest": "sha512", 00:18:07.860 "dhgroup": "null" 00:18:07.860 } 00:18:07.860 } 00:18:07.860 ]' 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:07.860 13:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:08.425 13:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:08.425 13:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:09.358 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 0 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.358 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:09.615 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.615 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.615 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.615 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.871 00:18:09.871 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:09.871 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:09.871 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:10.129 { 00:18:10.129 "cntlid": 105, 00:18:10.129 "qid": 0, 00:18:10.129 "state": "enabled", 00:18:10.129 "thread": "nvmf_tgt_poll_group_000", 00:18:10.129 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:10.129 "listen_address": { 00:18:10.129 "trtype": "TCP", 00:18:10.129 "adrfam": "IPv4", 00:18:10.129 "traddr": "10.0.0.2", 00:18:10.129 "trsvcid": "4420" 00:18:10.129 }, 00:18:10.129 "peer_address": { 00:18:10.129 "trtype": "TCP", 00:18:10.129 "adrfam": "IPv4", 00:18:10.129 "traddr": "10.0.0.1", 00:18:10.129 "trsvcid": "58308" 00:18:10.129 }, 00:18:10.129 "auth": { 00:18:10.129 "state": "completed", 00:18:10.129 "digest": "sha512", 00:18:10.129 "dhgroup": "ffdhe2048" 00:18:10.129 } 00:18:10.129 } 00:18:10.129 ]' 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:10.129 13:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:10.129 13:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:10.129 13:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:10.129 13:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:10.129 13:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:10.129 13:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:10.387 13:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:10.387 13:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:11.319 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:11.320 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:11.320 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:11.320 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:11.320 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:11.320 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:11.320 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:11.320 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:11.320 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 1 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:11.577 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:12.142 00:18:12.142 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:12.142 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:12.142 13:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:12.404 { 00:18:12.404 "cntlid": 107, 00:18:12.404 "qid": 0, 00:18:12.404 "state": "enabled", 00:18:12.404 "thread": "nvmf_tgt_poll_group_000", 00:18:12.404 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:12.404 "listen_address": { 00:18:12.404 "trtype": "TCP", 00:18:12.404 "adrfam": "IPv4", 00:18:12.404 "traddr": "10.0.0.2", 00:18:12.404 "trsvcid": "4420" 00:18:12.404 }, 00:18:12.404 "peer_address": { 00:18:12.404 "trtype": "TCP", 00:18:12.404 "adrfam": "IPv4", 00:18:12.404 "traddr": "10.0.0.1", 00:18:12.404 "trsvcid": "58340" 00:18:12.404 }, 00:18:12.404 "auth": { 00:18:12.404 "state": "completed", 00:18:12.404 "digest": "sha512", 00:18:12.404 "dhgroup": "ffdhe2048" 00:18:12.404 } 00:18:12.404 } 00:18:12.404 ]' 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:12.404 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:12.661 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:12.661 13:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:13.593 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:13.593 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:13.850 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 2 00:18:13.850 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:13.850 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:13.850 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:13.851 13:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:14.416 00:18:14.416 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:14.416 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:14.416 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:14.674 { 00:18:14.674 "cntlid": 109, 00:18:14.674 "qid": 0, 00:18:14.674 "state": "enabled", 00:18:14.674 "thread": "nvmf_tgt_poll_group_000", 00:18:14.674 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:14.674 "listen_address": { 00:18:14.674 "trtype": "TCP", 00:18:14.674 "adrfam": "IPv4", 00:18:14.674 "traddr": "10.0.0.2", 00:18:14.674 "trsvcid": "4420" 00:18:14.674 }, 00:18:14.674 "peer_address": { 00:18:14.674 "trtype": "TCP", 00:18:14.674 "adrfam": "IPv4", 00:18:14.674 "traddr": "10.0.0.1", 00:18:14.674 "trsvcid": "58370" 00:18:14.674 }, 00:18:14.674 "auth": { 00:18:14.674 "state": "completed", 00:18:14.674 "digest": "sha512", 00:18:14.674 "dhgroup": "ffdhe2048" 00:18:14.674 } 00:18:14.674 } 00:18:14.674 ]' 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:14.674 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:14.932 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:14.932 13:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:15.863 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:15.864 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:15.864 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:15.864 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.864 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:15.864 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.864 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:15.864 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:15.864 13:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 3 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:16.129 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:16.694 00:18:16.694 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:16.694 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:16.694 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:16.952 { 00:18:16.952 "cntlid": 111, 00:18:16.952 "qid": 0, 00:18:16.952 "state": "enabled", 00:18:16.952 "thread": "nvmf_tgt_poll_group_000", 00:18:16.952 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:16.952 "listen_address": { 00:18:16.952 "trtype": "TCP", 00:18:16.952 "adrfam": "IPv4", 00:18:16.952 "traddr": "10.0.0.2", 00:18:16.952 "trsvcid": "4420" 00:18:16.952 }, 00:18:16.952 "peer_address": { 00:18:16.952 "trtype": "TCP", 00:18:16.952 "adrfam": "IPv4", 00:18:16.952 "traddr": "10.0.0.1", 00:18:16.952 "trsvcid": "58384" 00:18:16.952 }, 00:18:16.952 "auth": { 00:18:16.952 "state": "completed", 00:18:16.952 "digest": "sha512", 00:18:16.952 "dhgroup": "ffdhe2048" 00:18:16.952 } 00:18:16.952 } 00:18:16.952 ]' 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:16.952 13:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:17.209 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:17.210 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:18.141 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:18.141 13:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 0 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.399 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.964 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:18.964 { 00:18:18.964 "cntlid": 113, 00:18:18.964 "qid": 0, 00:18:18.964 "state": "enabled", 00:18:18.964 "thread": "nvmf_tgt_poll_group_000", 00:18:18.964 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:18.964 "listen_address": { 00:18:18.964 "trtype": "TCP", 00:18:18.964 "adrfam": "IPv4", 00:18:18.964 "traddr": "10.0.0.2", 00:18:18.964 "trsvcid": "4420" 00:18:18.964 }, 00:18:18.964 "peer_address": { 00:18:18.964 "trtype": "TCP", 00:18:18.964 "adrfam": "IPv4", 00:18:18.964 "traddr": "10.0.0.1", 00:18:18.964 "trsvcid": "50192" 00:18:18.964 }, 00:18:18.964 "auth": { 00:18:18.964 "state": "completed", 00:18:18.964 "digest": "sha512", 00:18:18.964 "dhgroup": "ffdhe3072" 00:18:18.964 } 00:18:18.964 } 00:18:18.964 ]' 00:18:18.964 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:19.222 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:19.222 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:19.222 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:19.222 13:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:19.222 13:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:19.222 13:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:19.222 13:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:19.481 13:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:19.482 13:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:20.414 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:20.414 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 1 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:20.672 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:20.929 00:18:20.929 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:20.929 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:20.929 13:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:21.494 { 00:18:21.494 "cntlid": 115, 00:18:21.494 "qid": 0, 00:18:21.494 "state": "enabled", 00:18:21.494 "thread": "nvmf_tgt_poll_group_000", 00:18:21.494 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:21.494 "listen_address": { 00:18:21.494 "trtype": "TCP", 00:18:21.494 "adrfam": "IPv4", 00:18:21.494 "traddr": "10.0.0.2", 00:18:21.494 "trsvcid": "4420" 00:18:21.494 }, 00:18:21.494 "peer_address": { 00:18:21.494 "trtype": "TCP", 00:18:21.494 "adrfam": "IPv4", 00:18:21.494 "traddr": "10.0.0.1", 00:18:21.494 "trsvcid": "50210" 00:18:21.494 }, 00:18:21.494 "auth": { 00:18:21.494 "state": "completed", 00:18:21.494 "digest": "sha512", 00:18:21.494 "dhgroup": "ffdhe3072" 00:18:21.494 } 00:18:21.494 } 00:18:21.494 ]' 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:21.494 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:21.752 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:21.752 13:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:22.684 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:22.684 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 2 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.941 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:22.942 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:22.942 13:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:23.199 00:18:23.199 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:23.199 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:23.199 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:23.456 { 00:18:23.456 "cntlid": 117, 00:18:23.456 "qid": 0, 00:18:23.456 "state": "enabled", 00:18:23.456 "thread": "nvmf_tgt_poll_group_000", 00:18:23.456 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:23.456 "listen_address": { 00:18:23.456 "trtype": "TCP", 00:18:23.456 "adrfam": "IPv4", 00:18:23.456 "traddr": "10.0.0.2", 00:18:23.456 "trsvcid": "4420" 00:18:23.456 }, 00:18:23.456 "peer_address": { 00:18:23.456 "trtype": "TCP", 00:18:23.456 "adrfam": "IPv4", 00:18:23.456 "traddr": "10.0.0.1", 00:18:23.456 "trsvcid": "50228" 00:18:23.456 }, 00:18:23.456 "auth": { 00:18:23.456 "state": "completed", 00:18:23.456 "digest": "sha512", 00:18:23.456 "dhgroup": "ffdhe3072" 00:18:23.456 } 00:18:23.456 } 00:18:23.456 ]' 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:23.456 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:23.713 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:23.713 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:23.713 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:23.713 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:23.713 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:23.713 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:23.971 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:23.971 13:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:24.903 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:24.903 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 3 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:25.161 13:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:25.419 00:18:25.419 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:25.419 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:25.419 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:25.676 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:25.676 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:25.676 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.676 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:25.676 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.677 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:25.677 { 00:18:25.677 "cntlid": 119, 00:18:25.677 "qid": 0, 00:18:25.677 "state": "enabled", 00:18:25.677 "thread": "nvmf_tgt_poll_group_000", 00:18:25.677 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:25.677 "listen_address": { 00:18:25.677 "trtype": "TCP", 00:18:25.677 "adrfam": "IPv4", 00:18:25.677 "traddr": "10.0.0.2", 00:18:25.677 "trsvcid": "4420" 00:18:25.677 }, 00:18:25.677 "peer_address": { 00:18:25.677 "trtype": "TCP", 00:18:25.677 "adrfam": "IPv4", 00:18:25.677 "traddr": "10.0.0.1", 00:18:25.677 "trsvcid": "50260" 00:18:25.677 }, 00:18:25.677 "auth": { 00:18:25.677 "state": "completed", 00:18:25.677 "digest": "sha512", 00:18:25.677 "dhgroup": "ffdhe3072" 00:18:25.677 } 00:18:25.677 } 00:18:25.677 ]' 00:18:25.677 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:25.934 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:25.934 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:25.934 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:25.934 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:25.934 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:25.934 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:25.934 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:26.192 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:26.192 13:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:27.124 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:27.124 13:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 0 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.381 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.640 00:18:27.640 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:27.640 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:27.640 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:27.897 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:27.897 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:27.897 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.897 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:28.154 { 00:18:28.154 "cntlid": 121, 00:18:28.154 "qid": 0, 00:18:28.154 "state": "enabled", 00:18:28.154 "thread": "nvmf_tgt_poll_group_000", 00:18:28.154 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:28.154 "listen_address": { 00:18:28.154 "trtype": "TCP", 00:18:28.154 "adrfam": "IPv4", 00:18:28.154 "traddr": "10.0.0.2", 00:18:28.154 "trsvcid": "4420" 00:18:28.154 }, 00:18:28.154 "peer_address": { 00:18:28.154 "trtype": "TCP", 00:18:28.154 "adrfam": "IPv4", 00:18:28.154 "traddr": "10.0.0.1", 00:18:28.154 "trsvcid": "55120" 00:18:28.154 }, 00:18:28.154 "auth": { 00:18:28.154 "state": "completed", 00:18:28.154 "digest": "sha512", 00:18:28.154 "dhgroup": "ffdhe4096" 00:18:28.154 } 00:18:28.154 } 00:18:28.154 ]' 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:28.154 13:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:28.412 13:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:28.412 13:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:29.343 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:29.343 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:29.600 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 1 00:18:29.600 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:29.600 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:29.600 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:29.600 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:29.600 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:29.600 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:29.601 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.601 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:29.601 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.601 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:29.601 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:29.601 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:30.165 00:18:30.165 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:30.165 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:30.165 13:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:30.165 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:30.423 { 00:18:30.423 "cntlid": 123, 00:18:30.423 "qid": 0, 00:18:30.423 "state": "enabled", 00:18:30.423 "thread": "nvmf_tgt_poll_group_000", 00:18:30.423 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:30.423 "listen_address": { 00:18:30.423 "trtype": "TCP", 00:18:30.423 "adrfam": "IPv4", 00:18:30.423 "traddr": "10.0.0.2", 00:18:30.423 "trsvcid": "4420" 00:18:30.423 }, 00:18:30.423 "peer_address": { 00:18:30.423 "trtype": "TCP", 00:18:30.423 "adrfam": "IPv4", 00:18:30.423 "traddr": "10.0.0.1", 00:18:30.423 "trsvcid": "55158" 00:18:30.423 }, 00:18:30.423 "auth": { 00:18:30.423 "state": "completed", 00:18:30.423 "digest": "sha512", 00:18:30.423 "dhgroup": "ffdhe4096" 00:18:30.423 } 00:18:30.423 } 00:18:30.423 ]' 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:30.423 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:30.680 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:30.680 13:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:31.613 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:31.613 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 2 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:31.871 13:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:32.128 00:18:32.128 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:32.128 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:32.128 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:32.694 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:32.694 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:32.695 { 00:18:32.695 "cntlid": 125, 00:18:32.695 "qid": 0, 00:18:32.695 "state": "enabled", 00:18:32.695 "thread": "nvmf_tgt_poll_group_000", 00:18:32.695 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:32.695 "listen_address": { 00:18:32.695 "trtype": "TCP", 00:18:32.695 "adrfam": "IPv4", 00:18:32.695 "traddr": "10.0.0.2", 00:18:32.695 "trsvcid": "4420" 00:18:32.695 }, 00:18:32.695 "peer_address": { 00:18:32.695 "trtype": "TCP", 00:18:32.695 "adrfam": "IPv4", 00:18:32.695 "traddr": "10.0.0.1", 00:18:32.695 "trsvcid": "55198" 00:18:32.695 }, 00:18:32.695 "auth": { 00:18:32.695 "state": "completed", 00:18:32.695 "digest": "sha512", 00:18:32.695 "dhgroup": "ffdhe4096" 00:18:32.695 } 00:18:32.695 } 00:18:32.695 ]' 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:32.695 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:32.952 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:32.952 13:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:33.918 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:33.918 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 3 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:34.201 13:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:34.458 00:18:34.715 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:34.715 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:34.715 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:34.972 { 00:18:34.972 "cntlid": 127, 00:18:34.972 "qid": 0, 00:18:34.972 "state": "enabled", 00:18:34.972 "thread": "nvmf_tgt_poll_group_000", 00:18:34.972 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:34.972 "listen_address": { 00:18:34.972 "trtype": "TCP", 00:18:34.972 "adrfam": "IPv4", 00:18:34.972 "traddr": "10.0.0.2", 00:18:34.972 "trsvcid": "4420" 00:18:34.972 }, 00:18:34.972 "peer_address": { 00:18:34.972 "trtype": "TCP", 00:18:34.972 "adrfam": "IPv4", 00:18:34.972 "traddr": "10.0.0.1", 00:18:34.972 "trsvcid": "55214" 00:18:34.972 }, 00:18:34.972 "auth": { 00:18:34.972 "state": "completed", 00:18:34.972 "digest": "sha512", 00:18:34.972 "dhgroup": "ffdhe4096" 00:18:34.972 } 00:18:34.972 } 00:18:34.972 ]' 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:34.972 13:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:35.230 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:35.230 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:36.160 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:36.160 13:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 0 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:36.417 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:36.981 00:18:36.981 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:36.981 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:36.981 13:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:37.238 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:37.238 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:37.238 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.238 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:37.238 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.238 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:37.238 { 00:18:37.238 "cntlid": 129, 00:18:37.238 "qid": 0, 00:18:37.238 "state": "enabled", 00:18:37.238 "thread": "nvmf_tgt_poll_group_000", 00:18:37.238 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:37.238 "listen_address": { 00:18:37.238 "trtype": "TCP", 00:18:37.238 "adrfam": "IPv4", 00:18:37.238 "traddr": "10.0.0.2", 00:18:37.238 "trsvcid": "4420" 00:18:37.238 }, 00:18:37.238 "peer_address": { 00:18:37.238 "trtype": "TCP", 00:18:37.238 "adrfam": "IPv4", 00:18:37.238 "traddr": "10.0.0.1", 00:18:37.238 "trsvcid": "55230" 00:18:37.238 }, 00:18:37.238 "auth": { 00:18:37.238 "state": "completed", 00:18:37.238 "digest": "sha512", 00:18:37.238 "dhgroup": "ffdhe6144" 00:18:37.238 } 00:18:37.238 } 00:18:37.238 ]' 00:18:37.238 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:37.496 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:37.496 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:37.496 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:37.496 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:37.496 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:37.496 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:37.496 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:37.753 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:37.753 13:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:38.685 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:38.685 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 1 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:38.943 13:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:39.522 00:18:39.522 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:39.522 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:39.522 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:39.780 { 00:18:39.780 "cntlid": 131, 00:18:39.780 "qid": 0, 00:18:39.780 "state": "enabled", 00:18:39.780 "thread": "nvmf_tgt_poll_group_000", 00:18:39.780 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:39.780 "listen_address": { 00:18:39.780 "trtype": "TCP", 00:18:39.780 "adrfam": "IPv4", 00:18:39.780 "traddr": "10.0.0.2", 00:18:39.780 "trsvcid": "4420" 00:18:39.780 }, 00:18:39.780 "peer_address": { 00:18:39.780 "trtype": "TCP", 00:18:39.780 "adrfam": "IPv4", 00:18:39.780 "traddr": "10.0.0.1", 00:18:39.780 "trsvcid": "46002" 00:18:39.780 }, 00:18:39.780 "auth": { 00:18:39.780 "state": "completed", 00:18:39.780 "digest": "sha512", 00:18:39.780 "dhgroup": "ffdhe6144" 00:18:39.780 } 00:18:39.780 } 00:18:39.780 ]' 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:39.780 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:40.037 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:40.037 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:40.037 13:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:40.294 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:40.294 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:41.227 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:41.227 13:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 2 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:41.485 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:42.050 00:18:42.050 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:42.050 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:42.050 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:42.307 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:42.307 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:42.307 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.307 13:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:42.307 { 00:18:42.307 "cntlid": 133, 00:18:42.307 "qid": 0, 00:18:42.307 "state": "enabled", 00:18:42.307 "thread": "nvmf_tgt_poll_group_000", 00:18:42.307 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:42.307 "listen_address": { 00:18:42.307 "trtype": "TCP", 00:18:42.307 "adrfam": "IPv4", 00:18:42.307 "traddr": "10.0.0.2", 00:18:42.307 "trsvcid": "4420" 00:18:42.307 }, 00:18:42.307 "peer_address": { 00:18:42.307 "trtype": "TCP", 00:18:42.307 "adrfam": "IPv4", 00:18:42.307 "traddr": "10.0.0.1", 00:18:42.307 "trsvcid": "46030" 00:18:42.307 }, 00:18:42.307 "auth": { 00:18:42.307 "state": "completed", 00:18:42.307 "digest": "sha512", 00:18:42.307 "dhgroup": "ffdhe6144" 00:18:42.307 } 00:18:42.307 } 00:18:42.307 ]' 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:42.307 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:42.566 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:42.566 13:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:43.498 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:43.498 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 3 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:43.756 13:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:44.321 00:18:44.321 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:44.321 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:44.321 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:44.579 { 00:18:44.579 "cntlid": 135, 00:18:44.579 "qid": 0, 00:18:44.579 "state": "enabled", 00:18:44.579 "thread": "nvmf_tgt_poll_group_000", 00:18:44.579 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:44.579 "listen_address": { 00:18:44.579 "trtype": "TCP", 00:18:44.579 "adrfam": "IPv4", 00:18:44.579 "traddr": "10.0.0.2", 00:18:44.579 "trsvcid": "4420" 00:18:44.579 }, 00:18:44.579 "peer_address": { 00:18:44.579 "trtype": "TCP", 00:18:44.579 "adrfam": "IPv4", 00:18:44.579 "traddr": "10.0.0.1", 00:18:44.579 "trsvcid": "46050" 00:18:44.579 }, 00:18:44.579 "auth": { 00:18:44.579 "state": "completed", 00:18:44.579 "digest": "sha512", 00:18:44.579 "dhgroup": "ffdhe6144" 00:18:44.579 } 00:18:44.579 } 00:18:44.579 ]' 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:44.579 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:44.836 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:44.836 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:44.836 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:45.093 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:45.093 13:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:46.025 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:46.025 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 0 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.283 13:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:46.283 13:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.283 13:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:46.283 13:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:46.283 13:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:47.215 00:18:47.215 13:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:47.216 13:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:47.216 13:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:47.474 { 00:18:47.474 "cntlid": 137, 00:18:47.474 "qid": 0, 00:18:47.474 "state": "enabled", 00:18:47.474 "thread": "nvmf_tgt_poll_group_000", 00:18:47.474 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:47.474 "listen_address": { 00:18:47.474 "trtype": "TCP", 00:18:47.474 "adrfam": "IPv4", 00:18:47.474 "traddr": "10.0.0.2", 00:18:47.474 "trsvcid": "4420" 00:18:47.474 }, 00:18:47.474 "peer_address": { 00:18:47.474 "trtype": "TCP", 00:18:47.474 "adrfam": "IPv4", 00:18:47.474 "traddr": "10.0.0.1", 00:18:47.474 "trsvcid": "46074" 00:18:47.474 }, 00:18:47.474 "auth": { 00:18:47.474 "state": "completed", 00:18:47.474 "digest": "sha512", 00:18:47.474 "dhgroup": "ffdhe8192" 00:18:47.474 } 00:18:47.474 } 00:18:47.474 ]' 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:47.474 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:47.731 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:47.731 13:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:48.664 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:48.664 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 1 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:48.922 13:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:49.854 00:18:49.854 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:49.854 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:49.854 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:49.854 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:49.854 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:49.854 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.854 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:50.111 { 00:18:50.111 "cntlid": 139, 00:18:50.111 "qid": 0, 00:18:50.111 "state": "enabled", 00:18:50.111 "thread": "nvmf_tgt_poll_group_000", 00:18:50.111 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:50.111 "listen_address": { 00:18:50.111 "trtype": "TCP", 00:18:50.111 "adrfam": "IPv4", 00:18:50.111 "traddr": "10.0.0.2", 00:18:50.111 "trsvcid": "4420" 00:18:50.111 }, 00:18:50.111 "peer_address": { 00:18:50.111 "trtype": "TCP", 00:18:50.111 "adrfam": "IPv4", 00:18:50.111 "traddr": "10.0.0.1", 00:18:50.111 "trsvcid": "34200" 00:18:50.111 }, 00:18:50.111 "auth": { 00:18:50.111 "state": "completed", 00:18:50.111 "digest": "sha512", 00:18:50.111 "dhgroup": "ffdhe8192" 00:18:50.111 } 00:18:50.111 } 00:18:50.111 ]' 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:50.111 13:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:50.368 13:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:50.369 13:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: --dhchap-ctrl-secret DHHC-1:02:NjkzYjM5Mjg3NTlmOGMxYzE4ZWMyNTI5YzRkYzMxZjlhYTJmYTUxZjkzZjU2Mzc5Ny5bUg==: 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:51.301 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:51.301 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 2 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:51.866 13:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:52.431 00:18:52.431 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:52.431 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:52.431 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:52.688 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:52.688 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:52.688 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:52.688 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:52.945 { 00:18:52.945 "cntlid": 141, 00:18:52.945 "qid": 0, 00:18:52.945 "state": "enabled", 00:18:52.945 "thread": "nvmf_tgt_poll_group_000", 00:18:52.945 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:52.945 "listen_address": { 00:18:52.945 "trtype": "TCP", 00:18:52.945 "adrfam": "IPv4", 00:18:52.945 "traddr": "10.0.0.2", 00:18:52.945 "trsvcid": "4420" 00:18:52.945 }, 00:18:52.945 "peer_address": { 00:18:52.945 "trtype": "TCP", 00:18:52.945 "adrfam": "IPv4", 00:18:52.945 "traddr": "10.0.0.1", 00:18:52.945 "trsvcid": "34222" 00:18:52.945 }, 00:18:52.945 "auth": { 00:18:52.945 "state": "completed", 00:18:52.945 "digest": "sha512", 00:18:52.945 "dhgroup": "ffdhe8192" 00:18:52.945 } 00:18:52.945 } 00:18:52.945 ]' 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:52.945 13:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:53.202 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:53.202 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:01:Y2I2NTBmZjZkZDljZTY4Y2UyYWI1NGZkNTUxYzNkZWaetKjh: 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:54.134 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:54.134 13:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 3 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:54.391 13:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:55.322 00:18:55.322 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:55.322 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:55.322 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:55.580 { 00:18:55.580 "cntlid": 143, 00:18:55.580 "qid": 0, 00:18:55.580 "state": "enabled", 00:18:55.580 "thread": "nvmf_tgt_poll_group_000", 00:18:55.580 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:55.580 "listen_address": { 00:18:55.580 "trtype": "TCP", 00:18:55.580 "adrfam": "IPv4", 00:18:55.580 "traddr": "10.0.0.2", 00:18:55.580 "trsvcid": "4420" 00:18:55.580 }, 00:18:55.580 "peer_address": { 00:18:55.580 "trtype": "TCP", 00:18:55.580 "adrfam": "IPv4", 00:18:55.580 "traddr": "10.0.0.1", 00:18:55.580 "trsvcid": "34246" 00:18:55.580 }, 00:18:55.580 "auth": { 00:18:55.580 "state": "completed", 00:18:55.580 "digest": "sha512", 00:18:55.580 "dhgroup": "ffdhe8192" 00:18:55.580 } 00:18:55.580 } 00:18:55.580 ]' 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:55.580 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:55.837 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:55.837 13:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:56.769 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s sha256,sha384,sha512 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:18:56.769 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@141 -- # connect_authenticate sha512 ffdhe8192 0 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:57.026 13:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:57.957 00:18:57.957 13:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:57.957 13:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:57.957 13:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:58.215 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:58.215 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:58.215 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.215 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:58.215 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.215 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:58.215 { 00:18:58.215 "cntlid": 145, 00:18:58.215 "qid": 0, 00:18:58.215 "state": "enabled", 00:18:58.215 "thread": "nvmf_tgt_poll_group_000", 00:18:58.215 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:18:58.215 "listen_address": { 00:18:58.215 "trtype": "TCP", 00:18:58.215 "adrfam": "IPv4", 00:18:58.215 "traddr": "10.0.0.2", 00:18:58.215 "trsvcid": "4420" 00:18:58.215 }, 00:18:58.215 "peer_address": { 00:18:58.215 "trtype": "TCP", 00:18:58.215 "adrfam": "IPv4", 00:18:58.215 "traddr": "10.0.0.1", 00:18:58.215 "trsvcid": "39410" 00:18:58.215 }, 00:18:58.215 "auth": { 00:18:58.215 "state": "completed", 00:18:58.215 "digest": "sha512", 00:18:58.215 "dhgroup": "ffdhe8192" 00:18:58.215 } 00:18:58.215 } 00:18:58.215 ]' 00:18:58.215 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:58.472 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:58.472 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:58.472 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:58.472 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:58.472 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:58.472 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:58.472 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:58.729 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:58.729 13:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:00:NDZmZGE5NzdmMzVjZWI5NWM4ZTY1YTk3OWVkZGZhZjRhMzg4ZTRhZGJmYTU0YTFmFyOEaQ==: --dhchap-ctrl-secret DHHC-1:03:M2NlZjY0NDIxNTBiM2EyNjhiNTIxYmU3MWFhOGYzYjQ5YjRmNjI3YjljNjlmODE3MTJjMTZlNDVlNDYxMWFiZA7DaN0=: 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:59.660 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@144 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@145 -- # NOT bdev_connect -b nvme0 --dhchap-key key2 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key2 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key2 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:18:59.660 13:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:19:00.224 request: 00:19:00.224 { 00:19:00.224 "name": "nvme0", 00:19:00.224 "trtype": "tcp", 00:19:00.224 "traddr": "10.0.0.2", 00:19:00.224 "adrfam": "ipv4", 00:19:00.224 "trsvcid": "4420", 00:19:00.225 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:00.225 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:00.225 "prchk_reftag": false, 00:19:00.225 "prchk_guard": false, 00:19:00.225 "hdgst": false, 00:19:00.225 "ddgst": false, 00:19:00.225 "dhchap_key": "key2", 00:19:00.225 "allow_unrecognized_csi": false, 00:19:00.225 "method": "bdev_nvme_attach_controller", 00:19:00.225 "req_id": 1 00:19:00.225 } 00:19:00.225 Got JSON-RPC error response 00:19:00.225 response: 00:19:00.225 { 00:19:00.225 "code": -5, 00:19:00.225 "message": "Input/output error" 00:19:00.225 } 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@146 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@149 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:19:00.482 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@150 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:19:00.483 13:29:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:19:01.416 request: 00:19:01.416 { 00:19:01.416 "name": "nvme0", 00:19:01.416 "trtype": "tcp", 00:19:01.416 "traddr": "10.0.0.2", 00:19:01.416 "adrfam": "ipv4", 00:19:01.416 "trsvcid": "4420", 00:19:01.416 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:01.416 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:01.416 "prchk_reftag": false, 00:19:01.416 "prchk_guard": false, 00:19:01.416 "hdgst": false, 00:19:01.416 "ddgst": false, 00:19:01.416 "dhchap_key": "key1", 00:19:01.416 "dhchap_ctrlr_key": "ckey2", 00:19:01.416 "allow_unrecognized_csi": false, 00:19:01.416 "method": "bdev_nvme_attach_controller", 00:19:01.416 "req_id": 1 00:19:01.416 } 00:19:01.416 Got JSON-RPC error response 00:19:01.416 response: 00:19:01.416 { 00:19:01.416 "code": -5, 00:19:01.416 "message": "Input/output error" 00:19:01.416 } 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@151 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@154 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@155 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:19:01.416 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:19:01.982 request: 00:19:01.982 { 00:19:01.982 "name": "nvme0", 00:19:01.982 "trtype": "tcp", 00:19:01.982 "traddr": "10.0.0.2", 00:19:01.982 "adrfam": "ipv4", 00:19:01.982 "trsvcid": "4420", 00:19:01.982 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:01.982 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:01.982 "prchk_reftag": false, 00:19:01.982 "prchk_guard": false, 00:19:01.982 "hdgst": false, 00:19:01.982 "ddgst": false, 00:19:01.982 "dhchap_key": "key1", 00:19:01.982 "dhchap_ctrlr_key": "ckey1", 00:19:01.982 "allow_unrecognized_csi": false, 00:19:01.982 "method": "bdev_nvme_attach_controller", 00:19:01.982 "req_id": 1 00:19:01.982 } 00:19:01.982 Got JSON-RPC error response 00:19:01.982 response: 00:19:01.982 { 00:19:01.982 "code": -5, 00:19:01.982 "message": "Input/output error" 00:19:01.982 } 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@156 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@159 -- # killprocess 627204 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 627204 ']' 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 627204 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:01.982 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 627204 00:19:02.240 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:19:02.240 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:19:02.240 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 627204' 00:19:02.240 killing process with pid 627204 00:19:02.240 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 627204 00:19:02.240 13:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 627204 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@160 -- # nvmfappstart --wait-for-rpc -L nvmf_auth 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=649874 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc -L nvmf_auth 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 649874 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 649874 ']' 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:02.499 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@161 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@163 -- # waitforlisten 649874 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 649874 ']' 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:02.756 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:02.756 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@164 -- # rpc_cmd 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.014 null0 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.v1z 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha512.wqc ]] 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.wqc 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.J0r 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha384.Zcn ]] 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.Zcn 00:19:03.014 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.015 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.272 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.272 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.3AX 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha256.Hef ]] 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.Hef 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.aIq 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n '' ]] 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@179 -- # connect_authenticate sha512 ffdhe8192 3 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:03.273 13:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:04.709 nvme0n1 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:04.709 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:19:04.968 { 00:19:04.968 "cntlid": 1, 00:19:04.968 "qid": 0, 00:19:04.968 "state": "enabled", 00:19:04.968 "thread": "nvmf_tgt_poll_group_000", 00:19:04.968 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:04.968 "listen_address": { 00:19:04.968 "trtype": "TCP", 00:19:04.968 "adrfam": "IPv4", 00:19:04.968 "traddr": "10.0.0.2", 00:19:04.968 "trsvcid": "4420" 00:19:04.968 }, 00:19:04.968 "peer_address": { 00:19:04.968 "trtype": "TCP", 00:19:04.968 "adrfam": "IPv4", 00:19:04.968 "traddr": "10.0.0.1", 00:19:04.968 "trsvcid": "39452" 00:19:04.968 }, 00:19:04.968 "auth": { 00:19:04.968 "state": "completed", 00:19:04.968 "digest": "sha512", 00:19:04.968 "dhgroup": "ffdhe8192" 00:19:04.968 } 00:19:04.968 } 00:19:04.968 ]' 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:04.968 13:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:05.226 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:19:05.226 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:19:06.159 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@182 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key3 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@183 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 00:19:06.159 13:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@184 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:06.417 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:06.675 request: 00:19:06.675 { 00:19:06.675 "name": "nvme0", 00:19:06.675 "trtype": "tcp", 00:19:06.675 "traddr": "10.0.0.2", 00:19:06.675 "adrfam": "ipv4", 00:19:06.675 "trsvcid": "4420", 00:19:06.675 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:06.675 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:06.675 "prchk_reftag": false, 00:19:06.675 "prchk_guard": false, 00:19:06.675 "hdgst": false, 00:19:06.675 "ddgst": false, 00:19:06.675 "dhchap_key": "key3", 00:19:06.675 "allow_unrecognized_csi": false, 00:19:06.675 "method": "bdev_nvme_attach_controller", 00:19:06.675 "req_id": 1 00:19:06.675 } 00:19:06.675 Got JSON-RPC error response 00:19:06.675 response: 00:19:06.675 { 00:19:06.675 "code": -5, 00:19:06.675 "message": "Input/output error" 00:19:06.675 } 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # IFS=, 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@188 -- # printf %s sha256,sha384,sha512 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # hostrpc bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:19:06.675 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@193 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:06.932 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:19:06.933 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:06.933 13:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:07.189 request: 00:19:07.189 { 00:19:07.189 "name": "nvme0", 00:19:07.189 "trtype": "tcp", 00:19:07.189 "traddr": "10.0.0.2", 00:19:07.189 "adrfam": "ipv4", 00:19:07.189 "trsvcid": "4420", 00:19:07.189 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:07.189 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:07.189 "prchk_reftag": false, 00:19:07.189 "prchk_guard": false, 00:19:07.189 "hdgst": false, 00:19:07.189 "ddgst": false, 00:19:07.189 "dhchap_key": "key3", 00:19:07.189 "allow_unrecognized_csi": false, 00:19:07.189 "method": "bdev_nvme_attach_controller", 00:19:07.189 "req_id": 1 00:19:07.189 } 00:19:07.189 Got JSON-RPC error response 00:19:07.189 response: 00:19:07.189 { 00:19:07.189 "code": -5, 00:19:07.189 "message": "Input/output error" 00:19:07.189 } 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s sha256,sha384,sha512 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:07.189 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@208 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@209 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@210 -- # NOT bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:07.752 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:08.009 request: 00:19:08.009 { 00:19:08.009 "name": "nvme0", 00:19:08.009 "trtype": "tcp", 00:19:08.009 "traddr": "10.0.0.2", 00:19:08.009 "adrfam": "ipv4", 00:19:08.009 "trsvcid": "4420", 00:19:08.009 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:08.009 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:08.009 "prchk_reftag": false, 00:19:08.009 "prchk_guard": false, 00:19:08.009 "hdgst": false, 00:19:08.009 "ddgst": false, 00:19:08.009 "dhchap_key": "key0", 00:19:08.009 "dhchap_ctrlr_key": "key1", 00:19:08.009 "allow_unrecognized_csi": false, 00:19:08.009 "method": "bdev_nvme_attach_controller", 00:19:08.009 "req_id": 1 00:19:08.009 } 00:19:08.009 Got JSON-RPC error response 00:19:08.009 response: 00:19:08.009 { 00:19:08.009 "code": -5, 00:19:08.009 "message": "Input/output error" 00:19:08.009 } 00:19:08.266 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:08.266 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:08.266 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:08.266 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:08.266 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@213 -- # bdev_connect -b nvme0 --dhchap-key key0 00:19:08.266 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:19:08.266 13:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:19:08.523 nvme0n1 00:19:08.523 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # hostrpc bdev_nvme_get_controllers 00:19:08.523 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # jq -r '.[].name' 00:19:08.523 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:08.780 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:08.780 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@215 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:08.780 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:09.038 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@218 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 00:19:09.038 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.038 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:09.038 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.038 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@219 -- # bdev_connect -b nvme0 --dhchap-key key1 00:19:09.038 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:09.038 13:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:10.422 nvme0n1 00:19:10.422 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # hostrpc bdev_nvme_get_controllers 00:19:10.422 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # jq -r '.[].name' 00:19:10.422 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@222 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # hostrpc bdev_nvme_get_controllers 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # jq -r '.[].name' 00:19:10.679 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:10.936 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:10.936 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@225 -- # nvme_connect --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:19:10.936 13:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.2 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --hostid cd6acfbe-4794-e311-a299-001e67a97b02 -l 0 --dhchap-secret DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: --dhchap-ctrl-secret DHHC-1:03:Y2NmNGY3ZTZlMWUyZGJkZGQ5OWJlZjhlMzZlZjBhMjYyOGNjZTAxMGVmNDA1MDE2NGIwNDAzNDM5NDM3MjdkNagCdCY=: 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nvme_get_ctrlr 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@41 -- # local dev 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@43 -- # for dev in /sys/devices/virtual/nvme-fabrics/ctl/nvme* 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # [[ nqn.2024-03.io.spdk:cnode0 == \n\q\n\.\2\0\2\4\-\0\3\.\i\o\.\s\p\d\k\:\c\n\o\d\e\0 ]] 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # echo nvme0 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # break 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nctrlr=nvme0 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@227 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:11.870 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@228 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:12.127 13:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:13.060 request: 00:19:13.060 { 00:19:13.060 "name": "nvme0", 00:19:13.060 "trtype": "tcp", 00:19:13.060 "traddr": "10.0.0.2", 00:19:13.060 "adrfam": "ipv4", 00:19:13.060 "trsvcid": "4420", 00:19:13.060 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:13.060 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02", 00:19:13.060 "prchk_reftag": false, 00:19:13.060 "prchk_guard": false, 00:19:13.060 "hdgst": false, 00:19:13.060 "ddgst": false, 00:19:13.060 "dhchap_key": "key1", 00:19:13.060 "allow_unrecognized_csi": false, 00:19:13.060 "method": "bdev_nvme_attach_controller", 00:19:13.060 "req_id": 1 00:19:13.060 } 00:19:13.060 Got JSON-RPC error response 00:19:13.060 response: 00:19:13.060 { 00:19:13.060 "code": -5, 00:19:13.060 "message": "Input/output error" 00:19:13.060 } 00:19:13.060 13:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:13.060 13:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:13.060 13:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:13.060 13:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:13.060 13:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@229 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:13.060 13:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:13.060 13:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:14.432 nvme0n1 00:19:14.432 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # hostrpc bdev_nvme_get_controllers 00:19:14.432 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # jq -r '.[].name' 00:19:14.432 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:14.432 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:14.432 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@231 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:14.432 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:14.690 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@233 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:14.690 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:14.690 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:14.690 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:14.690 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@234 -- # bdev_connect -b nvme0 00:19:14.690 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:19:14.690 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:19:15.255 nvme0n1 00:19:15.255 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # hostrpc bdev_nvme_get_controllers 00:19:15.255 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # jq -r '.[].name' 00:19:15.255 13:30:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:15.512 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:15.512 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@236 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:15.512 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@239 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@240 -- # nvme_set_keys nvme0 DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: '' 2s 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key=DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey= 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: ]] 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # echo DHHC-1:01:MTRlMTQzZTM1NmViNjA3MWFhYWRhMTYwNmE5Y2MxMzJdYWBU: 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z '' ]] 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:19:15.771 13:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@241 -- # waitforblk nvme0n1 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@243 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key1 --dhchap-ctrlr-key key2 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@244 -- # nvme_set_keys nvme0 '' DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: 2s 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key= 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey=DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z '' ]] 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: ]] 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # echo DHHC-1:02:MGNkYTdhMmIxNjg0ZmFmNWQ5Nzk3NjIyOGM3Y2M4OTBlNTJkNzBhZDc0ZGE1MzllFsYJHw==: 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:19:17.669 13:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@245 -- # waitforblk nvme0n1 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@246 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:19:20.212 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@249 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@250 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:20.212 13:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:21.145 nvme0n1 00:19:21.145 13:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@252 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:21.145 13:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.145 13:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:21.145 13:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.145 13:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@253 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:21.145 13:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:22.077 13:30:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # hostrpc bdev_nvme_get_controllers 00:19:22.077 13:30:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # jq -r '.[].name' 00:19:22.077 13:30:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:22.334 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:22.334 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@256 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:22.335 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.335 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:22.335 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.335 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@257 -- # hostrpc bdev_nvme_set_keys nvme0 00:19:22.335 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 00:19:22.594 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # hostrpc bdev_nvme_get_controllers 00:19:22.594 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # jq -r '.[].name' 00:19:22.594 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@260 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@261 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:22.852 13:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:23.784 request: 00:19:23.784 { 00:19:23.784 "name": "nvme0", 00:19:23.784 "dhchap_key": "key1", 00:19:23.784 "dhchap_ctrlr_key": "key3", 00:19:23.784 "method": "bdev_nvme_set_keys", 00:19:23.784 "req_id": 1 00:19:23.784 } 00:19:23.784 Got JSON-RPC error response 00:19:23.784 response: 00:19:23.784 { 00:19:23.784 "code": -13, 00:19:23.784 "message": "Permission denied" 00:19:23.784 } 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 1 != 0 )) 00:19:23.784 13:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@263 -- # sleep 1s 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 0 != 0 )) 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@267 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@268 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:25.157 13:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.2 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:26.530 nvme0n1 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@270 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@271 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:26.530 13:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:27.462 request: 00:19:27.462 { 00:19:27.462 "name": "nvme0", 00:19:27.462 "dhchap_key": "key2", 00:19:27.462 "dhchap_ctrlr_key": "key0", 00:19:27.462 "method": "bdev_nvme_set_keys", 00:19:27.462 "req_id": 1 00:19:27.462 } 00:19:27.462 Got JSON-RPC error response 00:19:27.462 response: 00:19:27.462 { 00:19:27.462 "code": -13, 00:19:27.462 "message": "Permission denied" 00:19:27.462 } 00:19:27.462 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:27.462 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:27.462 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:27.462 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:27.462 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:19:27.462 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:19:27.462 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:27.720 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 1 != 0 )) 00:19:27.720 13:30:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@273 -- # sleep 1s 00:19:28.652 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:19:28.652 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:19:28.652 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 0 != 0 )) 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@276 -- # trap - SIGINT SIGTERM EXIT 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@277 -- # cleanup 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@21 -- # killprocess 627248 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 627248 ']' 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 627248 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 627248 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 627248' 00:19:28.910 killing process with pid 627248 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 627248 00:19:28.910 13:30:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 627248 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@22 -- # nvmftestfini 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@121 -- # sync 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@124 -- # set +e 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:19:29.476 rmmod nvme_tcp 00:19:29.476 rmmod nvme_fabrics 00:19:29.476 rmmod nvme_keyring 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@128 -- # set -e 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@129 -- # return 0 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@515 -- # '[' -n 649874 ']' 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@516 -- # killprocess 649874 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 649874 ']' 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 649874 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 649874 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 649874' 00:19:29.476 killing process with pid 649874 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 649874 00:19:29.476 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 649874 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@297 -- # iptr 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-save 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-restore 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@302 -- # remove_spdk_ns 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:29.736 13:30:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@23 -- # rm -f /tmp/spdk.key-null.v1z /tmp/spdk.key-sha256.J0r /tmp/spdk.key-sha384.3AX /tmp/spdk.key-sha512.aIq /tmp/spdk.key-sha512.wqc /tmp/spdk.key-sha384.Zcn /tmp/spdk.key-sha256.Hef '' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvme-auth.log /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf-auth.log 00:19:32.275 00:19:32.275 real 3m30.482s 00:19:32.275 user 8m13.597s 00:19:32.275 sys 0m28.189s 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:32.275 ************************************ 00:19:32.275 END TEST nvmf_auth_target 00:19:32.275 ************************************ 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@39 -- # '[' tcp = tcp ']' 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@40 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:19:32.275 ************************************ 00:19:32.275 START TEST nvmf_bdevio_no_huge 00:19:32.275 ************************************ 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:32.275 * Looking for test storage... 00:19:32.275 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lcov --version 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@333 -- # local ver1 ver1_l 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@334 -- # local ver2 ver2_l 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # IFS=.-: 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # read -ra ver1 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # IFS=.-: 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # read -ra ver2 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@338 -- # local 'op=<' 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@340 -- # ver1_l=2 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@341 -- # ver2_l=1 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@344 -- # case "$op" in 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@345 -- # : 1 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v = 0 )) 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # decimal 1 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=1 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 1 00:19:32.275 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # ver1[v]=1 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # decimal 2 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=2 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 2 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # ver2[v]=2 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # return 0 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:19:32.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.276 --rc genhtml_branch_coverage=1 00:19:32.276 --rc genhtml_function_coverage=1 00:19:32.276 --rc genhtml_legend=1 00:19:32.276 --rc geninfo_all_blocks=1 00:19:32.276 --rc geninfo_unexecuted_blocks=1 00:19:32.276 00:19:32.276 ' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:19:32.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.276 --rc genhtml_branch_coverage=1 00:19:32.276 --rc genhtml_function_coverage=1 00:19:32.276 --rc genhtml_legend=1 00:19:32.276 --rc geninfo_all_blocks=1 00:19:32.276 --rc geninfo_unexecuted_blocks=1 00:19:32.276 00:19:32.276 ' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:19:32.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.276 --rc genhtml_branch_coverage=1 00:19:32.276 --rc genhtml_function_coverage=1 00:19:32.276 --rc genhtml_legend=1 00:19:32.276 --rc geninfo_all_blocks=1 00:19:32.276 --rc geninfo_unexecuted_blocks=1 00:19:32.276 00:19:32.276 ' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:19:32.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.276 --rc genhtml_branch_coverage=1 00:19:32.276 --rc genhtml_function_coverage=1 00:19:32.276 --rc genhtml_legend=1 00:19:32.276 --rc geninfo_all_blocks=1 00:19:32.276 --rc geninfo_unexecuted_blocks=1 00:19:32.276 00:19:32.276 ' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # uname -s 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@15 -- # shopt -s extglob 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@5 -- # export PATH 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@51 -- # : 0 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:19:32.276 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@55 -- # have_pci_nics=0 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@14 -- # nvmftestinit 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@474 -- # prepare_net_devs 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@436 -- # local -g is_hw=no 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@438 -- # remove_spdk_ns 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@309 -- # xtrace_disable 00:19:32.276 13:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@315 -- # pci_devs=() 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@315 -- # local -a pci_devs 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@316 -- # pci_net_devs=() 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@317 -- # pci_drivers=() 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@317 -- # local -A pci_drivers 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@319 -- # net_devs=() 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@319 -- # local -ga net_devs 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@320 -- # e810=() 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@320 -- # local -ga e810 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@321 -- # x722=() 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@321 -- # local -ga x722 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@322 -- # mlx=() 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@322 -- # local -ga mlx 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:19:34.190 Found 0000:84:00.0 (0x8086 - 0x159b) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:19:34.190 Found 0000:84:00.1 (0x8086 - 0x159b) 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.190 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:19:34.191 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:19:34.191 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:19:34.191 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:19:34.191 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:19:34.191 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.191 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:19:34.191 13:30:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@416 -- # [[ up == up ]] 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:19:34.191 Found net devices under 0000:84:00.0: cvl_0_0 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@416 -- # [[ up == up ]] 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:19:34.191 Found net devices under 0000:84:00.1: cvl_0_1 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@440 -- # is_hw=yes 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:34.191 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:19:34.450 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:34.450 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:19:34.450 00:19:34.450 --- 10.0.0.2 ping statistics --- 00:19:34.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.450 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:34.450 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:34.450 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:19:34.450 00:19:34.450 --- 10.0.0.1 ping statistics --- 00:19:34.450 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.450 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@448 -- # return 0 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@724 -- # xtrace_disable 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@507 -- # nvmfpid=655758 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@508 -- # waitforlisten 655758 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@831 -- # '[' -z 655758 ']' 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:34.450 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:34.451 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:34.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:34.451 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:34.451 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.451 [2024-10-07 13:30:30.217584] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:34.451 [2024-10-07 13:30:30.217680] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:34.451 [2024-10-07 13:30:30.296285] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:34.709 [2024-10-07 13:30:30.412750] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:34.709 [2024-10-07 13:30:30.412828] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:34.709 [2024-10-07 13:30:30.412842] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:34.709 [2024-10-07 13:30:30.412853] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:34.709 [2024-10-07 13:30:30.412863] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:34.709 [2024-10-07 13:30:30.414059] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:19:34.709 [2024-10-07 13:30:30.414126] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:19:34.709 [2024-10-07 13:30:30.414189] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:19:34.709 [2024-10-07 13:30:30.414192] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@864 -- # return 0 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@730 -- # xtrace_disable 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.709 [2024-10-07 13:30:30.570180] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.709 Malloc0 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.709 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:34.710 [2024-10-07 13:30:30.608103] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # config=() 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # local subsystem config 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:19:34.710 { 00:19:34.710 "params": { 00:19:34.710 "name": "Nvme$subsystem", 00:19:34.710 "trtype": "$TEST_TRANSPORT", 00:19:34.710 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:34.710 "adrfam": "ipv4", 00:19:34.710 "trsvcid": "$NVMF_PORT", 00:19:34.710 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:34.710 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:34.710 "hdgst": ${hdgst:-false}, 00:19:34.710 "ddgst": ${ddgst:-false} 00:19:34.710 }, 00:19:34.710 "method": "bdev_nvme_attach_controller" 00:19:34.710 } 00:19:34.710 EOF 00:19:34.710 )") 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # cat 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@582 -- # jq . 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@583 -- # IFS=, 00:19:34.710 13:30:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:19:34.710 "params": { 00:19:34.710 "name": "Nvme1", 00:19:34.710 "trtype": "tcp", 00:19:34.710 "traddr": "10.0.0.2", 00:19:34.710 "adrfam": "ipv4", 00:19:34.710 "trsvcid": "4420", 00:19:34.710 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.710 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:34.710 "hdgst": false, 00:19:34.710 "ddgst": false 00:19:34.710 }, 00:19:34.710 "method": "bdev_nvme_attach_controller" 00:19:34.710 }' 00:19:34.968 [2024-10-07 13:30:30.665820] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:34.968 [2024-10-07 13:30:30.665902] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid655830 ] 00:19:34.968 [2024-10-07 13:30:30.732319] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:34.968 [2024-10-07 13:30:30.849590] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:19:34.968 [2024-10-07 13:30:30.849649] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:19:34.968 [2024-10-07 13:30:30.849653] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:19:35.227 I/O targets: 00:19:35.227 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:35.227 00:19:35.227 00:19:35.227 CUnit - A unit testing framework for C - Version 2.1-3 00:19:35.227 http://cunit.sourceforge.net/ 00:19:35.227 00:19:35.227 00:19:35.227 Suite: bdevio tests on: Nvme1n1 00:19:35.227 Test: blockdev write read block ...passed 00:19:35.485 Test: blockdev write zeroes read block ...passed 00:19:35.485 Test: blockdev write zeroes read no split ...passed 00:19:35.485 Test: blockdev write zeroes read split ...passed 00:19:35.485 Test: blockdev write zeroes read split partial ...passed 00:19:35.485 Test: blockdev reset ...[2024-10-07 13:30:31.287056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:35.485 [2024-10-07 13:30:31.287178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb73d40 (9): Bad file descriptor 00:19:35.485 [2024-10-07 13:30:31.302883] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:35.485 passed 00:19:35.485 Test: blockdev write read 8 blocks ...passed 00:19:35.485 Test: blockdev write read size > 128k ...passed 00:19:35.485 Test: blockdev write read invalid size ...passed 00:19:35.485 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:35.485 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:35.485 Test: blockdev write read max offset ...passed 00:19:35.744 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:35.744 Test: blockdev writev readv 8 blocks ...passed 00:19:35.744 Test: blockdev writev readv 30 x 1block ...passed 00:19:35.744 Test: blockdev writev readv block ...passed 00:19:35.744 Test: blockdev writev readv size > 128k ...passed 00:19:35.744 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:35.744 Test: blockdev comparev and writev ...[2024-10-07 13:30:31.514071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.514106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.514132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.514149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.514477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.514511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.514535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.514552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.514867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.514891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.514913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.514929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.515242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.515266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.515294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:35.744 [2024-10-07 13:30:31.515311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:35.744 passed 00:19:35.744 Test: blockdev nvme passthru rw ...passed 00:19:35.744 Test: blockdev nvme passthru vendor specific ...[2024-10-07 13:30:31.597781] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.744 [2024-10-07 13:30:31.597822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.597979] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.744 [2024-10-07 13:30:31.598004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.598138] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.744 [2024-10-07 13:30:31.598161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:35.744 [2024-10-07 13:30:31.598295] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:35.744 [2024-10-07 13:30:31.598318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:35.744 passed 00:19:35.744 Test: blockdev nvme admin passthru ...passed 00:19:35.744 Test: blockdev copy ...passed 00:19:35.744 00:19:35.744 Run Summary: Type Total Ran Passed Failed Inactive 00:19:35.744 suites 1 1 n/a 0 0 00:19:35.744 tests 23 23 23 0 0 00:19:35.745 asserts 152 152 152 0 n/a 00:19:35.745 00:19:35.745 Elapsed time = 1.148 seconds 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@30 -- # nvmftestfini 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@514 -- # nvmfcleanup 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@121 -- # sync 00:19:36.310 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@124 -- # set +e 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@125 -- # for i in {1..20} 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:19:36.311 rmmod nvme_tcp 00:19:36.311 rmmod nvme_fabrics 00:19:36.311 rmmod nvme_keyring 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@128 -- # set -e 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@129 -- # return 0 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@515 -- # '[' -n 655758 ']' 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@516 -- # killprocess 655758 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@950 -- # '[' -z 655758 ']' 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@954 -- # kill -0 655758 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # uname 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 655758 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@968 -- # echo 'killing process with pid 655758' 00:19:36.311 killing process with pid 655758 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@969 -- # kill 655758 00:19:36.311 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@974 -- # wait 655758 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@297 -- # iptr 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-save 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-restore 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@302 -- # remove_spdk_ns 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:36.878 13:30:32 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:19:38.821 00:19:38.821 real 0m6.865s 00:19:38.821 user 0m11.292s 00:19:38.821 sys 0m2.718s 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1126 -- # xtrace_disable 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:38.821 ************************************ 00:19:38.821 END TEST nvmf_bdevio_no_huge 00:19:38.821 ************************************ 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@41 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:19:38.821 ************************************ 00:19:38.821 START TEST nvmf_tls 00:19:38.821 ************************************ 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:38.821 * Looking for test storage... 00:19:38.821 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lcov --version 00:19:38.821 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@333 -- # local ver1 ver1_l 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@334 -- # local ver2 ver2_l 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # IFS=.-: 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # read -ra ver1 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # IFS=.-: 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # read -ra ver2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@338 -- # local 'op=<' 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@340 -- # ver1_l=2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@341 -- # ver2_l=1 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@344 -- # case "$op" in 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@345 -- # : 1 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v = 0 )) 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # decimal 1 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=1 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 1 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # ver1[v]=1 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # decimal 2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # ver2[v]=2 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # return 0 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:19:39.106 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.106 --rc genhtml_branch_coverage=1 00:19:39.106 --rc genhtml_function_coverage=1 00:19:39.106 --rc genhtml_legend=1 00:19:39.106 --rc geninfo_all_blocks=1 00:19:39.106 --rc geninfo_unexecuted_blocks=1 00:19:39.106 00:19:39.106 ' 00:19:39.106 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:19:39.106 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.106 --rc genhtml_branch_coverage=1 00:19:39.106 --rc genhtml_function_coverage=1 00:19:39.106 --rc genhtml_legend=1 00:19:39.106 --rc geninfo_all_blocks=1 00:19:39.106 --rc geninfo_unexecuted_blocks=1 00:19:39.106 00:19:39.106 ' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:19:39.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.107 --rc genhtml_branch_coverage=1 00:19:39.107 --rc genhtml_function_coverage=1 00:19:39.107 --rc genhtml_legend=1 00:19:39.107 --rc geninfo_all_blocks=1 00:19:39.107 --rc geninfo_unexecuted_blocks=1 00:19:39.107 00:19:39.107 ' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:19:39.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.107 --rc genhtml_branch_coverage=1 00:19:39.107 --rc genhtml_function_coverage=1 00:19:39.107 --rc genhtml_legend=1 00:19:39.107 --rc geninfo_all_blocks=1 00:19:39.107 --rc geninfo_unexecuted_blocks=1 00:19:39.107 00:19:39.107 ' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # uname -s 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@15 -- # shopt -s extglob 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@5 -- # export PATH 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@51 -- # : 0 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:19:39.107 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@55 -- # have_pci_nics=0 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@63 -- # nvmftestinit 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@474 -- # prepare_net_devs 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@436 -- # local -g is_hw=no 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@438 -- # remove_spdk_ns 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@309 -- # xtrace_disable 00:19:39.107 13:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@315 -- # pci_devs=() 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@315 -- # local -a pci_devs 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@316 -- # pci_net_devs=() 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@317 -- # pci_drivers=() 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@317 -- # local -A pci_drivers 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@319 -- # net_devs=() 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@319 -- # local -ga net_devs 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@320 -- # e810=() 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@320 -- # local -ga e810 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@321 -- # x722=() 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@321 -- # local -ga x722 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@322 -- # mlx=() 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@322 -- # local -ga mlx 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:19:41.646 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:19:41.647 Found 0000:84:00.0 (0x8086 - 0x159b) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:19:41.647 Found 0000:84:00.1 (0x8086 - 0x159b) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@416 -- # [[ up == up ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:19:41.647 Found net devices under 0000:84:00.0: cvl_0_0 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@416 -- # [[ up == up ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:19:41.647 Found net devices under 0000:84:00.1: cvl_0_1 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@440 -- # is_hw=yes 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:19:41.647 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:41.647 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:19:41.647 00:19:41.647 --- 10.0.0.2 ping statistics --- 00:19:41.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.647 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:41.647 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:41.647 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:19:41.647 00:19:41.647 --- 10.0.0.1 ping statistics --- 00:19:41.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.647 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@448 -- # return 0 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@64 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=658009 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 658009 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 658009 ']' 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:41.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:41.647 [2024-10-07 13:30:37.257652] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:41.647 [2024-10-07 13:30:37.257740] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:41.647 [2024-10-07 13:30:37.323699] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:41.647 [2024-10-07 13:30:37.433608] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:41.647 [2024-10-07 13:30:37.433671] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:41.647 [2024-10-07 13:30:37.433685] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:41.647 [2024-10-07 13:30:37.433697] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:41.647 [2024-10-07 13:30:37.433707] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:41.647 [2024-10-07 13:30:37.434330] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:41.647 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:19:41.648 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:19:41.648 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:19:41.648 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:41.648 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:41.648 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@66 -- # '[' tcp '!=' tcp ']' 00:19:41.648 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:41.906 true 00:19:41.907 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:41.907 13:30:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # jq -r .tls_version 00:19:42.165 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # version=0 00:19:42.165 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@75 -- # [[ 0 != \0 ]] 00:19:42.165 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:42.423 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:42.423 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # jq -r .tls_version 00:19:42.681 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # version=13 00:19:42.681 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@83 -- # [[ 13 != \1\3 ]] 00:19:42.681 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:42.939 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:42.939 13:30:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # jq -r .tls_version 00:19:43.197 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # version=7 00:19:43.197 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@91 -- # [[ 7 != \7 ]] 00:19:43.198 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:43.198 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # jq -r .enable_ktls 00:19:43.456 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # ktls=false 00:19:43.456 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@98 -- # [[ false != \f\a\l\s\e ]] 00:19:43.456 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:43.729 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:43.729 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:44.296 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # ktls=true 00:19:44.296 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@106 -- # [[ true != \t\r\u\e ]] 00:19:44.296 13:30:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:44.296 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:44.296 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # ktls=false 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@114 -- # [[ false != \f\a\l\s\e ]] 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # format_interchange_psk 00112233445566778899aabbccddeeff 1 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 1 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:19:44.555 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 1 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 ffeeddccbbaa99887766554433221100 1 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=ffeeddccbbaa99887766554433221100 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # mktemp 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # key_path=/tmp/tmp.ZNGxsxQrO2 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # mktemp 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # key_2_path=/tmp/tmp.QYwXpjQkLs 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@125 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@126 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@128 -- # chmod 0600 /tmp/tmp.ZNGxsxQrO2 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@129 -- # chmod 0600 /tmp/tmp.QYwXpjQkLs 00:19:44.814 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:45.072 13:30:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@132 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:45.330 13:30:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@134 -- # setup_nvmf_tgt /tmp/tmp.ZNGxsxQrO2 00:19:45.330 13:30:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.ZNGxsxQrO2 00:19:45.330 13:30:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:45.896 [2024-10-07 13:30:41.540310] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:45.896 13:30:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:45.896 13:30:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:46.154 [2024-10-07 13:30:42.081823] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:46.154 [2024-10-07 13:30:42.082143] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:46.413 13:30:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:46.671 malloc0 00:19:46.671 13:30:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:46.930 13:30:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.ZNGxsxQrO2 00:19:47.188 13:30:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:19:47.448 13:30:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@138 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /tmp/tmp.ZNGxsxQrO2 00:19:57.443 Initializing NVMe Controllers 00:19:57.443 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:57.443 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:57.443 Initialization complete. Launching workers. 00:19:57.443 ======================================================== 00:19:57.443 Latency(us) 00:19:57.443 Device Information : IOPS MiB/s Average min max 00:19:57.443 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8611.06 33.64 7433.68 1069.73 10099.65 00:19:57.443 ======================================================== 00:19:57.443 Total : 8611.06 33.64 7433.68 1069.73 10099.65 00:19:57.443 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@144 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.ZNGxsxQrO2 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.ZNGxsxQrO2 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=659933 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 659933 /var/tmp/bdevperf.sock 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 659933 ']' 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:57.443 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:57.443 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:57.702 [2024-10-07 13:30:53.378049] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:57.702 [2024-10-07 13:30:53.378138] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid659933 ] 00:19:57.702 [2024-10-07 13:30:53.436669] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:57.702 [2024-10-07 13:30:53.542161] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:19:57.964 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:57.964 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:19:57.964 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ZNGxsxQrO2 00:19:58.222 13:30:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:19:58.480 [2024-10-07 13:30:54.247979] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:58.480 TLSTESTn1 00:19:58.480 13:30:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:58.741 Running I/O for 10 seconds... 00:20:00.618 3476.00 IOPS, 13.58 MiB/s [2024-10-07T11:30:57.488Z] 3590.50 IOPS, 14.03 MiB/s [2024-10-07T11:30:58.868Z] 3577.33 IOPS, 13.97 MiB/s [2024-10-07T11:30:59.810Z] 3572.75 IOPS, 13.96 MiB/s [2024-10-07T11:31:00.750Z] 3559.20 IOPS, 13.90 MiB/s [2024-10-07T11:31:01.690Z] 3535.33 IOPS, 13.81 MiB/s [2024-10-07T11:31:02.634Z] 3524.57 IOPS, 13.77 MiB/s [2024-10-07T11:31:03.587Z] 3520.88 IOPS, 13.75 MiB/s [2024-10-07T11:31:04.524Z] 3517.33 IOPS, 13.74 MiB/s [2024-10-07T11:31:04.524Z] 3528.70 IOPS, 13.78 MiB/s 00:20:08.591 Latency(us) 00:20:08.591 [2024-10-07T11:31:04.524Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:08.591 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:08.591 Verification LBA range: start 0x0 length 0x2000 00:20:08.591 TLSTESTn1 : 10.02 3533.28 13.80 0.00 0.00 36165.92 5679.79 39418.69 00:20:08.591 [2024-10-07T11:31:04.524Z] =================================================================================================================== 00:20:08.591 [2024-10-07T11:31:04.524Z] Total : 3533.28 13.80 0.00 0.00 36165.92 5679.79 39418.69 00:20:08.591 { 00:20:08.591 "results": [ 00:20:08.591 { 00:20:08.591 "job": "TLSTESTn1", 00:20:08.591 "core_mask": "0x4", 00:20:08.591 "workload": "verify", 00:20:08.591 "status": "finished", 00:20:08.591 "verify_range": { 00:20:08.591 "start": 0, 00:20:08.591 "length": 8192 00:20:08.591 }, 00:20:08.591 "queue_depth": 128, 00:20:08.591 "io_size": 4096, 00:20:08.591 "runtime": 10.023262, 00:20:08.591 "iops": 3533.280882012263, 00:20:08.591 "mibps": 13.801878445360403, 00:20:08.591 "io_failed": 0, 00:20:08.591 "io_timeout": 0, 00:20:08.591 "avg_latency_us": 36165.91794102729, 00:20:08.591 "min_latency_us": 5679.786666666667, 00:20:08.591 "max_latency_us": 39418.69037037037 00:20:08.591 } 00:20:08.591 ], 00:20:08.591 "core_count": 1 00:20:08.591 } 00:20:08.591 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:08.591 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 659933 00:20:08.591 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 659933 ']' 00:20:08.591 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 659933 00:20:08.591 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:08.591 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:08.591 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 659933 00:20:08.851 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:08.851 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:08.851 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 659933' 00:20:08.851 killing process with pid 659933 00:20:08.851 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 659933 00:20:08.851 Received shutdown signal, test time was about 10.000000 seconds 00:20:08.851 00:20:08.851 Latency(us) 00:20:08.851 [2024-10-07T11:31:04.784Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:08.851 [2024-10-07T11:31:04.784Z] =================================================================================================================== 00:20:08.851 [2024-10-07T11:31:04.784Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:08.851 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 659933 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@147 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.QYwXpjQkLs 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.QYwXpjQkLs 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.QYwXpjQkLs 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.QYwXpjQkLs 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=661364 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 661364 /var/tmp/bdevperf.sock 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 661364 ']' 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:09.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:09.110 13:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:09.110 [2024-10-07 13:31:04.845036] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:09.110 [2024-10-07 13:31:04.845111] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid661364 ] 00:20:09.110 [2024-10-07 13:31:04.901694] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:09.110 [2024-10-07 13:31:05.005283] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:09.367 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:09.367 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:09.367 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.QYwXpjQkLs 00:20:09.625 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:09.882 [2024-10-07 13:31:05.690436] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:09.882 [2024-10-07 13:31:05.696078] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:09.882 [2024-10-07 13:31:05.696648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16429e0 (107): Transport endpoint is not connected 00:20:09.882 [2024-10-07 13:31:05.697637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16429e0 (9): Bad file descriptor 00:20:09.883 [2024-10-07 13:31:05.698636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:09.883 [2024-10-07 13:31:05.698659] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:09.883 [2024-10-07 13:31:05.698675] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:20:09.883 [2024-10-07 13:31:05.698694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:09.883 request: 00:20:09.883 { 00:20:09.883 "name": "TLSTEST", 00:20:09.883 "trtype": "tcp", 00:20:09.883 "traddr": "10.0.0.2", 00:20:09.883 "adrfam": "ipv4", 00:20:09.883 "trsvcid": "4420", 00:20:09.883 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:09.883 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:09.883 "prchk_reftag": false, 00:20:09.883 "prchk_guard": false, 00:20:09.883 "hdgst": false, 00:20:09.883 "ddgst": false, 00:20:09.883 "psk": "key0", 00:20:09.883 "allow_unrecognized_csi": false, 00:20:09.883 "method": "bdev_nvme_attach_controller", 00:20:09.883 "req_id": 1 00:20:09.883 } 00:20:09.883 Got JSON-RPC error response 00:20:09.883 response: 00:20:09.883 { 00:20:09.883 "code": -5, 00:20:09.883 "message": "Input/output error" 00:20:09.883 } 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 661364 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 661364 ']' 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 661364 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 661364 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 661364' 00:20:09.883 killing process with pid 661364 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 661364 00:20:09.883 Received shutdown signal, test time was about 10.000000 seconds 00:20:09.883 00:20:09.883 Latency(us) 00:20:09.883 [2024-10-07T11:31:05.816Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:09.883 [2024-10-07T11:31:05.816Z] =================================================================================================================== 00:20:09.883 [2024-10-07T11:31:05.816Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:09.883 13:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 661364 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@150 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.ZNGxsxQrO2 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.ZNGxsxQrO2 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.ZNGxsxQrO2 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.ZNGxsxQrO2 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=661505 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 661505 /var/tmp/bdevperf.sock 00:20:10.141 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 661505 ']' 00:20:10.142 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:10.142 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:10.142 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:10.142 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:10.142 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:10.142 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:10.142 [2024-10-07 13:31:06.067168] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:10.142 [2024-10-07 13:31:06.067245] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid661505 ] 00:20:10.402 [2024-10-07 13:31:06.125830] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:10.402 [2024-10-07 13:31:06.234048] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:10.662 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:10.662 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:10.662 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ZNGxsxQrO2 00:20:10.920 13:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk key0 00:20:11.181 [2024-10-07 13:31:06.978621] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:11.181 [2024-10-07 13:31:06.989035] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:11.181 [2024-10-07 13:31:06.989063] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:11.181 [2024-10-07 13:31:06.989119] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:11.181 [2024-10-07 13:31:06.989895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x248a9e0 (107): Transport endpoint is not connected 00:20:11.181 [2024-10-07 13:31:06.990885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x248a9e0 (9): Bad file descriptor 00:20:11.181 [2024-10-07 13:31:06.991886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:11.181 [2024-10-07 13:31:06.991905] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:11.181 [2024-10-07 13:31:06.991934] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:20:11.181 [2024-10-07 13:31:06.991953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:11.181 request: 00:20:11.181 { 00:20:11.181 "name": "TLSTEST", 00:20:11.181 "trtype": "tcp", 00:20:11.181 "traddr": "10.0.0.2", 00:20:11.181 "adrfam": "ipv4", 00:20:11.181 "trsvcid": "4420", 00:20:11.181 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:11.181 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:11.181 "prchk_reftag": false, 00:20:11.181 "prchk_guard": false, 00:20:11.181 "hdgst": false, 00:20:11.181 "ddgst": false, 00:20:11.181 "psk": "key0", 00:20:11.181 "allow_unrecognized_csi": false, 00:20:11.181 "method": "bdev_nvme_attach_controller", 00:20:11.181 "req_id": 1 00:20:11.181 } 00:20:11.181 Got JSON-RPC error response 00:20:11.181 response: 00:20:11.181 { 00:20:11.181 "code": -5, 00:20:11.181 "message": "Input/output error" 00:20:11.181 } 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 661505 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 661505 ']' 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 661505 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 661505 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 661505' 00:20:11.181 killing process with pid 661505 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 661505 00:20:11.181 Received shutdown signal, test time was about 10.000000 seconds 00:20:11.181 00:20:11.181 Latency(us) 00:20:11.181 [2024-10-07T11:31:07.114Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:11.181 [2024-10-07T11:31:07.114Z] =================================================================================================================== 00:20:11.181 [2024-10-07T11:31:07.114Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:11.181 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 661505 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@153 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.ZNGxsxQrO2 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.ZNGxsxQrO2 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.ZNGxsxQrO2 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.ZNGxsxQrO2 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=661650 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 661650 /var/tmp/bdevperf.sock 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 661650 ']' 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:11.441 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:11.441 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:11.441 [2024-10-07 13:31:07.367146] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:11.441 [2024-10-07 13:31:07.367219] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid661650 ] 00:20:11.701 [2024-10-07 13:31:07.426378] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:11.701 [2024-10-07 13:31:07.533551] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:11.959 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:11.959 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:11.959 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ZNGxsxQrO2 00:20:12.218 13:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:12.478 [2024-10-07 13:31:08.253695] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:12.478 [2024-10-07 13:31:08.262300] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:12.478 [2024-10-07 13:31:08.262329] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:12.478 [2024-10-07 13:31:08.262382] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:12.478 [2024-10-07 13:31:08.262930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaf99e0 (107): Transport endpoint is not connected 00:20:12.478 [2024-10-07 13:31:08.263918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaf99e0 (9): Bad file descriptor 00:20:12.478 [2024-10-07 13:31:08.264918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:12.478 [2024-10-07 13:31:08.264937] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:12.478 [2024-10-07 13:31:08.264966] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode2, Operation not permitted 00:20:12.478 [2024-10-07 13:31:08.264986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:12.478 request: 00:20:12.478 { 00:20:12.478 "name": "TLSTEST", 00:20:12.478 "trtype": "tcp", 00:20:12.478 "traddr": "10.0.0.2", 00:20:12.478 "adrfam": "ipv4", 00:20:12.478 "trsvcid": "4420", 00:20:12.478 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:12.478 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:12.478 "prchk_reftag": false, 00:20:12.478 "prchk_guard": false, 00:20:12.478 "hdgst": false, 00:20:12.478 "ddgst": false, 00:20:12.478 "psk": "key0", 00:20:12.478 "allow_unrecognized_csi": false, 00:20:12.478 "method": "bdev_nvme_attach_controller", 00:20:12.478 "req_id": 1 00:20:12.478 } 00:20:12.478 Got JSON-RPC error response 00:20:12.478 response: 00:20:12.478 { 00:20:12.478 "code": -5, 00:20:12.478 "message": "Input/output error" 00:20:12.478 } 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 661650 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 661650 ']' 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 661650 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 661650 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 661650' 00:20:12.478 killing process with pid 661650 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 661650 00:20:12.478 Received shutdown signal, test time was about 10.000000 seconds 00:20:12.478 00:20:12.478 Latency(us) 00:20:12.478 [2024-10-07T11:31:08.411Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.478 [2024-10-07T11:31:08.411Z] =================================================================================================================== 00:20:12.478 [2024-10-07T11:31:08.411Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:12.478 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 661650 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@156 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk= 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:12.736 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=661791 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 661791 /var/tmp/bdevperf.sock 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 661791 ']' 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:12.737 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:12.737 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:12.737 [2024-10-07 13:31:08.641479] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:12.737 [2024-10-07 13:31:08.641572] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid661791 ] 00:20:12.994 [2024-10-07 13:31:08.700004] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:12.994 [2024-10-07 13:31:08.802516] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:12.994 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:12.994 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:12.994 13:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 '' 00:20:13.561 [2024-10-07 13:31:09.209060] keyring.c: 24:keyring_file_check_path: *ERROR*: Non-absolute paths are not allowed: 00:20:13.561 [2024-10-07 13:31:09.209101] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:20:13.561 request: 00:20:13.561 { 00:20:13.561 "name": "key0", 00:20:13.561 "path": "", 00:20:13.561 "method": "keyring_file_add_key", 00:20:13.561 "req_id": 1 00:20:13.561 } 00:20:13.561 Got JSON-RPC error response 00:20:13.561 response: 00:20:13.561 { 00:20:13.561 "code": -1, 00:20:13.561 "message": "Operation not permitted" 00:20:13.561 } 00:20:13.561 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:13.561 [2024-10-07 13:31:09.481908] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:13.561 [2024-10-07 13:31:09.481971] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:20:13.561 request: 00:20:13.561 { 00:20:13.561 "name": "TLSTEST", 00:20:13.561 "trtype": "tcp", 00:20:13.561 "traddr": "10.0.0.2", 00:20:13.561 "adrfam": "ipv4", 00:20:13.561 "trsvcid": "4420", 00:20:13.561 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:13.561 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:13.561 "prchk_reftag": false, 00:20:13.561 "prchk_guard": false, 00:20:13.561 "hdgst": false, 00:20:13.561 "ddgst": false, 00:20:13.561 "psk": "key0", 00:20:13.561 "allow_unrecognized_csi": false, 00:20:13.561 "method": "bdev_nvme_attach_controller", 00:20:13.561 "req_id": 1 00:20:13.561 } 00:20:13.561 Got JSON-RPC error response 00:20:13.561 response: 00:20:13.561 { 00:20:13.561 "code": -126, 00:20:13.561 "message": "Required key not available" 00:20:13.561 } 00:20:13.818 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 661791 00:20:13.818 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 661791 ']' 00:20:13.818 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 661791 00:20:13.818 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:13.818 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:13.818 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 661791 00:20:13.819 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:13.819 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:13.819 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 661791' 00:20:13.819 killing process with pid 661791 00:20:13.819 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 661791 00:20:13.819 Received shutdown signal, test time was about 10.000000 seconds 00:20:13.819 00:20:13.819 Latency(us) 00:20:13.819 [2024-10-07T11:31:09.752Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:13.819 [2024-10-07T11:31:09.752Z] =================================================================================================================== 00:20:13.819 [2024-10-07T11:31:09.752Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:13.819 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 661791 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@159 -- # killprocess 658009 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 658009 ']' 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 658009 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 658009 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 658009' 00:20:14.076 killing process with pid 658009 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 658009 00:20:14.076 13:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 658009 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 2 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff0011223344556677 2 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=2 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # mktemp 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # key_long_path=/tmp/tmp.6wbBW5DnOI 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@162 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@163 -- # chmod 0600 /tmp/tmp.6wbBW5DnOI 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@164 -- # nvmfappstart -m 0x2 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=661944 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 661944 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 661944 ']' 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:14.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:14.334 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:14.334 [2024-10-07 13:31:10.218250] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:14.334 [2024-10-07 13:31:10.218333] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:14.592 [2024-10-07 13:31:10.288118] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.592 [2024-10-07 13:31:10.400202] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:14.593 [2024-10-07 13:31:10.400259] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:14.593 [2024-10-07 13:31:10.400288] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:14.593 [2024-10-07 13:31:10.400300] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:14.593 [2024-10-07 13:31:10.400310] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:14.593 [2024-10-07 13:31:10.401065] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:14.593 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:14.593 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:14.593 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:14.593 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:14.593 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:14.851 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:14.851 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@166 -- # setup_nvmf_tgt /tmp/tmp.6wbBW5DnOI 00:20:14.851 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.6wbBW5DnOI 00:20:14.851 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:15.109 [2024-10-07 13:31:10.787928] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:15.109 13:31:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:15.367 13:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:15.630 [2024-10-07 13:31:11.317362] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:15.630 [2024-10-07 13:31:11.317654] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:15.630 13:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:15.942 malloc0 00:20:15.942 13:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:16.227 13:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:16.485 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@168 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.6wbBW5DnOI 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.6wbBW5DnOI 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=662298 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 662298 /var/tmp/bdevperf.sock 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 662298 ']' 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:16.743 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:16.743 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:16.744 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:16.744 [2024-10-07 13:31:12.571779] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:16.744 [2024-10-07 13:31:12.571880] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid662298 ] 00:20:16.744 [2024-10-07 13:31:12.633220] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.002 [2024-10-07 13:31:12.743870] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:17.002 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:17.002 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:17.002 13:31:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:17.260 13:31:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:17.519 [2024-10-07 13:31:13.432350] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:17.778 TLSTESTn1 00:20:17.778 13:31:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:17.778 Running I/O for 10 seconds... 00:20:19.723 3637.00 IOPS, 14.21 MiB/s [2024-10-07T11:31:17.035Z] 3605.00 IOPS, 14.08 MiB/s [2024-10-07T11:31:17.977Z] 3613.67 IOPS, 14.12 MiB/s [2024-10-07T11:31:18.916Z] 3564.75 IOPS, 13.92 MiB/s [2024-10-07T11:31:19.856Z] 3556.00 IOPS, 13.89 MiB/s [2024-10-07T11:31:20.794Z] 3541.00 IOPS, 13.83 MiB/s [2024-10-07T11:31:21.729Z] 3542.14 IOPS, 13.84 MiB/s [2024-10-07T11:31:23.109Z] 3568.62 IOPS, 13.94 MiB/s [2024-10-07T11:31:23.677Z] 3568.89 IOPS, 13.94 MiB/s [2024-10-07T11:31:23.936Z] 3566.50 IOPS, 13.93 MiB/s 00:20:28.003 Latency(us) 00:20:28.003 [2024-10-07T11:31:23.936Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.003 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:28.003 Verification LBA range: start 0x0 length 0x2000 00:20:28.003 TLSTESTn1 : 10.02 3571.93 13.95 0.00 0.00 35777.10 6019.60 28544.57 00:20:28.003 [2024-10-07T11:31:23.936Z] =================================================================================================================== 00:20:28.003 [2024-10-07T11:31:23.936Z] Total : 3571.93 13.95 0.00 0.00 35777.10 6019.60 28544.57 00:20:28.003 { 00:20:28.003 "results": [ 00:20:28.003 { 00:20:28.003 "job": "TLSTESTn1", 00:20:28.003 "core_mask": "0x4", 00:20:28.003 "workload": "verify", 00:20:28.003 "status": "finished", 00:20:28.003 "verify_range": { 00:20:28.003 "start": 0, 00:20:28.003 "length": 8192 00:20:28.003 }, 00:20:28.003 "queue_depth": 128, 00:20:28.003 "io_size": 4096, 00:20:28.003 "runtime": 10.020357, 00:20:28.003 "iops": 3571.9286248982944, 00:20:28.003 "mibps": 13.952846191008963, 00:20:28.003 "io_failed": 0, 00:20:28.003 "io_timeout": 0, 00:20:28.003 "avg_latency_us": 35777.10196261527, 00:20:28.003 "min_latency_us": 6019.602962962963, 00:20:28.003 "max_latency_us": 28544.568888888887 00:20:28.003 } 00:20:28.003 ], 00:20:28.003 "core_count": 1 00:20:28.003 } 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 662298 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 662298 ']' 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 662298 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 662298 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 662298' 00:20:28.003 killing process with pid 662298 00:20:28.003 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 662298 00:20:28.003 Received shutdown signal, test time was about 10.000000 seconds 00:20:28.004 00:20:28.004 Latency(us) 00:20:28.004 [2024-10-07T11:31:23.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.004 [2024-10-07T11:31:23.937Z] =================================================================================================================== 00:20:28.004 [2024-10-07T11:31:23.937Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:28.004 13:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 662298 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@171 -- # chmod 0666 /tmp/tmp.6wbBW5DnOI 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@172 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.6wbBW5DnOI 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.6wbBW5DnOI 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.6wbBW5DnOI 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.6wbBW5DnOI 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=663673 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 663673 /var/tmp/bdevperf.sock 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 663673 ']' 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:28.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:28.262 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:28.262 [2024-10-07 13:31:24.073104] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:28.262 [2024-10-07 13:31:24.073180] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid663673 ] 00:20:28.262 [2024-10-07 13:31:24.132131] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:28.520 [2024-10-07 13:31:24.241315] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:28.520 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:28.520 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:28.520 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:28.778 [2024-10-07 13:31:24.609145] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.6wbBW5DnOI': 0100666 00:20:28.778 [2024-10-07 13:31:24.609206] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:20:28.778 request: 00:20:28.778 { 00:20:28.778 "name": "key0", 00:20:28.778 "path": "/tmp/tmp.6wbBW5DnOI", 00:20:28.778 "method": "keyring_file_add_key", 00:20:28.778 "req_id": 1 00:20:28.778 } 00:20:28.778 Got JSON-RPC error response 00:20:28.778 response: 00:20:28.778 { 00:20:28.778 "code": -1, 00:20:28.778 "message": "Operation not permitted" 00:20:28.778 } 00:20:28.778 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:29.036 [2024-10-07 13:31:24.873993] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:29.036 [2024-10-07 13:31:24.874061] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:20:29.036 request: 00:20:29.036 { 00:20:29.036 "name": "TLSTEST", 00:20:29.036 "trtype": "tcp", 00:20:29.036 "traddr": "10.0.0.2", 00:20:29.036 "adrfam": "ipv4", 00:20:29.036 "trsvcid": "4420", 00:20:29.036 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:29.036 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:29.036 "prchk_reftag": false, 00:20:29.036 "prchk_guard": false, 00:20:29.036 "hdgst": false, 00:20:29.036 "ddgst": false, 00:20:29.036 "psk": "key0", 00:20:29.036 "allow_unrecognized_csi": false, 00:20:29.036 "method": "bdev_nvme_attach_controller", 00:20:29.036 "req_id": 1 00:20:29.036 } 00:20:29.036 Got JSON-RPC error response 00:20:29.036 response: 00:20:29.036 { 00:20:29.036 "code": -126, 00:20:29.036 "message": "Required key not available" 00:20:29.036 } 00:20:29.036 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 663673 00:20:29.036 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 663673 ']' 00:20:29.036 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 663673 00:20:29.036 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:29.036 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:29.037 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 663673 00:20:29.037 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:29.037 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:29.037 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 663673' 00:20:29.037 killing process with pid 663673 00:20:29.037 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 663673 00:20:29.037 Received shutdown signal, test time was about 10.000000 seconds 00:20:29.037 00:20:29.037 Latency(us) 00:20:29.037 [2024-10-07T11:31:24.970Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:29.037 [2024-10-07T11:31:24.970Z] =================================================================================================================== 00:20:29.037 [2024-10-07T11:31:24.970Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:29.037 13:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 663673 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@175 -- # killprocess 661944 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 661944 ']' 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 661944 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:29.295 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 661944 00:20:29.555 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:29.555 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:29.555 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 661944' 00:20:29.555 killing process with pid 661944 00:20:29.555 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 661944 00:20:29.555 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 661944 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@176 -- # nvmfappstart -m 0x2 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=663833 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 663833 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 663833 ']' 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:29.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:29.815 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:29.815 [2024-10-07 13:31:25.573320] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:29.815 [2024-10-07 13:31:25.573401] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:29.815 [2024-10-07 13:31:25.643149] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.074 [2024-10-07 13:31:25.752598] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:30.074 [2024-10-07 13:31:25.752691] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:30.074 [2024-10-07 13:31:25.752707] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:30.074 [2024-10-07 13:31:25.752719] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:30.074 [2024-10-07 13:31:25.752730] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:30.074 [2024-10-07 13:31:25.753514] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@178 -- # NOT setup_nvmf_tgt /tmp/tmp.6wbBW5DnOI 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /tmp/tmp.6wbBW5DnOI 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /tmp/tmp.6wbBW5DnOI 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.6wbBW5DnOI 00:20:30.074 13:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:30.333 [2024-10-07 13:31:26.206405] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:30.333 13:31:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:30.899 13:31:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:30.900 [2024-10-07 13:31:26.779888] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:30.900 [2024-10-07 13:31:26.780142] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:30.900 13:31:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:31.158 malloc0 00:20:31.158 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:31.725 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:31.725 [2024-10-07 13:31:27.656768] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.6wbBW5DnOI': 0100666 00:20:31.725 [2024-10-07 13:31:27.656859] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:20:31.982 request: 00:20:31.982 { 00:20:31.982 "name": "key0", 00:20:31.982 "path": "/tmp/tmp.6wbBW5DnOI", 00:20:31.982 "method": "keyring_file_add_key", 00:20:31.983 "req_id": 1 00:20:31.983 } 00:20:31.983 Got JSON-RPC error response 00:20:31.983 response: 00:20:31.983 { 00:20:31.983 "code": -1, 00:20:31.983 "message": "Operation not permitted" 00:20:31.983 } 00:20:31.983 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:32.242 [2024-10-07 13:31:27.921558] tcp.c:3792:nvmf_tcp_subsystem_add_host: *ERROR*: Key 'key0' does not exist 00:20:32.242 [2024-10-07 13:31:27.921639] subsystem.c:1055:spdk_nvmf_subsystem_add_host_ext: *ERROR*: Unable to add host to TCP transport 00:20:32.242 request: 00:20:32.242 { 00:20:32.242 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:32.242 "host": "nqn.2016-06.io.spdk:host1", 00:20:32.242 "psk": "key0", 00:20:32.242 "method": "nvmf_subsystem_add_host", 00:20:32.242 "req_id": 1 00:20:32.242 } 00:20:32.242 Got JSON-RPC error response 00:20:32.242 response: 00:20:32.242 { 00:20:32.242 "code": -32603, 00:20:32.242 "message": "Internal error" 00:20:32.242 } 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@181 -- # killprocess 663833 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 663833 ']' 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 663833 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 663833 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 663833' 00:20:32.242 killing process with pid 663833 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 663833 00:20:32.242 13:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 663833 00:20:32.500 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@182 -- # chmod 0600 /tmp/tmp.6wbBW5DnOI 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@185 -- # nvmfappstart -m 0x2 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=664131 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 664131 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 664131 ']' 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:32.501 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:32.501 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:32.501 [2024-10-07 13:31:28.334835] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:32.501 [2024-10-07 13:31:28.334918] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:32.501 [2024-10-07 13:31:28.406960] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.759 [2024-10-07 13:31:28.517667] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:32.759 [2024-10-07 13:31:28.517744] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:32.759 [2024-10-07 13:31:28.517775] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:32.759 [2024-10-07 13:31:28.517788] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:32.759 [2024-10-07 13:31:28.517800] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:32.759 [2024-10-07 13:31:28.518477] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@186 -- # setup_nvmf_tgt /tmp/tmp.6wbBW5DnOI 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.6wbBW5DnOI 00:20:32.759 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:33.017 [2024-10-07 13:31:28.920900] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:33.017 13:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:33.585 13:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:33.844 [2024-10-07 13:31:29.530609] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:33.844 [2024-10-07 13:31:29.530908] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:33.844 13:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:34.104 malloc0 00:20:34.104 13:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:34.361 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:34.618 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@189 -- # bdevperf_pid=664541 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@188 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@191 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@192 -- # waitforlisten 664541 /var/tmp/bdevperf.sock 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 664541 ']' 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:34.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:34.876 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:34.877 13:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:35.134 [2024-10-07 13:31:30.839538] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:35.134 [2024-10-07 13:31:30.839612] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid664541 ] 00:20:35.134 [2024-10-07 13:31:30.896815] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.134 [2024-10-07 13:31:31.007308] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:35.392 13:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:35.392 13:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:35.392 13:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@193 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:35.651 13:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@194 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:35.909 [2024-10-07 13:31:31.619310] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:35.909 TLSTESTn1 00:20:35.909 13:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:36.167 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # tgtconf='{ 00:20:36.167 "subsystems": [ 00:20:36.167 { 00:20:36.167 "subsystem": "keyring", 00:20:36.167 "config": [ 00:20:36.167 { 00:20:36.167 "method": "keyring_file_add_key", 00:20:36.167 "params": { 00:20:36.167 "name": "key0", 00:20:36.167 "path": "/tmp/tmp.6wbBW5DnOI" 00:20:36.167 } 00:20:36.167 } 00:20:36.167 ] 00:20:36.167 }, 00:20:36.167 { 00:20:36.167 "subsystem": "iobuf", 00:20:36.167 "config": [ 00:20:36.167 { 00:20:36.167 "method": "iobuf_set_options", 00:20:36.167 "params": { 00:20:36.167 "small_pool_count": 8192, 00:20:36.167 "large_pool_count": 1024, 00:20:36.167 "small_bufsize": 8192, 00:20:36.167 "large_bufsize": 135168 00:20:36.167 } 00:20:36.167 } 00:20:36.167 ] 00:20:36.167 }, 00:20:36.167 { 00:20:36.167 "subsystem": "sock", 00:20:36.167 "config": [ 00:20:36.167 { 00:20:36.167 "method": "sock_set_default_impl", 00:20:36.167 "params": { 00:20:36.167 "impl_name": "posix" 00:20:36.167 } 00:20:36.167 }, 00:20:36.167 { 00:20:36.167 "method": "sock_impl_set_options", 00:20:36.167 "params": { 00:20:36.167 "impl_name": "ssl", 00:20:36.167 "recv_buf_size": 4096, 00:20:36.167 "send_buf_size": 4096, 00:20:36.167 "enable_recv_pipe": true, 00:20:36.167 "enable_quickack": false, 00:20:36.167 "enable_placement_id": 0, 00:20:36.167 "enable_zerocopy_send_server": true, 00:20:36.167 "enable_zerocopy_send_client": false, 00:20:36.167 "zerocopy_threshold": 0, 00:20:36.167 "tls_version": 0, 00:20:36.167 "enable_ktls": false 00:20:36.167 } 00:20:36.167 }, 00:20:36.167 { 00:20:36.167 "method": "sock_impl_set_options", 00:20:36.167 "params": { 00:20:36.167 "impl_name": "posix", 00:20:36.167 "recv_buf_size": 2097152, 00:20:36.167 "send_buf_size": 2097152, 00:20:36.167 "enable_recv_pipe": true, 00:20:36.167 "enable_quickack": false, 00:20:36.167 "enable_placement_id": 0, 00:20:36.167 "enable_zerocopy_send_server": true, 00:20:36.167 "enable_zerocopy_send_client": false, 00:20:36.167 "zerocopy_threshold": 0, 00:20:36.167 "tls_version": 0, 00:20:36.167 "enable_ktls": false 00:20:36.167 } 00:20:36.167 } 00:20:36.167 ] 00:20:36.167 }, 00:20:36.167 { 00:20:36.167 "subsystem": "vmd", 00:20:36.167 "config": [] 00:20:36.167 }, 00:20:36.167 { 00:20:36.167 "subsystem": "accel", 00:20:36.167 "config": [ 00:20:36.167 { 00:20:36.167 "method": "accel_set_options", 00:20:36.167 "params": { 00:20:36.167 "small_cache_size": 128, 00:20:36.167 "large_cache_size": 16, 00:20:36.167 "task_count": 2048, 00:20:36.167 "sequence_count": 2048, 00:20:36.167 "buf_count": 2048 00:20:36.167 } 00:20:36.167 } 00:20:36.167 ] 00:20:36.167 }, 00:20:36.167 { 00:20:36.167 "subsystem": "bdev", 00:20:36.167 "config": [ 00:20:36.167 { 00:20:36.168 "method": "bdev_set_options", 00:20:36.168 "params": { 00:20:36.168 "bdev_io_pool_size": 65535, 00:20:36.168 "bdev_io_cache_size": 256, 00:20:36.168 "bdev_auto_examine": true, 00:20:36.168 "iobuf_small_cache_size": 128, 00:20:36.168 "iobuf_large_cache_size": 16 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "bdev_raid_set_options", 00:20:36.168 "params": { 00:20:36.168 "process_window_size_kb": 1024, 00:20:36.168 "process_max_bandwidth_mb_sec": 0 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "bdev_iscsi_set_options", 00:20:36.168 "params": { 00:20:36.168 "timeout_sec": 30 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "bdev_nvme_set_options", 00:20:36.168 "params": { 00:20:36.168 "action_on_timeout": "none", 00:20:36.168 "timeout_us": 0, 00:20:36.168 "timeout_admin_us": 0, 00:20:36.168 "keep_alive_timeout_ms": 10000, 00:20:36.168 "arbitration_burst": 0, 00:20:36.168 "low_priority_weight": 0, 00:20:36.168 "medium_priority_weight": 0, 00:20:36.168 "high_priority_weight": 0, 00:20:36.168 "nvme_adminq_poll_period_us": 10000, 00:20:36.168 "nvme_ioq_poll_period_us": 0, 00:20:36.168 "io_queue_requests": 0, 00:20:36.168 "delay_cmd_submit": true, 00:20:36.168 "transport_retry_count": 4, 00:20:36.168 "bdev_retry_count": 3, 00:20:36.168 "transport_ack_timeout": 0, 00:20:36.168 "ctrlr_loss_timeout_sec": 0, 00:20:36.168 "reconnect_delay_sec": 0, 00:20:36.168 "fast_io_fail_timeout_sec": 0, 00:20:36.168 "disable_auto_failback": false, 00:20:36.168 "generate_uuids": false, 00:20:36.168 "transport_tos": 0, 00:20:36.168 "nvme_error_stat": false, 00:20:36.168 "rdma_srq_size": 0, 00:20:36.168 "io_path_stat": false, 00:20:36.168 "allow_accel_sequence": false, 00:20:36.168 "rdma_max_cq_size": 0, 00:20:36.168 "rdma_cm_event_timeout_ms": 0, 00:20:36.168 "dhchap_digests": [ 00:20:36.168 "sha256", 00:20:36.168 "sha384", 00:20:36.168 "sha512" 00:20:36.168 ], 00:20:36.168 "dhchap_dhgroups": [ 00:20:36.168 "null", 00:20:36.168 "ffdhe2048", 00:20:36.168 "ffdhe3072", 00:20:36.168 "ffdhe4096", 00:20:36.168 "ffdhe6144", 00:20:36.168 "ffdhe8192" 00:20:36.168 ] 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "bdev_nvme_set_hotplug", 00:20:36.168 "params": { 00:20:36.168 "period_us": 100000, 00:20:36.168 "enable": false 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "bdev_malloc_create", 00:20:36.168 "params": { 00:20:36.168 "name": "malloc0", 00:20:36.168 "num_blocks": 8192, 00:20:36.168 "block_size": 4096, 00:20:36.168 "physical_block_size": 4096, 00:20:36.168 "uuid": "4fbbb787-e65d-474b-8c86-daf7a0f3f2dc", 00:20:36.168 "optimal_io_boundary": 0, 00:20:36.168 "md_size": 0, 00:20:36.168 "dif_type": 0, 00:20:36.168 "dif_is_head_of_md": false, 00:20:36.168 "dif_pi_format": 0 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "bdev_wait_for_examine" 00:20:36.168 } 00:20:36.168 ] 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "subsystem": "nbd", 00:20:36.168 "config": [] 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "subsystem": "scheduler", 00:20:36.168 "config": [ 00:20:36.168 { 00:20:36.168 "method": "framework_set_scheduler", 00:20:36.168 "params": { 00:20:36.168 "name": "static" 00:20:36.168 } 00:20:36.168 } 00:20:36.168 ] 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "subsystem": "nvmf", 00:20:36.168 "config": [ 00:20:36.168 { 00:20:36.168 "method": "nvmf_set_config", 00:20:36.168 "params": { 00:20:36.168 "discovery_filter": "match_any", 00:20:36.168 "admin_cmd_passthru": { 00:20:36.168 "identify_ctrlr": false 00:20:36.168 }, 00:20:36.168 "dhchap_digests": [ 00:20:36.168 "sha256", 00:20:36.168 "sha384", 00:20:36.168 "sha512" 00:20:36.168 ], 00:20:36.168 "dhchap_dhgroups": [ 00:20:36.168 "null", 00:20:36.168 "ffdhe2048", 00:20:36.168 "ffdhe3072", 00:20:36.168 "ffdhe4096", 00:20:36.168 "ffdhe6144", 00:20:36.168 "ffdhe8192" 00:20:36.168 ] 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "nvmf_set_max_subsystems", 00:20:36.168 "params": { 00:20:36.168 "max_subsystems": 1024 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "nvmf_set_crdt", 00:20:36.168 "params": { 00:20:36.168 "crdt1": 0, 00:20:36.168 "crdt2": 0, 00:20:36.168 "crdt3": 0 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "nvmf_create_transport", 00:20:36.168 "params": { 00:20:36.168 "trtype": "TCP", 00:20:36.168 "max_queue_depth": 128, 00:20:36.168 "max_io_qpairs_per_ctrlr": 127, 00:20:36.168 "in_capsule_data_size": 4096, 00:20:36.168 "max_io_size": 131072, 00:20:36.168 "io_unit_size": 131072, 00:20:36.168 "max_aq_depth": 128, 00:20:36.168 "num_shared_buffers": 511, 00:20:36.168 "buf_cache_size": 4294967295, 00:20:36.168 "dif_insert_or_strip": false, 00:20:36.168 "zcopy": false, 00:20:36.168 "c2h_success": false, 00:20:36.168 "sock_priority": 0, 00:20:36.168 "abort_timeout_sec": 1, 00:20:36.168 "ack_timeout": 0, 00:20:36.168 "data_wr_pool_size": 0 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "nvmf_create_subsystem", 00:20:36.168 "params": { 00:20:36.168 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.168 "allow_any_host": false, 00:20:36.168 "serial_number": "SPDK00000000000001", 00:20:36.168 "model_number": "SPDK bdev Controller", 00:20:36.168 "max_namespaces": 10, 00:20:36.168 "min_cntlid": 1, 00:20:36.168 "max_cntlid": 65519, 00:20:36.168 "ana_reporting": false 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "nvmf_subsystem_add_host", 00:20:36.168 "params": { 00:20:36.168 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.168 "host": "nqn.2016-06.io.spdk:host1", 00:20:36.168 "psk": "key0" 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "nvmf_subsystem_add_ns", 00:20:36.168 "params": { 00:20:36.168 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.168 "namespace": { 00:20:36.168 "nsid": 1, 00:20:36.168 "bdev_name": "malloc0", 00:20:36.168 "nguid": "4FBBB787E65D474B8C86DAF7A0F3F2DC", 00:20:36.168 "uuid": "4fbbb787-e65d-474b-8c86-daf7a0f3f2dc", 00:20:36.168 "no_auto_visible": false 00:20:36.168 } 00:20:36.168 } 00:20:36.168 }, 00:20:36.168 { 00:20:36.168 "method": "nvmf_subsystem_add_listener", 00:20:36.168 "params": { 00:20:36.168 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.168 "listen_address": { 00:20:36.168 "trtype": "TCP", 00:20:36.168 "adrfam": "IPv4", 00:20:36.168 "traddr": "10.0.0.2", 00:20:36.168 "trsvcid": "4420" 00:20:36.168 }, 00:20:36.168 "secure_channel": true 00:20:36.168 } 00:20:36.168 } 00:20:36.168 ] 00:20:36.168 } 00:20:36.168 ] 00:20:36.168 }' 00:20:36.168 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:36.735 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # bdevperfconf='{ 00:20:36.735 "subsystems": [ 00:20:36.735 { 00:20:36.735 "subsystem": "keyring", 00:20:36.735 "config": [ 00:20:36.735 { 00:20:36.735 "method": "keyring_file_add_key", 00:20:36.735 "params": { 00:20:36.735 "name": "key0", 00:20:36.735 "path": "/tmp/tmp.6wbBW5DnOI" 00:20:36.735 } 00:20:36.735 } 00:20:36.735 ] 00:20:36.735 }, 00:20:36.735 { 00:20:36.735 "subsystem": "iobuf", 00:20:36.735 "config": [ 00:20:36.735 { 00:20:36.735 "method": "iobuf_set_options", 00:20:36.735 "params": { 00:20:36.735 "small_pool_count": 8192, 00:20:36.735 "large_pool_count": 1024, 00:20:36.735 "small_bufsize": 8192, 00:20:36.735 "large_bufsize": 135168 00:20:36.735 } 00:20:36.735 } 00:20:36.735 ] 00:20:36.735 }, 00:20:36.735 { 00:20:36.735 "subsystem": "sock", 00:20:36.735 "config": [ 00:20:36.735 { 00:20:36.735 "method": "sock_set_default_impl", 00:20:36.735 "params": { 00:20:36.735 "impl_name": "posix" 00:20:36.735 } 00:20:36.735 }, 00:20:36.735 { 00:20:36.735 "method": "sock_impl_set_options", 00:20:36.735 "params": { 00:20:36.735 "impl_name": "ssl", 00:20:36.735 "recv_buf_size": 4096, 00:20:36.735 "send_buf_size": 4096, 00:20:36.735 "enable_recv_pipe": true, 00:20:36.735 "enable_quickack": false, 00:20:36.735 "enable_placement_id": 0, 00:20:36.735 "enable_zerocopy_send_server": true, 00:20:36.735 "enable_zerocopy_send_client": false, 00:20:36.735 "zerocopy_threshold": 0, 00:20:36.735 "tls_version": 0, 00:20:36.735 "enable_ktls": false 00:20:36.735 } 00:20:36.735 }, 00:20:36.735 { 00:20:36.736 "method": "sock_impl_set_options", 00:20:36.736 "params": { 00:20:36.736 "impl_name": "posix", 00:20:36.736 "recv_buf_size": 2097152, 00:20:36.736 "send_buf_size": 2097152, 00:20:36.736 "enable_recv_pipe": true, 00:20:36.736 "enable_quickack": false, 00:20:36.736 "enable_placement_id": 0, 00:20:36.736 "enable_zerocopy_send_server": true, 00:20:36.736 "enable_zerocopy_send_client": false, 00:20:36.736 "zerocopy_threshold": 0, 00:20:36.736 "tls_version": 0, 00:20:36.736 "enable_ktls": false 00:20:36.736 } 00:20:36.736 } 00:20:36.736 ] 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "subsystem": "vmd", 00:20:36.736 "config": [] 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "subsystem": "accel", 00:20:36.736 "config": [ 00:20:36.736 { 00:20:36.736 "method": "accel_set_options", 00:20:36.736 "params": { 00:20:36.736 "small_cache_size": 128, 00:20:36.736 "large_cache_size": 16, 00:20:36.736 "task_count": 2048, 00:20:36.736 "sequence_count": 2048, 00:20:36.736 "buf_count": 2048 00:20:36.736 } 00:20:36.736 } 00:20:36.736 ] 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "subsystem": "bdev", 00:20:36.736 "config": [ 00:20:36.736 { 00:20:36.736 "method": "bdev_set_options", 00:20:36.736 "params": { 00:20:36.736 "bdev_io_pool_size": 65535, 00:20:36.736 "bdev_io_cache_size": 256, 00:20:36.736 "bdev_auto_examine": true, 00:20:36.736 "iobuf_small_cache_size": 128, 00:20:36.736 "iobuf_large_cache_size": 16 00:20:36.736 } 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "method": "bdev_raid_set_options", 00:20:36.736 "params": { 00:20:36.736 "process_window_size_kb": 1024, 00:20:36.736 "process_max_bandwidth_mb_sec": 0 00:20:36.736 } 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "method": "bdev_iscsi_set_options", 00:20:36.736 "params": { 00:20:36.736 "timeout_sec": 30 00:20:36.736 } 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "method": "bdev_nvme_set_options", 00:20:36.736 "params": { 00:20:36.736 "action_on_timeout": "none", 00:20:36.736 "timeout_us": 0, 00:20:36.736 "timeout_admin_us": 0, 00:20:36.736 "keep_alive_timeout_ms": 10000, 00:20:36.736 "arbitration_burst": 0, 00:20:36.736 "low_priority_weight": 0, 00:20:36.736 "medium_priority_weight": 0, 00:20:36.736 "high_priority_weight": 0, 00:20:36.736 "nvme_adminq_poll_period_us": 10000, 00:20:36.736 "nvme_ioq_poll_period_us": 0, 00:20:36.736 "io_queue_requests": 512, 00:20:36.736 "delay_cmd_submit": true, 00:20:36.736 "transport_retry_count": 4, 00:20:36.736 "bdev_retry_count": 3, 00:20:36.736 "transport_ack_timeout": 0, 00:20:36.736 "ctrlr_loss_timeout_sec": 0, 00:20:36.736 "reconnect_delay_sec": 0, 00:20:36.736 "fast_io_fail_timeout_sec": 0, 00:20:36.736 "disable_auto_failback": false, 00:20:36.736 "generate_uuids": false, 00:20:36.736 "transport_tos": 0, 00:20:36.736 "nvme_error_stat": false, 00:20:36.736 "rdma_srq_size": 0, 00:20:36.736 "io_path_stat": false, 00:20:36.736 "allow_accel_sequence": false, 00:20:36.736 "rdma_max_cq_size": 0, 00:20:36.736 "rdma_cm_event_timeout_ms": 0, 00:20:36.736 "dhchap_digests": [ 00:20:36.736 "sha256", 00:20:36.736 "sha384", 00:20:36.736 "sha512" 00:20:36.736 ], 00:20:36.736 "dhchap_dhgroups": [ 00:20:36.736 "null", 00:20:36.736 "ffdhe2048", 00:20:36.736 "ffdhe3072", 00:20:36.736 "ffdhe4096", 00:20:36.736 "ffdhe6144", 00:20:36.736 "ffdhe8192" 00:20:36.736 ] 00:20:36.736 } 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "method": "bdev_nvme_attach_controller", 00:20:36.736 "params": { 00:20:36.736 "name": "TLSTEST", 00:20:36.736 "trtype": "TCP", 00:20:36.736 "adrfam": "IPv4", 00:20:36.736 "traddr": "10.0.0.2", 00:20:36.736 "trsvcid": "4420", 00:20:36.736 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.736 "prchk_reftag": false, 00:20:36.736 "prchk_guard": false, 00:20:36.736 "ctrlr_loss_timeout_sec": 0, 00:20:36.736 "reconnect_delay_sec": 0, 00:20:36.736 "fast_io_fail_timeout_sec": 0, 00:20:36.736 "psk": "key0", 00:20:36.736 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:36.736 "hdgst": false, 00:20:36.736 "ddgst": false, 00:20:36.736 "multipath": "multipath" 00:20:36.736 } 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "method": "bdev_nvme_set_hotplug", 00:20:36.736 "params": { 00:20:36.736 "period_us": 100000, 00:20:36.736 "enable": false 00:20:36.736 } 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "method": "bdev_wait_for_examine" 00:20:36.736 } 00:20:36.736 ] 00:20:36.736 }, 00:20:36.736 { 00:20:36.736 "subsystem": "nbd", 00:20:36.736 "config": [] 00:20:36.736 } 00:20:36.736 ] 00:20:36.736 }' 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@201 -- # killprocess 664541 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 664541 ']' 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 664541 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 664541 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 664541' 00:20:36.736 killing process with pid 664541 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 664541 00:20:36.736 Received shutdown signal, test time was about 10.000000 seconds 00:20:36.736 00:20:36.736 Latency(us) 00:20:36.736 [2024-10-07T11:31:32.669Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:36.736 [2024-10-07T11:31:32.669Z] =================================================================================================================== 00:20:36.736 [2024-10-07T11:31:32.669Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:36.736 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 664541 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@202 -- # killprocess 664131 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 664131 ']' 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 664131 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 664131 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 664131' 00:20:36.995 killing process with pid 664131 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 664131 00:20:36.995 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 664131 00:20:37.255 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:37.255 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:37.255 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # echo '{ 00:20:37.255 "subsystems": [ 00:20:37.255 { 00:20:37.255 "subsystem": "keyring", 00:20:37.255 "config": [ 00:20:37.255 { 00:20:37.255 "method": "keyring_file_add_key", 00:20:37.255 "params": { 00:20:37.255 "name": "key0", 00:20:37.255 "path": "/tmp/tmp.6wbBW5DnOI" 00:20:37.255 } 00:20:37.255 } 00:20:37.255 ] 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "subsystem": "iobuf", 00:20:37.255 "config": [ 00:20:37.255 { 00:20:37.255 "method": "iobuf_set_options", 00:20:37.255 "params": { 00:20:37.255 "small_pool_count": 8192, 00:20:37.255 "large_pool_count": 1024, 00:20:37.255 "small_bufsize": 8192, 00:20:37.255 "large_bufsize": 135168 00:20:37.255 } 00:20:37.255 } 00:20:37.255 ] 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "subsystem": "sock", 00:20:37.255 "config": [ 00:20:37.255 { 00:20:37.255 "method": "sock_set_default_impl", 00:20:37.255 "params": { 00:20:37.255 "impl_name": "posix" 00:20:37.255 } 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "method": "sock_impl_set_options", 00:20:37.255 "params": { 00:20:37.255 "impl_name": "ssl", 00:20:37.255 "recv_buf_size": 4096, 00:20:37.255 "send_buf_size": 4096, 00:20:37.255 "enable_recv_pipe": true, 00:20:37.255 "enable_quickack": false, 00:20:37.255 "enable_placement_id": 0, 00:20:37.255 "enable_zerocopy_send_server": true, 00:20:37.255 "enable_zerocopy_send_client": false, 00:20:37.255 "zerocopy_threshold": 0, 00:20:37.255 "tls_version": 0, 00:20:37.255 "enable_ktls": false 00:20:37.255 } 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "method": "sock_impl_set_options", 00:20:37.255 "params": { 00:20:37.255 "impl_name": "posix", 00:20:37.255 "recv_buf_size": 2097152, 00:20:37.255 "send_buf_size": 2097152, 00:20:37.255 "enable_recv_pipe": true, 00:20:37.255 "enable_quickack": false, 00:20:37.255 "enable_placement_id": 0, 00:20:37.255 "enable_zerocopy_send_server": true, 00:20:37.255 "enable_zerocopy_send_client": false, 00:20:37.255 "zerocopy_threshold": 0, 00:20:37.255 "tls_version": 0, 00:20:37.255 "enable_ktls": false 00:20:37.255 } 00:20:37.255 } 00:20:37.255 ] 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "subsystem": "vmd", 00:20:37.255 "config": [] 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "subsystem": "accel", 00:20:37.255 "config": [ 00:20:37.255 { 00:20:37.255 "method": "accel_set_options", 00:20:37.255 "params": { 00:20:37.255 "small_cache_size": 128, 00:20:37.255 "large_cache_size": 16, 00:20:37.255 "task_count": 2048, 00:20:37.255 "sequence_count": 2048, 00:20:37.255 "buf_count": 2048 00:20:37.255 } 00:20:37.255 } 00:20:37.255 ] 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "subsystem": "bdev", 00:20:37.255 "config": [ 00:20:37.255 { 00:20:37.255 "method": "bdev_set_options", 00:20:37.255 "params": { 00:20:37.255 "bdev_io_pool_size": 65535, 00:20:37.255 "bdev_io_cache_size": 256, 00:20:37.255 "bdev_auto_examine": true, 00:20:37.255 "iobuf_small_cache_size": 128, 00:20:37.255 "iobuf_large_cache_size": 16 00:20:37.255 } 00:20:37.255 }, 00:20:37.255 { 00:20:37.255 "method": "bdev_raid_set_options", 00:20:37.255 "params": { 00:20:37.255 "process_window_size_kb": 1024, 00:20:37.255 "process_max_bandwidth_mb_sec": 0 00:20:37.255 } 00:20:37.255 }, 00:20:37.255 { 00:20:37.256 "method": "bdev_iscsi_set_options", 00:20:37.256 "params": { 00:20:37.256 "timeout_sec": 30 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "bdev_nvme_set_options", 00:20:37.256 "params": { 00:20:37.256 "action_on_timeout": "none", 00:20:37.256 "timeout_us": 0, 00:20:37.256 "timeout_admin_us": 0, 00:20:37.256 "keep_alive_timeout_ms": 10000, 00:20:37.256 "arbitration_burst": 0, 00:20:37.256 "low_priority_weight": 0, 00:20:37.256 "medium_priority_weight": 0, 00:20:37.256 "high_priority_weight": 0, 00:20:37.256 "nvme_adminq_poll_period_us": 10000, 00:20:37.256 "nvme_ioq_poll_period_us": 0, 00:20:37.256 "io_queue_requests": 0, 00:20:37.256 "delay_cmd_submit": true, 00:20:37.256 "transport_retry_count": 4, 00:20:37.256 "bdev_retry_count": 3, 00:20:37.256 "transport_ack_timeout": 0, 00:20:37.256 "ctrlr_loss_timeout_sec": 0, 00:20:37.256 "reconnect_delay_sec": 0, 00:20:37.256 "fast_io_fail_timeout_sec": 0, 00:20:37.256 "disable_auto_failback": false, 00:20:37.256 "generate_uuids": false, 00:20:37.256 "transport_tos": 0, 00:20:37.256 "nvme_error_stat": false, 00:20:37.256 "rdma_srq_size": 0, 00:20:37.256 "io_path_stat": false, 00:20:37.256 "allow_accel_sequence": false, 00:20:37.256 "rdma_max_cq_size": 0, 00:20:37.256 "rdma_cm_event_timeout_ms": 0, 00:20:37.256 "dhchap_digests": [ 00:20:37.256 "sha256", 00:20:37.256 "sha384", 00:20:37.256 "sha512" 00:20:37.256 ], 00:20:37.256 "dhchap_dhgroups": [ 00:20:37.256 "null", 00:20:37.256 "ffdhe2048", 00:20:37.256 "ffdhe3072", 00:20:37.256 "ffdhe4096", 00:20:37.256 "ffdhe6144", 00:20:37.256 "ffdhe8192" 00:20:37.256 ] 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "bdev_nvme_set_hotplug", 00:20:37.256 "params": { 00:20:37.256 "period_us": 100000, 00:20:37.256 "enable": false 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "bdev_malloc_create", 00:20:37.256 "params": { 00:20:37.256 "name": "malloc0", 00:20:37.256 "num_blocks": 8192, 00:20:37.256 "block_size": 4096, 00:20:37.256 "physical_block_size": 4096, 00:20:37.256 "uuid": "4fbbb787-e65d-474b-8c86-daf7a0f3f2dc", 00:20:37.256 "optimal_io_boundary": 0, 00:20:37.256 "md_size": 0, 00:20:37.256 "dif_type": 0, 00:20:37.256 "dif_is_head_of_md": false, 00:20:37.256 "dif_pi_format": 0 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "bdev_wait_for_examine" 00:20:37.256 } 00:20:37.256 ] 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "subsystem": "nbd", 00:20:37.256 "config": [] 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "subsystem": "scheduler", 00:20:37.256 "config": [ 00:20:37.256 { 00:20:37.256 "method": "framework_set_scheduler", 00:20:37.256 "params": { 00:20:37.256 "name": "static" 00:20:37.256 } 00:20:37.256 } 00:20:37.256 ] 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "subsystem": "nvmf", 00:20:37.256 "config": [ 00:20:37.256 { 00:20:37.256 "method": "nvmf_set_config", 00:20:37.256 "params": { 00:20:37.256 "discovery_filter": "match_any", 00:20:37.256 "admin_cmd_passthru": { 00:20:37.256 "identify_ctrlr": false 00:20:37.256 }, 00:20:37.256 "dhchap_digests": [ 00:20:37.256 "sha256", 00:20:37.256 "sha384", 00:20:37.256 "sha512" 00:20:37.256 ], 00:20:37.256 "dhchap_dhgroups": [ 00:20:37.256 "null", 00:20:37.256 "ffdhe2048", 00:20:37.256 "ffdhe3072", 00:20:37.256 "ffdhe4096", 00:20:37.256 "ffdhe6144", 00:20:37.256 "ffdhe8192" 00:20:37.256 ] 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "nvmf_set_max_subsystems", 00:20:37.256 "params": { 00:20:37.256 "max_subsystems": 1024 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "nvmf_set_crdt", 00:20:37.256 "params": { 00:20:37.256 "crdt1": 0, 00:20:37.256 "crdt2": 0, 00:20:37.256 "crdt3": 0 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "nvmf_create_transport", 00:20:37.256 "params": { 00:20:37.256 "trtype": "TCP", 00:20:37.256 "max_queue_depth": 128, 00:20:37.256 "max_io_qpairs_per_ctrlr": 127, 00:20:37.256 "in_capsule_data_size": 4096, 00:20:37.256 "max_io_size": 131072, 00:20:37.256 "io_unit_size": 131072, 00:20:37.256 "max_aq_depth": 128, 00:20:37.256 "num_shared_buffers": 511, 00:20:37.256 "buf_cache_size": 4294967295, 00:20:37.256 "dif_insert_or_strip": false, 00:20:37.256 "zcopy": false, 00:20:37.256 "c2h_success": false, 00:20:37.256 "sock_priority": 0, 00:20:37.256 "abort_timeout_sec": 1, 00:20:37.256 "ack_timeout": 0, 00:20:37.256 "data_wr_pool_size": 0 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "nvmf_create_subsystem", 00:20:37.256 "params": { 00:20:37.256 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.256 "allow_any_host": false, 00:20:37.256 "serial_number": "SPDK00000000000001", 00:20:37.256 "model_number": "SPDK bdev Controller", 00:20:37.256 "max_namespaces": 10, 00:20:37.256 "min_cntlid": 1, 00:20:37.256 "max_cntlid": 65519, 00:20:37.256 "ana_reporting": false 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "nvmf_subsystem_add_host", 00:20:37.256 "params": { 00:20:37.256 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.256 "host": "nqn.2016-06.io.spdk:host1", 00:20:37.256 "psk": "key0" 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "nvmf_subsystem_add_ns", 00:20:37.256 "params": { 00:20:37.256 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.256 "namespace": { 00:20:37.256 "nsid": 1, 00:20:37.256 "bdev_name": "malloc0", 00:20:37.256 "nguid": "4FBBB787E65D474B8C86DAF7A0F3F2DC", 00:20:37.256 "uuid": "4fbbb787-e65d-474b-8c86-daf7a0f3f2dc", 00:20:37.256 "no_auto_visible": false 00:20:37.256 } 00:20:37.256 } 00:20:37.256 }, 00:20:37.256 { 00:20:37.256 "method": "nvmf_subsystem_add_listener", 00:20:37.256 "params": { 00:20:37.256 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.256 "listen_address": { 00:20:37.256 "trtype": "TCP", 00:20:37.256 "adrfam": "IPv4", 00:20:37.256 "traddr": "10.0.0.2", 00:20:37.256 "trsvcid": "4420" 00:20:37.256 }, 00:20:37.256 "secure_channel": true 00:20:37.256 } 00:20:37.256 } 00:20:37.256 ] 00:20:37.256 } 00:20:37.256 ] 00:20:37.256 }' 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=664779 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 664779 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 664779 ']' 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:37.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:37.256 13:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:37.256 [2024-10-07 13:31:33.025242] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:37.256 [2024-10-07 13:31:33.025308] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:37.256 [2024-10-07 13:31:33.086825] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:37.516 [2024-10-07 13:31:33.198203] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:37.516 [2024-10-07 13:31:33.198270] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:37.516 [2024-10-07 13:31:33.198308] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:37.516 [2024-10-07 13:31:33.198320] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:37.516 [2024-10-07 13:31:33.198330] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:37.516 [2024-10-07 13:31:33.199095] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:37.516 [2024-10-07 13:31:33.443614] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:37.776 [2024-10-07 13:31:33.475641] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:37.776 [2024-10-07 13:31:33.475938] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@209 -- # bdevperf_pid=664891 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@210 -- # waitforlisten 664891 /var/tmp/bdevperf.sock 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 664891 ']' 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:38.343 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:38.343 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # echo '{ 00:20:38.343 "subsystems": [ 00:20:38.343 { 00:20:38.343 "subsystem": "keyring", 00:20:38.343 "config": [ 00:20:38.343 { 00:20:38.343 "method": "keyring_file_add_key", 00:20:38.343 "params": { 00:20:38.343 "name": "key0", 00:20:38.343 "path": "/tmp/tmp.6wbBW5DnOI" 00:20:38.343 } 00:20:38.343 } 00:20:38.343 ] 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "subsystem": "iobuf", 00:20:38.343 "config": [ 00:20:38.343 { 00:20:38.343 "method": "iobuf_set_options", 00:20:38.343 "params": { 00:20:38.343 "small_pool_count": 8192, 00:20:38.343 "large_pool_count": 1024, 00:20:38.343 "small_bufsize": 8192, 00:20:38.343 "large_bufsize": 135168 00:20:38.343 } 00:20:38.343 } 00:20:38.343 ] 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "subsystem": "sock", 00:20:38.343 "config": [ 00:20:38.343 { 00:20:38.343 "method": "sock_set_default_impl", 00:20:38.343 "params": { 00:20:38.343 "impl_name": "posix" 00:20:38.343 } 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "method": "sock_impl_set_options", 00:20:38.343 "params": { 00:20:38.343 "impl_name": "ssl", 00:20:38.343 "recv_buf_size": 4096, 00:20:38.343 "send_buf_size": 4096, 00:20:38.343 "enable_recv_pipe": true, 00:20:38.343 "enable_quickack": false, 00:20:38.343 "enable_placement_id": 0, 00:20:38.343 "enable_zerocopy_send_server": true, 00:20:38.343 "enable_zerocopy_send_client": false, 00:20:38.343 "zerocopy_threshold": 0, 00:20:38.343 "tls_version": 0, 00:20:38.343 "enable_ktls": false 00:20:38.343 } 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "method": "sock_impl_set_options", 00:20:38.343 "params": { 00:20:38.343 "impl_name": "posix", 00:20:38.343 "recv_buf_size": 2097152, 00:20:38.343 "send_buf_size": 2097152, 00:20:38.343 "enable_recv_pipe": true, 00:20:38.343 "enable_quickack": false, 00:20:38.343 "enable_placement_id": 0, 00:20:38.343 "enable_zerocopy_send_server": true, 00:20:38.343 "enable_zerocopy_send_client": false, 00:20:38.343 "zerocopy_threshold": 0, 00:20:38.343 "tls_version": 0, 00:20:38.343 "enable_ktls": false 00:20:38.343 } 00:20:38.343 } 00:20:38.343 ] 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "subsystem": "vmd", 00:20:38.343 "config": [] 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "subsystem": "accel", 00:20:38.343 "config": [ 00:20:38.343 { 00:20:38.343 "method": "accel_set_options", 00:20:38.343 "params": { 00:20:38.343 "small_cache_size": 128, 00:20:38.343 "large_cache_size": 16, 00:20:38.343 "task_count": 2048, 00:20:38.343 "sequence_count": 2048, 00:20:38.343 "buf_count": 2048 00:20:38.343 } 00:20:38.343 } 00:20:38.343 ] 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "subsystem": "bdev", 00:20:38.343 "config": [ 00:20:38.343 { 00:20:38.343 "method": "bdev_set_options", 00:20:38.343 "params": { 00:20:38.343 "bdev_io_pool_size": 65535, 00:20:38.343 "bdev_io_cache_size": 256, 00:20:38.343 "bdev_auto_examine": true, 00:20:38.343 "iobuf_small_cache_size": 128, 00:20:38.343 "iobuf_large_cache_size": 16 00:20:38.343 } 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "method": "bdev_raid_set_options", 00:20:38.343 "params": { 00:20:38.343 "process_window_size_kb": 1024, 00:20:38.343 "process_max_bandwidth_mb_sec": 0 00:20:38.343 } 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "method": "bdev_iscsi_set_options", 00:20:38.343 "params": { 00:20:38.343 "timeout_sec": 30 00:20:38.343 } 00:20:38.343 }, 00:20:38.343 { 00:20:38.343 "method": "bdev_nvme_set_options", 00:20:38.343 "params": { 00:20:38.343 "action_on_timeout": "none", 00:20:38.343 "timeout_us": 0, 00:20:38.343 "timeout_admin_us": 0, 00:20:38.343 "keep_alive_timeout_ms": 10000, 00:20:38.343 "arbitration_burst": 0, 00:20:38.343 "low_priority_weight": 0, 00:20:38.343 "medium_priority_weight": 0, 00:20:38.343 "high_priority_weight": 0, 00:20:38.343 "nvme_adminq_poll_period_us": 10000, 00:20:38.343 "nvme_ioq_poll_period_us": 0, 00:20:38.343 "io_queue_requests": 512, 00:20:38.343 "delay_cmd_submit": true, 00:20:38.343 "transport_retry_count": 4, 00:20:38.343 "bdev_retry_count": 3, 00:20:38.343 "transport_ack_timeout": 0, 00:20:38.343 "ctrlr_loss_timeout_sec": 0, 00:20:38.343 "reconnect_delay_sec": 0, 00:20:38.344 "fast_io_fail_timeout_sec": 0, 00:20:38.344 "disable_auto_failback": false, 00:20:38.344 "generate_uuids": false, 00:20:38.344 "transport_tos": 0, 00:20:38.344 "nvme_error_stat": false, 00:20:38.344 "rdma_srq_size": 0, 00:20:38.344 "io_path_stat": false, 00:20:38.344 "allow_accel_sequence": false, 00:20:38.344 "rdma_max_cq_size": 0, 00:20:38.344 "rdma_cm_event_timeout_ms": 0, 00:20:38.344 "dhchap_digests": [ 00:20:38.344 "sha256", 00:20:38.344 "sha384", 00:20:38.344 "sha512" 00:20:38.344 ], 00:20:38.344 "dhchap_dhgroups": [ 00:20:38.344 "null", 00:20:38.344 "ffdhe2048", 00:20:38.344 "ffdhe3072", 00:20:38.344 "ffdhe4096", 00:20:38.344 "ffdhe6144", 00:20:38.344 "ffdhe8192" 00:20:38.344 ] 00:20:38.344 } 00:20:38.344 }, 00:20:38.344 { 00:20:38.344 "method": "bdev_nvme_attach_controller", 00:20:38.344 "params": { 00:20:38.344 "name": "TLSTEST", 00:20:38.344 "trtype": "TCP", 00:20:38.344 "adrfam": "IPv4", 00:20:38.344 "traddr": "10.0.0.2", 00:20:38.344 "trsvcid": "4420", 00:20:38.344 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.344 "prchk_reftag": false, 00:20:38.344 "prchk_guard": false, 00:20:38.344 "ctrlr_loss_timeout_sec": 0, 00:20:38.344 "reconnect_delay_sec": 0, 00:20:38.344 "fast_io_fail_timeout_sec": 0, 00:20:38.344 "psk": "key0", 00:20:38.344 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:38.344 "hdgst": false, 00:20:38.344 "ddgst": false, 00:20:38.344 "multipath": "multipath" 00:20:38.344 } 00:20:38.344 }, 00:20:38.344 { 00:20:38.344 "method": "bdev_nvme_set_hotplug", 00:20:38.344 "params": { 00:20:38.344 "period_us": 100000, 00:20:38.344 "enable": false 00:20:38.344 } 00:20:38.344 }, 00:20:38.344 { 00:20:38.344 "method": "bdev_wait_for_examine" 00:20:38.344 } 00:20:38.344 ] 00:20:38.344 }, 00:20:38.344 { 00:20:38.344 "subsystem": "nbd", 00:20:38.344 "config": [] 00:20:38.344 } 00:20:38.344 ] 00:20:38.344 }' 00:20:38.344 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:38.344 13:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:38.344 [2024-10-07 13:31:34.108025] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:38.344 [2024-10-07 13:31:34.108108] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid664891 ] 00:20:38.344 [2024-10-07 13:31:34.170355] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.603 [2024-10-07 13:31:34.280104] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:38.603 [2024-10-07 13:31:34.459977] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:39.542 13:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:39.542 13:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:39.542 13:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:39.542 Running I/O for 10 seconds... 00:20:41.423 3453.00 IOPS, 13.49 MiB/s [2024-10-07T11:31:38.290Z] 3517.50 IOPS, 13.74 MiB/s [2024-10-07T11:31:39.669Z] 3552.00 IOPS, 13.88 MiB/s [2024-10-07T11:31:40.605Z] 3548.50 IOPS, 13.86 MiB/s [2024-10-07T11:31:41.543Z] 3538.80 IOPS, 13.82 MiB/s [2024-10-07T11:31:42.479Z] 3523.83 IOPS, 13.76 MiB/s [2024-10-07T11:31:43.465Z] 3531.71 IOPS, 13.80 MiB/s [2024-10-07T11:31:44.398Z] 3518.75 IOPS, 13.75 MiB/s [2024-10-07T11:31:45.336Z] 3520.56 IOPS, 13.75 MiB/s [2024-10-07T11:31:45.336Z] 3522.10 IOPS, 13.76 MiB/s 00:20:49.403 Latency(us) 00:20:49.403 [2024-10-07T11:31:45.336Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.403 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:49.403 Verification LBA range: start 0x0 length 0x2000 00:20:49.403 TLSTESTn1 : 10.02 3527.61 13.78 0.00 0.00 36227.20 6456.51 35535.08 00:20:49.403 [2024-10-07T11:31:45.336Z] =================================================================================================================== 00:20:49.403 [2024-10-07T11:31:45.336Z] Total : 3527.61 13.78 0.00 0.00 36227.20 6456.51 35535.08 00:20:49.403 { 00:20:49.403 "results": [ 00:20:49.403 { 00:20:49.403 "job": "TLSTESTn1", 00:20:49.403 "core_mask": "0x4", 00:20:49.403 "workload": "verify", 00:20:49.403 "status": "finished", 00:20:49.403 "verify_range": { 00:20:49.403 "start": 0, 00:20:49.403 "length": 8192 00:20:49.403 }, 00:20:49.403 "queue_depth": 128, 00:20:49.403 "io_size": 4096, 00:20:49.403 "runtime": 10.019524, 00:20:49.403 "iops": 3527.612688986024, 00:20:49.403 "mibps": 13.779737066351656, 00:20:49.403 "io_failed": 0, 00:20:49.403 "io_timeout": 0, 00:20:49.404 "avg_latency_us": 36227.20257592095, 00:20:49.404 "min_latency_us": 6456.50962962963, 00:20:49.404 "max_latency_us": 35535.07555555556 00:20:49.404 } 00:20:49.404 ], 00:20:49.404 "core_count": 1 00:20:49.404 } 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@215 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@216 -- # killprocess 664891 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 664891 ']' 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 664891 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 664891 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 664891' 00:20:49.664 killing process with pid 664891 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 664891 00:20:49.664 Received shutdown signal, test time was about 10.000000 seconds 00:20:49.664 00:20:49.664 Latency(us) 00:20:49.664 [2024-10-07T11:31:45.597Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.664 [2024-10-07T11:31:45.597Z] =================================================================================================================== 00:20:49.664 [2024-10-07T11:31:45.597Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:49.664 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 664891 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@217 -- # killprocess 664779 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 664779 ']' 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 664779 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 664779 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 664779' 00:20:49.922 killing process with pid 664779 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 664779 00:20:49.922 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 664779 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@220 -- # nvmfappstart 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=666309 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 666309 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 666309 ']' 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:50.180 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:50.180 13:31:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:50.180 [2024-10-07 13:31:46.000608] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:50.180 [2024-10-07 13:31:46.000697] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:50.180 [2024-10-07 13:31:46.065080] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:50.439 [2024-10-07 13:31:46.171651] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:50.439 [2024-10-07 13:31:46.171714] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:50.439 [2024-10-07 13:31:46.171743] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:50.439 [2024-10-07 13:31:46.171755] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:50.439 [2024-10-07 13:31:46.171764] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:50.439 [2024-10-07 13:31:46.172410] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@221 -- # setup_nvmf_tgt /tmp/tmp.6wbBW5DnOI 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.6wbBW5DnOI 00:20:50.439 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:50.697 [2024-10-07 13:31:46.558231] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:50.697 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:50.956 13:31:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:51.213 [2024-10-07 13:31:47.143830] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:51.213 [2024-10-07 13:31:47.144086] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:51.473 13:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:51.731 malloc0 00:20:51.731 13:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:51.989 13:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:52.247 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@224 -- # bdevperf_pid=666598 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@226 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@227 -- # waitforlisten 666598 /var/tmp/bdevperf.sock 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 666598 ']' 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@222 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:52.505 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:52.505 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:52.765 [2024-10-07 13:31:48.460999] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:52.765 [2024-10-07 13:31:48.461072] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid666598 ] 00:20:52.765 [2024-10-07 13:31:48.519036] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:52.765 [2024-10-07 13:31:48.633469] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:53.024 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:53.024 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:53.024 13:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@229 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:53.282 13:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@230 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:53.539 [2024-10-07 13:31:49.352014] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:53.539 nvme0n1 00:20:53.539 13:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@234 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:53.799 Running I/O for 1 seconds... 00:20:54.737 3382.00 IOPS, 13.21 MiB/s 00:20:54.737 Latency(us) 00:20:54.737 [2024-10-07T11:31:50.670Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:54.738 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:20:54.738 Verification LBA range: start 0x0 length 0x2000 00:20:54.738 nvme0n1 : 1.02 3433.68 13.41 0.00 0.00 36914.04 6359.42 36311.80 00:20:54.738 [2024-10-07T11:31:50.671Z] =================================================================================================================== 00:20:54.738 [2024-10-07T11:31:50.671Z] Total : 3433.68 13.41 0.00 0.00 36914.04 6359.42 36311.80 00:20:54.738 { 00:20:54.738 "results": [ 00:20:54.738 { 00:20:54.738 "job": "nvme0n1", 00:20:54.738 "core_mask": "0x2", 00:20:54.738 "workload": "verify", 00:20:54.738 "status": "finished", 00:20:54.738 "verify_range": { 00:20:54.738 "start": 0, 00:20:54.738 "length": 8192 00:20:54.738 }, 00:20:54.738 "queue_depth": 128, 00:20:54.738 "io_size": 4096, 00:20:54.738 "runtime": 1.022517, 00:20:54.738 "iops": 3433.6837431553704, 00:20:54.738 "mibps": 13.412827121700666, 00:20:54.738 "io_failed": 0, 00:20:54.738 "io_timeout": 0, 00:20:54.738 "avg_latency_us": 36914.04364273131, 00:20:54.738 "min_latency_us": 6359.419259259259, 00:20:54.738 "max_latency_us": 36311.79851851852 00:20:54.738 } 00:20:54.738 ], 00:20:54.738 "core_count": 1 00:20:54.738 } 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@236 -- # killprocess 666598 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 666598 ']' 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 666598 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 666598 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 666598' 00:20:54.738 killing process with pid 666598 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 666598 00:20:54.738 Received shutdown signal, test time was about 1.000000 seconds 00:20:54.738 00:20:54.738 Latency(us) 00:20:54.738 [2024-10-07T11:31:50.671Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:54.738 [2024-10-07T11:31:50.671Z] =================================================================================================================== 00:20:54.738 [2024-10-07T11:31:50.671Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:54.738 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 666598 00:20:54.996 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@237 -- # killprocess 666309 00:20:54.996 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 666309 ']' 00:20:54.996 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 666309 00:20:54.996 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:54.996 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:54.996 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 666309 00:20:55.255 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:20:55.255 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:20:55.255 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 666309' 00:20:55.255 killing process with pid 666309 00:20:55.255 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 666309 00:20:55.255 13:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 666309 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@242 -- # nvmfappstart 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=666998 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 666998 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 666998 ']' 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:55.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:55.514 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:55.514 [2024-10-07 13:31:51.283909] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:55.514 [2024-10-07 13:31:51.283985] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:55.514 [2024-10-07 13:31:51.345521] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.514 [2024-10-07 13:31:51.443996] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:55.514 [2024-10-07 13:31:51.444078] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:55.514 [2024-10-07 13:31:51.444092] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:55.514 [2024-10-07 13:31:51.444104] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:55.514 [2024-10-07 13:31:51.444113] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:55.514 [2024-10-07 13:31:51.444832] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@243 -- # rpc_cmd 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:55.771 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:55.771 [2024-10-07 13:31:51.590189] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:55.771 malloc0 00:20:55.772 [2024-10-07 13:31:51.632194] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:55.772 [2024-10-07 13:31:51.632526] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@256 -- # bdevperf_pid=667019 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@254 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@258 -- # waitforlisten 667019 /var/tmp/bdevperf.sock 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 667019 ']' 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:55.772 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:55.772 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:55.772 [2024-10-07 13:31:51.705173] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:55.772 [2024-10-07 13:31:51.705260] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid667019 ] 00:20:56.031 [2024-10-07 13:31:51.764419] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.031 [2024-10-07 13:31:51.872715] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:56.290 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:56.290 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:56.290 13:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@259 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.6wbBW5DnOI 00:20:56.548 13:31:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@260 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:56.807 [2024-10-07 13:31:52.564195] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:56.807 nvme0n1 00:20:56.807 13:31:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@264 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:57.067 Running I/O for 1 seconds... 00:20:58.005 3481.00 IOPS, 13.60 MiB/s 00:20:58.005 Latency(us) 00:20:58.005 [2024-10-07T11:31:53.938Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:58.005 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:20:58.005 Verification LBA range: start 0x0 length 0x2000 00:20:58.005 nvme0n1 : 1.02 3530.27 13.79 0.00 0.00 35888.16 6043.88 34369.99 00:20:58.005 [2024-10-07T11:31:53.938Z] =================================================================================================================== 00:20:58.005 [2024-10-07T11:31:53.938Z] Total : 3530.27 13.79 0.00 0.00 35888.16 6043.88 34369.99 00:20:58.005 { 00:20:58.005 "results": [ 00:20:58.005 { 00:20:58.005 "job": "nvme0n1", 00:20:58.005 "core_mask": "0x2", 00:20:58.005 "workload": "verify", 00:20:58.005 "status": "finished", 00:20:58.005 "verify_range": { 00:20:58.005 "start": 0, 00:20:58.005 "length": 8192 00:20:58.005 }, 00:20:58.005 "queue_depth": 128, 00:20:58.005 "io_size": 4096, 00:20:58.005 "runtime": 1.022586, 00:20:58.005 "iops": 3530.2654251084996, 00:20:58.005 "mibps": 13.790099316830077, 00:20:58.005 "io_failed": 0, 00:20:58.005 "io_timeout": 0, 00:20:58.005 "avg_latency_us": 35888.16445511439, 00:20:58.005 "min_latency_us": 6043.875555555555, 00:20:58.005 "max_latency_us": 34369.991111111114 00:20:58.005 } 00:20:58.005 ], 00:20:58.005 "core_count": 1 00:20:58.005 } 00:20:58.005 13:31:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # rpc_cmd save_config 00:20:58.005 13:31:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:58.005 13:31:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:58.005 13:31:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:58.005 13:31:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # tgtcfg='{ 00:20:58.005 "subsystems": [ 00:20:58.005 { 00:20:58.005 "subsystem": "keyring", 00:20:58.005 "config": [ 00:20:58.005 { 00:20:58.005 "method": "keyring_file_add_key", 00:20:58.005 "params": { 00:20:58.005 "name": "key0", 00:20:58.005 "path": "/tmp/tmp.6wbBW5DnOI" 00:20:58.005 } 00:20:58.005 } 00:20:58.005 ] 00:20:58.005 }, 00:20:58.005 { 00:20:58.005 "subsystem": "iobuf", 00:20:58.005 "config": [ 00:20:58.005 { 00:20:58.005 "method": "iobuf_set_options", 00:20:58.006 "params": { 00:20:58.006 "small_pool_count": 8192, 00:20:58.006 "large_pool_count": 1024, 00:20:58.006 "small_bufsize": 8192, 00:20:58.006 "large_bufsize": 135168 00:20:58.006 } 00:20:58.006 } 00:20:58.006 ] 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "subsystem": "sock", 00:20:58.006 "config": [ 00:20:58.006 { 00:20:58.006 "method": "sock_set_default_impl", 00:20:58.006 "params": { 00:20:58.006 "impl_name": "posix" 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "sock_impl_set_options", 00:20:58.006 "params": { 00:20:58.006 "impl_name": "ssl", 00:20:58.006 "recv_buf_size": 4096, 00:20:58.006 "send_buf_size": 4096, 00:20:58.006 "enable_recv_pipe": true, 00:20:58.006 "enable_quickack": false, 00:20:58.006 "enable_placement_id": 0, 00:20:58.006 "enable_zerocopy_send_server": true, 00:20:58.006 "enable_zerocopy_send_client": false, 00:20:58.006 "zerocopy_threshold": 0, 00:20:58.006 "tls_version": 0, 00:20:58.006 "enable_ktls": false 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "sock_impl_set_options", 00:20:58.006 "params": { 00:20:58.006 "impl_name": "posix", 00:20:58.006 "recv_buf_size": 2097152, 00:20:58.006 "send_buf_size": 2097152, 00:20:58.006 "enable_recv_pipe": true, 00:20:58.006 "enable_quickack": false, 00:20:58.006 "enable_placement_id": 0, 00:20:58.006 "enable_zerocopy_send_server": true, 00:20:58.006 "enable_zerocopy_send_client": false, 00:20:58.006 "zerocopy_threshold": 0, 00:20:58.006 "tls_version": 0, 00:20:58.006 "enable_ktls": false 00:20:58.006 } 00:20:58.006 } 00:20:58.006 ] 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "subsystem": "vmd", 00:20:58.006 "config": [] 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "subsystem": "accel", 00:20:58.006 "config": [ 00:20:58.006 { 00:20:58.006 "method": "accel_set_options", 00:20:58.006 "params": { 00:20:58.006 "small_cache_size": 128, 00:20:58.006 "large_cache_size": 16, 00:20:58.006 "task_count": 2048, 00:20:58.006 "sequence_count": 2048, 00:20:58.006 "buf_count": 2048 00:20:58.006 } 00:20:58.006 } 00:20:58.006 ] 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "subsystem": "bdev", 00:20:58.006 "config": [ 00:20:58.006 { 00:20:58.006 "method": "bdev_set_options", 00:20:58.006 "params": { 00:20:58.006 "bdev_io_pool_size": 65535, 00:20:58.006 "bdev_io_cache_size": 256, 00:20:58.006 "bdev_auto_examine": true, 00:20:58.006 "iobuf_small_cache_size": 128, 00:20:58.006 "iobuf_large_cache_size": 16 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "bdev_raid_set_options", 00:20:58.006 "params": { 00:20:58.006 "process_window_size_kb": 1024, 00:20:58.006 "process_max_bandwidth_mb_sec": 0 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "bdev_iscsi_set_options", 00:20:58.006 "params": { 00:20:58.006 "timeout_sec": 30 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "bdev_nvme_set_options", 00:20:58.006 "params": { 00:20:58.006 "action_on_timeout": "none", 00:20:58.006 "timeout_us": 0, 00:20:58.006 "timeout_admin_us": 0, 00:20:58.006 "keep_alive_timeout_ms": 10000, 00:20:58.006 "arbitration_burst": 0, 00:20:58.006 "low_priority_weight": 0, 00:20:58.006 "medium_priority_weight": 0, 00:20:58.006 "high_priority_weight": 0, 00:20:58.006 "nvme_adminq_poll_period_us": 10000, 00:20:58.006 "nvme_ioq_poll_period_us": 0, 00:20:58.006 "io_queue_requests": 0, 00:20:58.006 "delay_cmd_submit": true, 00:20:58.006 "transport_retry_count": 4, 00:20:58.006 "bdev_retry_count": 3, 00:20:58.006 "transport_ack_timeout": 0, 00:20:58.006 "ctrlr_loss_timeout_sec": 0, 00:20:58.006 "reconnect_delay_sec": 0, 00:20:58.006 "fast_io_fail_timeout_sec": 0, 00:20:58.006 "disable_auto_failback": false, 00:20:58.006 "generate_uuids": false, 00:20:58.006 "transport_tos": 0, 00:20:58.006 "nvme_error_stat": false, 00:20:58.006 "rdma_srq_size": 0, 00:20:58.006 "io_path_stat": false, 00:20:58.006 "allow_accel_sequence": false, 00:20:58.006 "rdma_max_cq_size": 0, 00:20:58.006 "rdma_cm_event_timeout_ms": 0, 00:20:58.006 "dhchap_digests": [ 00:20:58.006 "sha256", 00:20:58.006 "sha384", 00:20:58.006 "sha512" 00:20:58.006 ], 00:20:58.006 "dhchap_dhgroups": [ 00:20:58.006 "null", 00:20:58.006 "ffdhe2048", 00:20:58.006 "ffdhe3072", 00:20:58.006 "ffdhe4096", 00:20:58.006 "ffdhe6144", 00:20:58.006 "ffdhe8192" 00:20:58.006 ] 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "bdev_nvme_set_hotplug", 00:20:58.006 "params": { 00:20:58.006 "period_us": 100000, 00:20:58.006 "enable": false 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "bdev_malloc_create", 00:20:58.006 "params": { 00:20:58.006 "name": "malloc0", 00:20:58.006 "num_blocks": 8192, 00:20:58.006 "block_size": 4096, 00:20:58.006 "physical_block_size": 4096, 00:20:58.006 "uuid": "d5d2d350-8da6-40f3-96d3-64463bcdf509", 00:20:58.006 "optimal_io_boundary": 0, 00:20:58.006 "md_size": 0, 00:20:58.006 "dif_type": 0, 00:20:58.006 "dif_is_head_of_md": false, 00:20:58.006 "dif_pi_format": 0 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "bdev_wait_for_examine" 00:20:58.006 } 00:20:58.006 ] 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "subsystem": "nbd", 00:20:58.006 "config": [] 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "subsystem": "scheduler", 00:20:58.006 "config": [ 00:20:58.006 { 00:20:58.006 "method": "framework_set_scheduler", 00:20:58.006 "params": { 00:20:58.006 "name": "static" 00:20:58.006 } 00:20:58.006 } 00:20:58.006 ] 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "subsystem": "nvmf", 00:20:58.006 "config": [ 00:20:58.006 { 00:20:58.006 "method": "nvmf_set_config", 00:20:58.006 "params": { 00:20:58.006 "discovery_filter": "match_any", 00:20:58.006 "admin_cmd_passthru": { 00:20:58.006 "identify_ctrlr": false 00:20:58.006 }, 00:20:58.006 "dhchap_digests": [ 00:20:58.006 "sha256", 00:20:58.006 "sha384", 00:20:58.006 "sha512" 00:20:58.006 ], 00:20:58.006 "dhchap_dhgroups": [ 00:20:58.006 "null", 00:20:58.006 "ffdhe2048", 00:20:58.006 "ffdhe3072", 00:20:58.006 "ffdhe4096", 00:20:58.006 "ffdhe6144", 00:20:58.006 "ffdhe8192" 00:20:58.006 ] 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "nvmf_set_max_subsystems", 00:20:58.006 "params": { 00:20:58.006 "max_subsystems": 1024 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "nvmf_set_crdt", 00:20:58.006 "params": { 00:20:58.006 "crdt1": 0, 00:20:58.006 "crdt2": 0, 00:20:58.006 "crdt3": 0 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "nvmf_create_transport", 00:20:58.006 "params": { 00:20:58.006 "trtype": "TCP", 00:20:58.006 "max_queue_depth": 128, 00:20:58.006 "max_io_qpairs_per_ctrlr": 127, 00:20:58.006 "in_capsule_data_size": 4096, 00:20:58.006 "max_io_size": 131072, 00:20:58.006 "io_unit_size": 131072, 00:20:58.006 "max_aq_depth": 128, 00:20:58.006 "num_shared_buffers": 511, 00:20:58.006 "buf_cache_size": 4294967295, 00:20:58.006 "dif_insert_or_strip": false, 00:20:58.006 "zcopy": false, 00:20:58.006 "c2h_success": false, 00:20:58.006 "sock_priority": 0, 00:20:58.006 "abort_timeout_sec": 1, 00:20:58.006 "ack_timeout": 0, 00:20:58.006 "data_wr_pool_size": 0 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "nvmf_create_subsystem", 00:20:58.006 "params": { 00:20:58.006 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.006 "allow_any_host": false, 00:20:58.006 "serial_number": "00000000000000000000", 00:20:58.006 "model_number": "SPDK bdev Controller", 00:20:58.006 "max_namespaces": 32, 00:20:58.006 "min_cntlid": 1, 00:20:58.006 "max_cntlid": 65519, 00:20:58.006 "ana_reporting": false 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "nvmf_subsystem_add_host", 00:20:58.006 "params": { 00:20:58.006 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.006 "host": "nqn.2016-06.io.spdk:host1", 00:20:58.006 "psk": "key0" 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "nvmf_subsystem_add_ns", 00:20:58.006 "params": { 00:20:58.006 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.006 "namespace": { 00:20:58.006 "nsid": 1, 00:20:58.006 "bdev_name": "malloc0", 00:20:58.006 "nguid": "D5D2D3508DA640F396D364463BCDF509", 00:20:58.006 "uuid": "d5d2d350-8da6-40f3-96d3-64463bcdf509", 00:20:58.006 "no_auto_visible": false 00:20:58.006 } 00:20:58.006 } 00:20:58.006 }, 00:20:58.006 { 00:20:58.006 "method": "nvmf_subsystem_add_listener", 00:20:58.006 "params": { 00:20:58.006 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.006 "listen_address": { 00:20:58.006 "trtype": "TCP", 00:20:58.006 "adrfam": "IPv4", 00:20:58.006 "traddr": "10.0.0.2", 00:20:58.006 "trsvcid": "4420" 00:20:58.006 }, 00:20:58.006 "secure_channel": false, 00:20:58.006 "sock_impl": "ssl" 00:20:58.006 } 00:20:58.006 } 00:20:58.006 ] 00:20:58.006 } 00:20:58.006 ] 00:20:58.006 }' 00:20:58.007 13:31:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:58.575 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # bperfcfg='{ 00:20:58.575 "subsystems": [ 00:20:58.575 { 00:20:58.575 "subsystem": "keyring", 00:20:58.575 "config": [ 00:20:58.575 { 00:20:58.575 "method": "keyring_file_add_key", 00:20:58.575 "params": { 00:20:58.575 "name": "key0", 00:20:58.575 "path": "/tmp/tmp.6wbBW5DnOI" 00:20:58.575 } 00:20:58.575 } 00:20:58.575 ] 00:20:58.575 }, 00:20:58.575 { 00:20:58.575 "subsystem": "iobuf", 00:20:58.575 "config": [ 00:20:58.575 { 00:20:58.575 "method": "iobuf_set_options", 00:20:58.575 "params": { 00:20:58.575 "small_pool_count": 8192, 00:20:58.575 "large_pool_count": 1024, 00:20:58.575 "small_bufsize": 8192, 00:20:58.575 "large_bufsize": 135168 00:20:58.575 } 00:20:58.575 } 00:20:58.575 ] 00:20:58.575 }, 00:20:58.575 { 00:20:58.575 "subsystem": "sock", 00:20:58.575 "config": [ 00:20:58.575 { 00:20:58.575 "method": "sock_set_default_impl", 00:20:58.575 "params": { 00:20:58.575 "impl_name": "posix" 00:20:58.575 } 00:20:58.575 }, 00:20:58.575 { 00:20:58.575 "method": "sock_impl_set_options", 00:20:58.575 "params": { 00:20:58.575 "impl_name": "ssl", 00:20:58.575 "recv_buf_size": 4096, 00:20:58.575 "send_buf_size": 4096, 00:20:58.575 "enable_recv_pipe": true, 00:20:58.575 "enable_quickack": false, 00:20:58.575 "enable_placement_id": 0, 00:20:58.575 "enable_zerocopy_send_server": true, 00:20:58.575 "enable_zerocopy_send_client": false, 00:20:58.575 "zerocopy_threshold": 0, 00:20:58.575 "tls_version": 0, 00:20:58.575 "enable_ktls": false 00:20:58.575 } 00:20:58.575 }, 00:20:58.575 { 00:20:58.575 "method": "sock_impl_set_options", 00:20:58.575 "params": { 00:20:58.575 "impl_name": "posix", 00:20:58.575 "recv_buf_size": 2097152, 00:20:58.575 "send_buf_size": 2097152, 00:20:58.575 "enable_recv_pipe": true, 00:20:58.575 "enable_quickack": false, 00:20:58.575 "enable_placement_id": 0, 00:20:58.576 "enable_zerocopy_send_server": true, 00:20:58.576 "enable_zerocopy_send_client": false, 00:20:58.576 "zerocopy_threshold": 0, 00:20:58.576 "tls_version": 0, 00:20:58.576 "enable_ktls": false 00:20:58.576 } 00:20:58.576 } 00:20:58.576 ] 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "subsystem": "vmd", 00:20:58.576 "config": [] 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "subsystem": "accel", 00:20:58.576 "config": [ 00:20:58.576 { 00:20:58.576 "method": "accel_set_options", 00:20:58.576 "params": { 00:20:58.576 "small_cache_size": 128, 00:20:58.576 "large_cache_size": 16, 00:20:58.576 "task_count": 2048, 00:20:58.576 "sequence_count": 2048, 00:20:58.576 "buf_count": 2048 00:20:58.576 } 00:20:58.576 } 00:20:58.576 ] 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "subsystem": "bdev", 00:20:58.576 "config": [ 00:20:58.576 { 00:20:58.576 "method": "bdev_set_options", 00:20:58.576 "params": { 00:20:58.576 "bdev_io_pool_size": 65535, 00:20:58.576 "bdev_io_cache_size": 256, 00:20:58.576 "bdev_auto_examine": true, 00:20:58.576 "iobuf_small_cache_size": 128, 00:20:58.576 "iobuf_large_cache_size": 16 00:20:58.576 } 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "method": "bdev_raid_set_options", 00:20:58.576 "params": { 00:20:58.576 "process_window_size_kb": 1024, 00:20:58.576 "process_max_bandwidth_mb_sec": 0 00:20:58.576 } 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "method": "bdev_iscsi_set_options", 00:20:58.576 "params": { 00:20:58.576 "timeout_sec": 30 00:20:58.576 } 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "method": "bdev_nvme_set_options", 00:20:58.576 "params": { 00:20:58.576 "action_on_timeout": "none", 00:20:58.576 "timeout_us": 0, 00:20:58.576 "timeout_admin_us": 0, 00:20:58.576 "keep_alive_timeout_ms": 10000, 00:20:58.576 "arbitration_burst": 0, 00:20:58.576 "low_priority_weight": 0, 00:20:58.576 "medium_priority_weight": 0, 00:20:58.576 "high_priority_weight": 0, 00:20:58.576 "nvme_adminq_poll_period_us": 10000, 00:20:58.576 "nvme_ioq_poll_period_us": 0, 00:20:58.576 "io_queue_requests": 512, 00:20:58.576 "delay_cmd_submit": true, 00:20:58.576 "transport_retry_count": 4, 00:20:58.576 "bdev_retry_count": 3, 00:20:58.576 "transport_ack_timeout": 0, 00:20:58.576 "ctrlr_loss_timeout_sec": 0, 00:20:58.576 "reconnect_delay_sec": 0, 00:20:58.576 "fast_io_fail_timeout_sec": 0, 00:20:58.576 "disable_auto_failback": false, 00:20:58.576 "generate_uuids": false, 00:20:58.576 "transport_tos": 0, 00:20:58.576 "nvme_error_stat": false, 00:20:58.576 "rdma_srq_size": 0, 00:20:58.576 "io_path_stat": false, 00:20:58.576 "allow_accel_sequence": false, 00:20:58.576 "rdma_max_cq_size": 0, 00:20:58.576 "rdma_cm_event_timeout_ms": 0, 00:20:58.576 "dhchap_digests": [ 00:20:58.576 "sha256", 00:20:58.576 "sha384", 00:20:58.576 "sha512" 00:20:58.576 ], 00:20:58.576 "dhchap_dhgroups": [ 00:20:58.576 "null", 00:20:58.576 "ffdhe2048", 00:20:58.576 "ffdhe3072", 00:20:58.576 "ffdhe4096", 00:20:58.576 "ffdhe6144", 00:20:58.576 "ffdhe8192" 00:20:58.576 ] 00:20:58.576 } 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "method": "bdev_nvme_attach_controller", 00:20:58.576 "params": { 00:20:58.576 "name": "nvme0", 00:20:58.576 "trtype": "TCP", 00:20:58.576 "adrfam": "IPv4", 00:20:58.576 "traddr": "10.0.0.2", 00:20:58.576 "trsvcid": "4420", 00:20:58.576 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.576 "prchk_reftag": false, 00:20:58.576 "prchk_guard": false, 00:20:58.576 "ctrlr_loss_timeout_sec": 0, 00:20:58.576 "reconnect_delay_sec": 0, 00:20:58.576 "fast_io_fail_timeout_sec": 0, 00:20:58.576 "psk": "key0", 00:20:58.576 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:58.576 "hdgst": false, 00:20:58.576 "ddgst": false, 00:20:58.576 "multipath": "multipath" 00:20:58.576 } 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "method": "bdev_nvme_set_hotplug", 00:20:58.576 "params": { 00:20:58.576 "period_us": 100000, 00:20:58.576 "enable": false 00:20:58.576 } 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "method": "bdev_enable_histogram", 00:20:58.576 "params": { 00:20:58.576 "name": "nvme0n1", 00:20:58.576 "enable": true 00:20:58.576 } 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "method": "bdev_wait_for_examine" 00:20:58.576 } 00:20:58.576 ] 00:20:58.576 }, 00:20:58.576 { 00:20:58.576 "subsystem": "nbd", 00:20:58.576 "config": [] 00:20:58.576 } 00:20:58.576 ] 00:20:58.576 }' 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@270 -- # killprocess 667019 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 667019 ']' 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 667019 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 667019 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 667019' 00:20:58.576 killing process with pid 667019 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 667019 00:20:58.576 Received shutdown signal, test time was about 1.000000 seconds 00:20:58.576 00:20:58.576 Latency(us) 00:20:58.576 [2024-10-07T11:31:54.509Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:58.576 [2024-10-07T11:31:54.509Z] =================================================================================================================== 00:20:58.576 [2024-10-07T11:31:54.509Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:58.576 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 667019 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@271 -- # killprocess 666998 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 666998 ']' 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 666998 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 666998 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 666998' 00:20:58.836 killing process with pid 666998 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 666998 00:20:58.836 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 666998 00:20:59.097 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # nvmfappstart -c /dev/fd/62 00:20:59.097 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:59.097 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # echo '{ 00:20:59.097 "subsystems": [ 00:20:59.097 { 00:20:59.097 "subsystem": "keyring", 00:20:59.097 "config": [ 00:20:59.097 { 00:20:59.097 "method": "keyring_file_add_key", 00:20:59.097 "params": { 00:20:59.097 "name": "key0", 00:20:59.097 "path": "/tmp/tmp.6wbBW5DnOI" 00:20:59.097 } 00:20:59.097 } 00:20:59.097 ] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "iobuf", 00:20:59.097 "config": [ 00:20:59.097 { 00:20:59.097 "method": "iobuf_set_options", 00:20:59.097 "params": { 00:20:59.097 "small_pool_count": 8192, 00:20:59.097 "large_pool_count": 1024, 00:20:59.097 "small_bufsize": 8192, 00:20:59.097 "large_bufsize": 135168 00:20:59.097 } 00:20:59.097 } 00:20:59.097 ] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "sock", 00:20:59.097 "config": [ 00:20:59.097 { 00:20:59.097 "method": "sock_set_default_impl", 00:20:59.097 "params": { 00:20:59.097 "impl_name": "posix" 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "sock_impl_set_options", 00:20:59.097 "params": { 00:20:59.097 "impl_name": "ssl", 00:20:59.097 "recv_buf_size": 4096, 00:20:59.097 "send_buf_size": 4096, 00:20:59.097 "enable_recv_pipe": true, 00:20:59.097 "enable_quickack": false, 00:20:59.097 "enable_placement_id": 0, 00:20:59.097 "enable_zerocopy_send_server": true, 00:20:59.097 "enable_zerocopy_send_client": false, 00:20:59.097 "zerocopy_threshold": 0, 00:20:59.097 "tls_version": 0, 00:20:59.097 "enable_ktls": false 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "sock_impl_set_options", 00:20:59.097 "params": { 00:20:59.097 "impl_name": "posix", 00:20:59.097 "recv_buf_size": 2097152, 00:20:59.097 "send_buf_size": 2097152, 00:20:59.097 "enable_recv_pipe": true, 00:20:59.097 "enable_quickack": false, 00:20:59.097 "enable_placement_id": 0, 00:20:59.097 "enable_zerocopy_send_server": true, 00:20:59.097 "enable_zerocopy_send_client": false, 00:20:59.097 "zerocopy_threshold": 0, 00:20:59.097 "tls_version": 0, 00:20:59.097 "enable_ktls": false 00:20:59.097 } 00:20:59.097 } 00:20:59.097 ] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "vmd", 00:20:59.097 "config": [] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "accel", 00:20:59.097 "config": [ 00:20:59.097 { 00:20:59.097 "method": "accel_set_options", 00:20:59.097 "params": { 00:20:59.097 "small_cache_size": 128, 00:20:59.097 "large_cache_size": 16, 00:20:59.097 "task_count": 2048, 00:20:59.097 "sequence_count": 2048, 00:20:59.097 "buf_count": 2048 00:20:59.097 } 00:20:59.097 } 00:20:59.097 ] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "bdev", 00:20:59.097 "config": [ 00:20:59.097 { 00:20:59.097 "method": "bdev_set_options", 00:20:59.097 "params": { 00:20:59.097 "bdev_io_pool_size": 65535, 00:20:59.097 "bdev_io_cache_size": 256, 00:20:59.097 "bdev_auto_examine": true, 00:20:59.097 "iobuf_small_cache_size": 128, 00:20:59.097 "iobuf_large_cache_size": 16 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "bdev_raid_set_options", 00:20:59.097 "params": { 00:20:59.097 "process_window_size_kb": 1024, 00:20:59.097 "process_max_bandwidth_mb_sec": 0 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "bdev_iscsi_set_options", 00:20:59.097 "params": { 00:20:59.097 "timeout_sec": 30 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "bdev_nvme_set_options", 00:20:59.097 "params": { 00:20:59.097 "action_on_timeout": "none", 00:20:59.097 "timeout_us": 0, 00:20:59.097 "timeout_admin_us": 0, 00:20:59.097 "keep_alive_timeout_ms": 10000, 00:20:59.097 "arbitration_burst": 0, 00:20:59.097 "low_priority_weight": 0, 00:20:59.097 "medium_priority_weight": 0, 00:20:59.097 "high_priority_weight": 0, 00:20:59.097 "nvme_adminq_poll_period_us": 10000, 00:20:59.097 "nvme_ioq_poll_period_us": 0, 00:20:59.097 "io_queue_requests": 0, 00:20:59.097 "delay_cmd_submit": true, 00:20:59.097 "transport_retry_count": 4, 00:20:59.097 "bdev_retry_count": 3, 00:20:59.097 "transport_ack_timeout": 0, 00:20:59.097 "ctrlr_loss_timeout_sec": 0, 00:20:59.097 "reconnect_delay_sec": 0, 00:20:59.097 "fast_io_fail_timeout_sec": 0, 00:20:59.097 "disable_auto_failback": false, 00:20:59.097 "generate_uuids": false, 00:20:59.097 "transport_tos": 0, 00:20:59.097 "nvme_error_stat": false, 00:20:59.097 "rdma_srq_size": 0, 00:20:59.097 "io_path_stat": false, 00:20:59.097 "allow_accel_sequence": false, 00:20:59.097 "rdma_max_cq_size": 0, 00:20:59.097 "rdma_cm_event_timeout_ms": 0, 00:20:59.097 "dhchap_digests": [ 00:20:59.097 "sha256", 00:20:59.097 "sha384", 00:20:59.097 "sha512" 00:20:59.097 ], 00:20:59.097 "dhchap_dhgroups": [ 00:20:59.097 "null", 00:20:59.097 "ffdhe2048", 00:20:59.097 "ffdhe3072", 00:20:59.097 "ffdhe4096", 00:20:59.097 "ffdhe6144", 00:20:59.097 "ffdhe8192" 00:20:59.097 ] 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "bdev_nvme_set_hotplug", 00:20:59.097 "params": { 00:20:59.097 "period_us": 100000, 00:20:59.097 "enable": false 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "bdev_malloc_create", 00:20:59.097 "params": { 00:20:59.097 "name": "malloc0", 00:20:59.097 "num_blocks": 8192, 00:20:59.097 "block_size": 4096, 00:20:59.097 "physical_block_size": 4096, 00:20:59.097 "uuid": "d5d2d350-8da6-40f3-96d3-64463bcdf509", 00:20:59.097 "optimal_io_boundary": 0, 00:20:59.097 "md_size": 0, 00:20:59.097 "dif_type": 0, 00:20:59.097 "dif_is_head_of_md": false, 00:20:59.097 "dif_pi_format": 0 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "bdev_wait_for_examine" 00:20:59.097 } 00:20:59.097 ] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "nbd", 00:20:59.097 "config": [] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "scheduler", 00:20:59.097 "config": [ 00:20:59.097 { 00:20:59.097 "method": "framework_set_scheduler", 00:20:59.097 "params": { 00:20:59.097 "name": "static" 00:20:59.097 } 00:20:59.097 } 00:20:59.097 ] 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "subsystem": "nvmf", 00:20:59.097 "config": [ 00:20:59.097 { 00:20:59.097 "method": "nvmf_set_config", 00:20:59.097 "params": { 00:20:59.097 "discovery_filter": "match_any", 00:20:59.097 "admin_cmd_passthru": { 00:20:59.097 "identify_ctrlr": false 00:20:59.097 }, 00:20:59.097 "dhchap_digests": [ 00:20:59.097 "sha256", 00:20:59.097 "sha384", 00:20:59.097 "sha512" 00:20:59.097 ], 00:20:59.097 "dhchap_dhgroups": [ 00:20:59.097 "null", 00:20:59.097 "ffdhe2048", 00:20:59.097 "ffdhe3072", 00:20:59.097 "ffdhe4096", 00:20:59.097 "ffdhe6144", 00:20:59.097 "ffdhe8192" 00:20:59.097 ] 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "nvmf_set_max_subsystems", 00:20:59.097 "params": { 00:20:59.097 "max_subsystems": 1024 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "nvmf_set_crdt", 00:20:59.097 "params": { 00:20:59.097 "crdt1": 0, 00:20:59.097 "crdt2": 0, 00:20:59.097 "crdt3": 0 00:20:59.097 } 00:20:59.097 }, 00:20:59.097 { 00:20:59.097 "method": "nvmf_create_transport", 00:20:59.097 "params": { 00:20:59.097 "trtype": "TCP", 00:20:59.097 "max_queue_depth": 128, 00:20:59.097 "max_io_qpairs_per_ctrlr": 127, 00:20:59.097 "in_capsule_data_size": 4096, 00:20:59.098 "max_io_size": 131072, 00:20:59.098 "io_unit_size": 131072, 00:20:59.098 "max_aq_depth": 128, 00:20:59.098 "num_shared_buffers": 511, 00:20:59.098 "buf_cache_size": 4294967295, 00:20:59.098 "dif_insert_or_strip": false, 00:20:59.098 "zcopy": false, 00:20:59.098 "c2h_success": false, 00:20:59.098 "sock_priority": 0, 00:20:59.098 "abort_timeout_sec": 1, 00:20:59.098 "ack_timeout": 0, 00:20:59.098 "data_wr_pool_size": 0 00:20:59.098 } 00:20:59.098 }, 00:20:59.098 { 00:20:59.098 "method": "nvmf_create_subsystem", 00:20:59.098 "params": { 00:20:59.098 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.098 "allow_any_host": false, 00:20:59.098 "serial_number": "00000000000000000000", 00:20:59.098 "model_number": "SPDK bdev Controller", 00:20:59.098 "max_namespaces": 32, 00:20:59.098 "min_cntlid": 1, 00:20:59.098 "max_cntlid": 65519, 00:20:59.098 "ana_reporting": false 00:20:59.098 } 00:20:59.098 }, 00:20:59.098 { 00:20:59.098 "method": "nvmf_subsystem_add_host", 00:20:59.098 "params": { 00:20:59.098 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.098 "host": "nqn.2016-06.io.spdk:host1", 00:20:59.098 "psk": "key0" 00:20:59.098 } 00:20:59.098 }, 00:20:59.098 { 00:20:59.098 "method": "nvmf_subsystem_add_ns", 00:20:59.098 "params": { 00:20:59.098 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.098 "namespace": { 00:20:59.098 "nsid": 1, 00:20:59.098 "bdev_name": "malloc0", 00:20:59.098 "nguid": "D5D2D3508DA640F396D364463BCDF509", 00:20:59.098 "uuid": "d5d2d350-8da6-40f3-96d3-64463bcdf509", 00:20:59.098 "no_auto_visible": false 00:20:59.098 } 00:20:59.098 } 00:20:59.098 }, 00:20:59.098 { 00:20:59.098 "method": "nvmf_subsystem_add_listener", 00:20:59.098 "params": { 00:20:59.098 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.098 "listen_address": { 00:20:59.098 "trtype": "TCP", 00:20:59.098 "adrfam": "IPv4", 00:20:59.098 "traddr": "10.0.0.2", 00:20:59.098 "trsvcid": "4420" 00:20:59.098 }, 00:20:59.098 "secure_channel": false, 00:20:59.098 "sock_impl": "ssl" 00:20:59.098 } 00:20:59.098 } 00:20:59.098 ] 00:20:59.098 } 00:20:59.098 ] 00:20:59.098 }' 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=667439 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -c /dev/fd/62 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 667439 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 667439 ']' 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:59.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:59.098 13:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:59.098 [2024-10-07 13:31:54.938842] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:59.098 [2024-10-07 13:31:54.938924] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:59.098 [2024-10-07 13:31:55.008637] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:59.358 [2024-10-07 13:31:55.117832] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:59.358 [2024-10-07 13:31:55.117906] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:59.358 [2024-10-07 13:31:55.117936] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:59.358 [2024-10-07 13:31:55.117948] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:59.358 [2024-10-07 13:31:55.117959] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:59.358 [2024-10-07 13:31:55.118767] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:20:59.617 [2024-10-07 13:31:55.368619] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:59.617 [2024-10-07 13:31:55.400658] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:59.617 [2024-10-07 13:31:55.400945] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@276 -- # bdevperf_pid=667590 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@277 -- # waitforlisten 667590 /var/tmp/bdevperf.sock 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 667590 ']' 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 -c /dev/fd/63 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:00.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:00.184 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # echo '{ 00:21:00.184 "subsystems": [ 00:21:00.184 { 00:21:00.184 "subsystem": "keyring", 00:21:00.184 "config": [ 00:21:00.184 { 00:21:00.184 "method": "keyring_file_add_key", 00:21:00.184 "params": { 00:21:00.184 "name": "key0", 00:21:00.184 "path": "/tmp/tmp.6wbBW5DnOI" 00:21:00.184 } 00:21:00.184 } 00:21:00.184 ] 00:21:00.184 }, 00:21:00.184 { 00:21:00.184 "subsystem": "iobuf", 00:21:00.184 "config": [ 00:21:00.184 { 00:21:00.184 "method": "iobuf_set_options", 00:21:00.184 "params": { 00:21:00.184 "small_pool_count": 8192, 00:21:00.184 "large_pool_count": 1024, 00:21:00.184 "small_bufsize": 8192, 00:21:00.184 "large_bufsize": 135168 00:21:00.184 } 00:21:00.184 } 00:21:00.184 ] 00:21:00.184 }, 00:21:00.184 { 00:21:00.184 "subsystem": "sock", 00:21:00.184 "config": [ 00:21:00.184 { 00:21:00.184 "method": "sock_set_default_impl", 00:21:00.184 "params": { 00:21:00.184 "impl_name": "posix" 00:21:00.184 } 00:21:00.184 }, 00:21:00.184 { 00:21:00.184 "method": "sock_impl_set_options", 00:21:00.184 "params": { 00:21:00.184 "impl_name": "ssl", 00:21:00.184 "recv_buf_size": 4096, 00:21:00.184 "send_buf_size": 4096, 00:21:00.184 "enable_recv_pipe": true, 00:21:00.184 "enable_quickack": false, 00:21:00.184 "enable_placement_id": 0, 00:21:00.184 "enable_zerocopy_send_server": true, 00:21:00.184 "enable_zerocopy_send_client": false, 00:21:00.184 "zerocopy_threshold": 0, 00:21:00.184 "tls_version": 0, 00:21:00.184 "enable_ktls": false 00:21:00.184 } 00:21:00.184 }, 00:21:00.184 { 00:21:00.184 "method": "sock_impl_set_options", 00:21:00.184 "params": { 00:21:00.184 "impl_name": "posix", 00:21:00.184 "recv_buf_size": 2097152, 00:21:00.184 "send_buf_size": 2097152, 00:21:00.184 "enable_recv_pipe": true, 00:21:00.184 "enable_quickack": false, 00:21:00.184 "enable_placement_id": 0, 00:21:00.184 "enable_zerocopy_send_server": true, 00:21:00.184 "enable_zerocopy_send_client": false, 00:21:00.184 "zerocopy_threshold": 0, 00:21:00.184 "tls_version": 0, 00:21:00.184 "enable_ktls": false 00:21:00.184 } 00:21:00.184 } 00:21:00.184 ] 00:21:00.184 }, 00:21:00.184 { 00:21:00.184 "subsystem": "vmd", 00:21:00.184 "config": [] 00:21:00.184 }, 00:21:00.184 { 00:21:00.185 "subsystem": "accel", 00:21:00.185 "config": [ 00:21:00.185 { 00:21:00.185 "method": "accel_set_options", 00:21:00.185 "params": { 00:21:00.185 "small_cache_size": 128, 00:21:00.185 "large_cache_size": 16, 00:21:00.185 "task_count": 2048, 00:21:00.185 "sequence_count": 2048, 00:21:00.185 "buf_count": 2048 00:21:00.185 } 00:21:00.185 } 00:21:00.185 ] 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "subsystem": "bdev", 00:21:00.185 "config": [ 00:21:00.185 { 00:21:00.185 "method": "bdev_set_options", 00:21:00.185 "params": { 00:21:00.185 "bdev_io_pool_size": 65535, 00:21:00.185 "bdev_io_cache_size": 256, 00:21:00.185 "bdev_auto_examine": true, 00:21:00.185 "iobuf_small_cache_size": 128, 00:21:00.185 "iobuf_large_cache_size": 16 00:21:00.185 } 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "method": "bdev_raid_set_options", 00:21:00.185 "params": { 00:21:00.185 "process_window_size_kb": 1024, 00:21:00.185 "process_max_bandwidth_mb_sec": 0 00:21:00.185 } 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "method": "bdev_iscsi_set_options", 00:21:00.185 "params": { 00:21:00.185 "timeout_sec": 30 00:21:00.185 } 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "method": "bdev_nvme_set_options", 00:21:00.185 "params": { 00:21:00.185 "action_on_timeout": "none", 00:21:00.185 "timeout_us": 0, 00:21:00.185 "timeout_admin_us": 0, 00:21:00.185 "keep_alive_timeout_ms": 10000, 00:21:00.185 "arbitration_burst": 0, 00:21:00.185 "low_priority_weight": 0, 00:21:00.185 "medium_priority_weight": 0, 00:21:00.185 "high_priority_weight": 0, 00:21:00.185 "nvme_adminq_poll_period_us": 10000, 00:21:00.185 "nvme_ioq_poll_period_us": 0, 00:21:00.185 "io_queue_requests": 512, 00:21:00.185 "delay_cmd_submit": true, 00:21:00.185 "transport_retry_count": 4, 00:21:00.185 "bdev_retry_count": 3, 00:21:00.185 "transport_ack_timeout": 0, 00:21:00.185 "ctrlr_loss_timeout_sec": 0, 00:21:00.185 "reconnect_delay_sec": 0, 00:21:00.185 "fast_io_fail_timeout_sec": 0, 00:21:00.185 "disable_auto_failback": false, 00:21:00.185 "generate_uuids": false, 00:21:00.185 "transport_tos": 0, 00:21:00.185 "nvme_error_stat": false, 00:21:00.185 "rdma_srq_size": 0, 00:21:00.185 "io_path_stat": false, 00:21:00.185 "allow_accel_sequence": false, 00:21:00.185 "rdma_max_cq_size": 0, 00:21:00.185 "rdma_cm_event_timeout_ms": 0, 00:21:00.185 "dhchap_digests": [ 00:21:00.185 "sha256", 00:21:00.185 "sha384", 00:21:00.185 "sha512" 00:21:00.185 ], 00:21:00.185 "dhchap_dhgroups": [ 00:21:00.185 "null", 00:21:00.185 "ffdhe2048", 00:21:00.185 "ffdhe3072", 00:21:00.185 "ffdhe4096", 00:21:00.185 "ffdhe6144", 00:21:00.185 "ffdhe8192" 00:21:00.185 ] 00:21:00.185 } 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "method": "bdev_nvme_attach_controller", 00:21:00.185 "params": { 00:21:00.185 "name": "nvme0", 00:21:00.185 "trtype": "TCP", 00:21:00.185 "adrfam": "IPv4", 00:21:00.185 "traddr": "10.0.0.2", 00:21:00.185 "trsvcid": "4420", 00:21:00.185 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:00.185 "prchk_reftag": false, 00:21:00.185 "prchk_guard": false, 00:21:00.185 "ctrlr_loss_timeout_sec": 0, 00:21:00.185 "reconnect_delay_sec": 0, 00:21:00.185 "fast_io_fail_timeout_sec": 0, 00:21:00.185 "psk": "key0", 00:21:00.185 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:00.185 "hdgst": false, 00:21:00.185 "ddgst": false, 00:21:00.185 "multipath": "multipath" 00:21:00.185 } 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "method": "bdev_nvme_set_hotplug", 00:21:00.185 "params": { 00:21:00.185 "period_us": 100000, 00:21:00.185 "enable": false 00:21:00.185 } 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "method": "bdev_enable_histogram", 00:21:00.185 "params": { 00:21:00.185 "name": "nvme0n1", 00:21:00.185 "enable": true 00:21:00.185 } 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "method": "bdev_wait_for_examine" 00:21:00.185 } 00:21:00.185 ] 00:21:00.185 }, 00:21:00.185 { 00:21:00.185 "subsystem": "nbd", 00:21:00.185 "config": [] 00:21:00.185 } 00:21:00.185 ] 00:21:00.185 }' 00:21:00.185 13:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:00.185 [2024-10-07 13:31:55.999415] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:00.185 [2024-10-07 13:31:55.999509] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid667590 ] 00:21:00.185 [2024-10-07 13:31:56.056792] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.445 [2024-10-07 13:31:56.166647] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:00.445 [2024-10-07 13:31:56.342687] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:01.382 13:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:01.382 13:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:21:01.382 13:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:01.382 13:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # jq -r '.[].name' 00:21:01.641 13:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:01.641 13:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@280 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:01.641 Running I/O for 1 seconds... 00:21:02.576 3410.00 IOPS, 13.32 MiB/s 00:21:02.576 Latency(us) 00:21:02.576 [2024-10-07T11:31:58.509Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:02.576 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:21:02.576 Verification LBA range: start 0x0 length 0x2000 00:21:02.576 nvme0n1 : 1.03 3441.30 13.44 0.00 0.00 36749.64 5776.88 39418.69 00:21:02.576 [2024-10-07T11:31:58.509Z] =================================================================================================================== 00:21:02.576 [2024-10-07T11:31:58.509Z] Total : 3441.30 13.44 0.00 0.00 36749.64 5776.88 39418.69 00:21:02.576 { 00:21:02.576 "results": [ 00:21:02.576 { 00:21:02.576 "job": "nvme0n1", 00:21:02.576 "core_mask": "0x2", 00:21:02.576 "workload": "verify", 00:21:02.576 "status": "finished", 00:21:02.576 "verify_range": { 00:21:02.576 "start": 0, 00:21:02.576 "length": 8192 00:21:02.576 }, 00:21:02.576 "queue_depth": 128, 00:21:02.576 "io_size": 4096, 00:21:02.576 "runtime": 1.028101, 00:21:02.576 "iops": 3441.296137247216, 00:21:02.576 "mibps": 13.442563036121937, 00:21:02.576 "io_failed": 0, 00:21:02.576 "io_timeout": 0, 00:21:02.576 "avg_latency_us": 36749.64164897514, 00:21:02.576 "min_latency_us": 5776.877037037037, 00:21:02.576 "max_latency_us": 39418.69037037037 00:21:02.576 } 00:21:02.576 ], 00:21:02.576 "core_count": 1 00:21:02.576 } 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@282 -- # trap - SIGINT SIGTERM EXIT 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@283 -- # cleanup 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@15 -- # process_shm --id 0 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@808 -- # type=--id 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@809 -- # id=0 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@820 -- # for n in $shm_files 00:21:02.576 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:02.576 nvmf_trace.0 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@823 -- # return 0 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@16 -- # killprocess 667590 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 667590 ']' 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 667590 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 667590 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 667590' 00:21:02.837 killing process with pid 667590 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 667590 00:21:02.837 Received shutdown signal, test time was about 1.000000 seconds 00:21:02.837 00:21:02.837 Latency(us) 00:21:02.837 [2024-10-07T11:31:58.770Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:02.837 [2024-10-07T11:31:58.770Z] =================================================================================================================== 00:21:02.837 [2024-10-07T11:31:58.770Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:02.837 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 667590 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@17 -- # nvmftestfini 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@121 -- # sync 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@124 -- # set +e 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:03.096 rmmod nvme_tcp 00:21:03.096 rmmod nvme_fabrics 00:21:03.096 rmmod nvme_keyring 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@128 -- # set -e 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@129 -- # return 0 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@515 -- # '[' -n 667439 ']' 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@516 -- # killprocess 667439 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 667439 ']' 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 667439 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 667439 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 667439' 00:21:03.096 killing process with pid 667439 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 667439 00:21:03.096 13:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 667439 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@297 -- # iptr 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-save 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-restore 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@302 -- # remove_spdk_ns 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:03.355 13:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@18 -- # rm -f /tmp/tmp.ZNGxsxQrO2 /tmp/tmp.QYwXpjQkLs /tmp/tmp.6wbBW5DnOI 00:21:05.892 00:21:05.892 real 1m26.637s 00:21:05.892 user 2m22.266s 00:21:05.892 sys 0m29.800s 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:05.892 ************************************ 00:21:05.892 END TEST nvmf_tls 00:21:05.892 ************************************ 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@42 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:05.892 ************************************ 00:21:05.892 START TEST nvmf_fips 00:21:05.892 ************************************ 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:05.892 * Looking for test storage... 00:21:05.892 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lcov --version 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:21:05.892 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=<' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=2 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@345 -- # : 1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 2 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=2 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 2 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=2 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # return 0 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:05.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:05.893 --rc genhtml_branch_coverage=1 00:21:05.893 --rc genhtml_function_coverage=1 00:21:05.893 --rc genhtml_legend=1 00:21:05.893 --rc geninfo_all_blocks=1 00:21:05.893 --rc geninfo_unexecuted_blocks=1 00:21:05.893 00:21:05.893 ' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:05.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:05.893 --rc genhtml_branch_coverage=1 00:21:05.893 --rc genhtml_function_coverage=1 00:21:05.893 --rc genhtml_legend=1 00:21:05.893 --rc geninfo_all_blocks=1 00:21:05.893 --rc geninfo_unexecuted_blocks=1 00:21:05.893 00:21:05.893 ' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:05.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:05.893 --rc genhtml_branch_coverage=1 00:21:05.893 --rc genhtml_function_coverage=1 00:21:05.893 --rc genhtml_legend=1 00:21:05.893 --rc geninfo_all_blocks=1 00:21:05.893 --rc geninfo_unexecuted_blocks=1 00:21:05.893 00:21:05.893 ' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:05.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:05.893 --rc genhtml_branch_coverage=1 00:21:05.893 --rc genhtml_function_coverage=1 00:21:05.893 --rc genhtml_legend=1 00:21:05.893 --rc geninfo_all_blocks=1 00:21:05.893 --rc geninfo_unexecuted_blocks=1 00:21:05.893 00:21:05.893 ' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # uname -s 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@15 -- # shopt -s extglob 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@5 -- # export PATH 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@51 -- # : 0 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:05.893 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@90 -- # check_openssl_version 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@84 -- # local target=3.0.0 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # openssl version 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # awk '{print $2}' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # ge 3.1.1 3.0.0 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@376 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=>=' 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=3 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=3 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@348 -- # : 1 00:21:05.893 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=3 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v++ )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 0 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=0 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 0 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=0 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # return 0 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # openssl info -modulesdir 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # openssl fipsinstall -help 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@102 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # export callback=build_openssl_config 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # callback=build_openssl_config 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@114 -- # build_openssl_config 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@38 -- # cat 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@58 -- # [[ ! -t 0 ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@59 -- # cat - 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # mapfile -t providers 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # openssl list -providers 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # grep name 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # : 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@650 -- # local es=0 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # type -t openssl 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # type -P openssl 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:05.894 Error setting digest 00:21:05.894 40C2966EFE7E0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:05.894 40C2966EFE7E0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # es=1 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@131 -- # nvmftestinit 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@309 -- # xtrace_disable 00:21:05.894 13:32:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@315 -- # pci_devs=() 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@315 -- # local -a pci_devs 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@316 -- # pci_net_devs=() 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@317 -- # pci_drivers=() 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@317 -- # local -A pci_drivers 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@319 -- # net_devs=() 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@319 -- # local -ga net_devs 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@320 -- # e810=() 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@320 -- # local -ga e810 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@321 -- # x722=() 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@321 -- # local -ga x722 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@322 -- # mlx=() 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@322 -- # local -ga mlx 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:21:08.427 Found 0000:84:00.0 (0x8086 - 0x159b) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:21:08.427 Found 0000:84:00.1 (0x8086 - 0x159b) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:21:08.427 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:21:08.428 Found net devices under 0000:84:00.0: cvl_0_0 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:21:08.428 Found net devices under 0000:84:00.1: cvl_0_1 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@440 -- # is_hw=yes 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:08.428 13:32:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:21:08.428 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:08.428 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:21:08.428 00:21:08.428 --- 10.0.0.2 ping statistics --- 00:21:08.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:08.428 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:08.428 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:08.428 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:21:08.428 00:21:08.428 --- 10.0.0.1 ping statistics --- 00:21:08.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:08.428 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@448 -- # return 0 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@507 -- # nvmfpid=669976 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@508 -- # waitforlisten 669976 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 669976 ']' 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:08.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:08.428 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:08.428 [2024-10-07 13:32:04.110572] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:08.428 [2024-10-07 13:32:04.110670] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:08.428 [2024-10-07 13:32:04.176514] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:08.428 [2024-10-07 13:32:04.279713] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:08.428 [2024-10-07 13:32:04.279786] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:08.428 [2024-10-07 13:32:04.279814] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:08.428 [2024-10-07 13:32:04.279826] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:08.428 [2024-10-07 13:32:04.279836] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:08.428 [2024-10-07 13:32:04.280503] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@134 -- # trap cleanup EXIT 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # mktemp -t spdk-psk.XXX 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # key_path=/tmp/spdk-psk.sPA 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@140 -- # chmod 0600 /tmp/spdk-psk.sPA 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /tmp/spdk-psk.sPA 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@22 -- # local key=/tmp/spdk-psk.sPA 00:21:08.688 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:08.947 [2024-10-07 13:32:04.669043] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:08.947 [2024-10-07 13:32:04.685036] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:08.947 [2024-10-07 13:32:04.685313] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:08.947 malloc0 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@148 -- # bdevperf_pid=670065 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@149 -- # waitforlisten 670065 /var/tmp/bdevperf.sock 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 670065 ']' 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:08.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:08.947 13:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:08.947 [2024-10-07 13:32:04.826289] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:08.947 [2024-10-07 13:32:04.826380] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid670065 ] 00:21:09.206 [2024-10-07 13:32:04.884137] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:09.206 [2024-10-07 13:32:04.990337] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:21:09.206 13:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:09.206 13:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:21:09.206 13:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/spdk-psk.sPA 00:21:09.773 13:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@152 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:21:09.773 [2024-10-07 13:32:05.658052] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:10.031 TLSTESTn1 00:21:10.031 13:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@156 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:10.031 Running I/O for 10 seconds... 00:21:12.350 3428.00 IOPS, 13.39 MiB/s [2024-10-07T11:32:09.221Z] 3401.00 IOPS, 13.29 MiB/s [2024-10-07T11:32:10.160Z] 3447.67 IOPS, 13.47 MiB/s [2024-10-07T11:32:11.107Z] 3485.50 IOPS, 13.62 MiB/s [2024-10-07T11:32:12.047Z] 3473.40 IOPS, 13.57 MiB/s [2024-10-07T11:32:12.983Z] 3467.17 IOPS, 13.54 MiB/s [2024-10-07T11:32:13.919Z] 3481.86 IOPS, 13.60 MiB/s [2024-10-07T11:32:14.981Z] 3491.88 IOPS, 13.64 MiB/s [2024-10-07T11:32:15.921Z] 3503.44 IOPS, 13.69 MiB/s [2024-10-07T11:32:15.921Z] 3505.00 IOPS, 13.69 MiB/s 00:21:19.988 Latency(us) 00:21:19.988 [2024-10-07T11:32:15.921Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:19.988 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:19.988 Verification LBA range: start 0x0 length 0x2000 00:21:19.988 TLSTESTn1 : 10.02 3509.61 13.71 0.00 0.00 36410.48 6844.87 36117.62 00:21:19.988 [2024-10-07T11:32:15.921Z] =================================================================================================================== 00:21:19.988 [2024-10-07T11:32:15.921Z] Total : 3509.61 13.71 0.00 0.00 36410.48 6844.87 36117.62 00:21:19.988 { 00:21:19.988 "results": [ 00:21:19.988 { 00:21:19.988 "job": "TLSTESTn1", 00:21:19.988 "core_mask": "0x4", 00:21:19.988 "workload": "verify", 00:21:19.988 "status": "finished", 00:21:19.988 "verify_range": { 00:21:19.988 "start": 0, 00:21:19.988 "length": 8192 00:21:19.988 }, 00:21:19.988 "queue_depth": 128, 00:21:19.988 "io_size": 4096, 00:21:19.988 "runtime": 10.023053, 00:21:19.988 "iops": 3509.6092976860446, 00:21:19.988 "mibps": 13.709411319086112, 00:21:19.988 "io_failed": 0, 00:21:19.988 "io_timeout": 0, 00:21:19.988 "avg_latency_us": 36410.47660914803, 00:21:19.988 "min_latency_us": 6844.8711111111115, 00:21:19.988 "max_latency_us": 36117.61777777778 00:21:19.988 } 00:21:19.988 ], 00:21:19.988 "core_count": 1 00:21:19.988 } 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@1 -- # cleanup 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@15 -- # process_shm --id 0 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@808 -- # type=--id 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@809 -- # id=0 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@820 -- # for n in $shm_files 00:21:20.248 13:32:15 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:20.248 nvmf_trace.0 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@823 -- # return 0 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@16 -- # killprocess 670065 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 670065 ']' 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 670065 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 670065 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 670065' 00:21:20.248 killing process with pid 670065 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 670065 00:21:20.248 Received shutdown signal, test time was about 10.000000 seconds 00:21:20.248 00:21:20.248 Latency(us) 00:21:20.248 [2024-10-07T11:32:16.181Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:20.248 [2024-10-07T11:32:16.181Z] =================================================================================================================== 00:21:20.248 [2024-10-07T11:32:16.181Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:20.248 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 670065 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@17 -- # nvmftestfini 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@121 -- # sync 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@124 -- # set +e 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:20.508 rmmod nvme_tcp 00:21:20.508 rmmod nvme_fabrics 00:21:20.508 rmmod nvme_keyring 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@128 -- # set -e 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@129 -- # return 0 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@515 -- # '[' -n 669976 ']' 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@516 -- # killprocess 669976 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 669976 ']' 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 669976 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 669976 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 669976' 00:21:20.508 killing process with pid 669976 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 669976 00:21:20.508 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 669976 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@297 -- # iptr 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-save 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-restore 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@302 -- # remove_spdk_ns 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:20.767 13:32:16 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@18 -- # rm -f /tmp/spdk-psk.sPA 00:21:23.306 00:21:23.306 real 0m17.393s 00:21:23.306 user 0m21.716s 00:21:23.306 sys 0m6.889s 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:23.306 ************************************ 00:21:23.306 END TEST nvmf_fips 00:21:23.306 ************************************ 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@43 -- # run_test nvmf_control_msg_list /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:23.306 ************************************ 00:21:23.306 START TEST nvmf_control_msg_list 00:21:23.306 ************************************ 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:21:23.306 * Looking for test storage... 00:21:23.306 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lcov --version 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # IFS=.-: 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # read -ra ver1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # IFS=.-: 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # read -ra ver2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@338 -- # local 'op=<' 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@340 -- # ver1_l=2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@341 -- # ver2_l=1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@344 -- # case "$op" in 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@345 -- # : 1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # decimal 1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # ver1[v]=1 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # decimal 2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # ver2[v]=2 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # return 0 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:23.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:23.306 --rc genhtml_branch_coverage=1 00:21:23.306 --rc genhtml_function_coverage=1 00:21:23.306 --rc genhtml_legend=1 00:21:23.306 --rc geninfo_all_blocks=1 00:21:23.306 --rc geninfo_unexecuted_blocks=1 00:21:23.306 00:21:23.306 ' 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:23.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:23.306 --rc genhtml_branch_coverage=1 00:21:23.306 --rc genhtml_function_coverage=1 00:21:23.306 --rc genhtml_legend=1 00:21:23.306 --rc geninfo_all_blocks=1 00:21:23.306 --rc geninfo_unexecuted_blocks=1 00:21:23.306 00:21:23.306 ' 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:23.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:23.306 --rc genhtml_branch_coverage=1 00:21:23.306 --rc genhtml_function_coverage=1 00:21:23.306 --rc genhtml_legend=1 00:21:23.306 --rc geninfo_all_blocks=1 00:21:23.306 --rc geninfo_unexecuted_blocks=1 00:21:23.306 00:21:23.306 ' 00:21:23.306 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:23.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:23.306 --rc genhtml_branch_coverage=1 00:21:23.306 --rc genhtml_function_coverage=1 00:21:23.306 --rc genhtml_legend=1 00:21:23.306 --rc geninfo_all_blocks=1 00:21:23.306 --rc geninfo_unexecuted_blocks=1 00:21:23.306 00:21:23.306 ' 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # uname -s 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@15 -- # shopt -s extglob 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@5 -- # export PATH 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@51 -- # : 0 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:23.307 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@12 -- # nvmftestinit 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@309 -- # xtrace_disable 00:21:23.307 13:32:18 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@315 -- # pci_devs=() 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@315 -- # local -a pci_devs 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@316 -- # pci_net_devs=() 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@317 -- # pci_drivers=() 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@317 -- # local -A pci_drivers 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@319 -- # net_devs=() 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@319 -- # local -ga net_devs 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@320 -- # e810=() 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@320 -- # local -ga e810 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@321 -- # x722=() 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@321 -- # local -ga x722 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@322 -- # mlx=() 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@322 -- # local -ga mlx 00:21:25.209 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:21:25.468 Found 0000:84:00.0 (0x8086 - 0x159b) 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:25.468 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:21:25.469 Found 0000:84:00.1 (0x8086 - 0x159b) 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:25.469 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:21:25.481 Found net devices under 0000:84:00.0: cvl_0_0 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:21:25.481 Found net devices under 0000:84:00.1: cvl_0_1 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@440 -- # is_hw=yes 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:21:25.481 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:25.481 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:21:25.481 00:21:25.481 --- 10.0.0.2 ping statistics --- 00:21:25.481 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:25.481 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:25.481 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:25.481 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:21:25.481 00:21:25.481 --- 10.0.0.1 ping statistics --- 00:21:25.481 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:25.481 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@448 -- # return 0 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@13 -- # nvmfappstart 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@507 -- # nvmfpid=673411 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@508 -- # waitforlisten 673411 00:21:25.481 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@831 -- # '[' -z 673411 ']' 00:21:25.482 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:25.482 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:25.482 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:25.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:25.482 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:25.482 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.482 [2024-10-07 13:32:21.352327] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:25.482 [2024-10-07 13:32:21.352400] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:25.741 [2024-10-07 13:32:21.414834] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:25.741 [2024-10-07 13:32:21.515924] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:25.741 [2024-10-07 13:32:21.515982] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:25.741 [2024-10-07 13:32:21.516006] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:25.741 [2024-10-07 13:32:21.516017] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:25.741 [2024-10-07 13:32:21.516027] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:25.741 [2024-10-07 13:32:21.516687] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@864 -- # return 0 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@16 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@19 -- # rpc_cmd nvmf_create_transport '-t tcp -o' --in-capsule-data-size 768 --control-msg-num 1 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.741 [2024-10-07 13:32:21.655964] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.741 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:26.000 Malloc0 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:26.000 [2024-10-07 13:32:21.703432] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@27 -- # perf_pid1=673438 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x2 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@29 -- # perf_pid2=673439 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x4 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@31 -- # perf_pid3=673440 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x8 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:21:26.000 13:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@33 -- # wait 673438 00:21:26.000 [2024-10-07 13:32:21.772454] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:26.000 [2024-10-07 13:32:21.772795] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:26.000 [2024-10-07 13:32:21.773089] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:26.936 Initializing NVMe Controllers 00:21:26.936 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2024-07.io.spdk:cnode0 00:21:26.936 Associating TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 2 00:21:26.936 Initialization complete. Launching workers. 00:21:26.936 ======================================================== 00:21:26.936 Latency(us) 00:21:26.936 Device Information : IOPS MiB/s Average min max 00:21:26.936 TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 2: 25.00 0.10 40972.64 40764.07 41811.32 00:21:26.936 ======================================================== 00:21:26.936 Total : 25.00 0.10 40972.64 40764.07 41811.32 00:21:26.936 00:21:27.196 Initializing NVMe Controllers 00:21:27.196 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2024-07.io.spdk:cnode0 00:21:27.196 Associating TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 3 00:21:27.196 Initialization complete. Launching workers. 00:21:27.196 ======================================================== 00:21:27.196 Latency(us) 00:21:27.196 Device Information : IOPS MiB/s Average min max 00:21:27.196 TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 3: 3527.00 13.78 282.86 167.74 639.01 00:21:27.196 ======================================================== 00:21:27.196 Total : 3527.00 13.78 282.86 167.74 639.01 00:21:27.196 00:21:27.196 Initializing NVMe Controllers 00:21:27.196 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2024-07.io.spdk:cnode0 00:21:27.196 Associating TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 1 00:21:27.196 Initialization complete. Launching workers. 00:21:27.196 ======================================================== 00:21:27.196 Latency(us) 00:21:27.196 Device Information : IOPS MiB/s Average min max 00:21:27.196 TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 1: 3594.97 14.04 277.56 152.27 599.31 00:21:27.196 ======================================================== 00:21:27.196 Total : 3594.97 14.04 277.56 152.27 599.31 00:21:27.196 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@34 -- # wait 673439 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@35 -- # wait 673440 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@38 -- # nvmftestfini 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@121 -- # sync 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@124 -- # set +e 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:27.196 rmmod nvme_tcp 00:21:27.196 rmmod nvme_fabrics 00:21:27.196 rmmod nvme_keyring 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@128 -- # set -e 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@129 -- # return 0 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@515 -- # '[' -n 673411 ']' 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@516 -- # killprocess 673411 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@950 -- # '[' -z 673411 ']' 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@954 -- # kill -0 673411 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # uname 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:27.196 13:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 673411 00:21:27.196 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:27.196 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:27.196 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@968 -- # echo 'killing process with pid 673411' 00:21:27.196 killing process with pid 673411 00:21:27.196 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@969 -- # kill 673411 00:21:27.196 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@974 -- # wait 673411 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@297 -- # iptr 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-save 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-restore 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@302 -- # remove_spdk_ns 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:27.462 13:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:21:30.011 00:21:30.011 real 0m6.559s 00:21:30.011 user 0m5.630s 00:21:30.011 sys 0m2.823s 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:30.011 ************************************ 00:21:30.011 END TEST nvmf_control_msg_list 00:21:30.011 ************************************ 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@44 -- # run_test nvmf_wait_for_buf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:30.011 ************************************ 00:21:30.011 START TEST nvmf_wait_for_buf 00:21:30.011 ************************************ 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:21:30.011 * Looking for test storage... 00:21:30.011 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lcov --version 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # IFS=.-: 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # read -ra ver1 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # IFS=.-: 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # read -ra ver2 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@338 -- # local 'op=<' 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@340 -- # ver1_l=2 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@341 -- # ver2_l=1 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@344 -- # case "$op" in 00:21:30.011 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@345 -- # : 1 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # decimal 1 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=1 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 1 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # ver1[v]=1 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # decimal 2 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=2 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 2 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # ver2[v]=2 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # return 0 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:30.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.012 --rc genhtml_branch_coverage=1 00:21:30.012 --rc genhtml_function_coverage=1 00:21:30.012 --rc genhtml_legend=1 00:21:30.012 --rc geninfo_all_blocks=1 00:21:30.012 --rc geninfo_unexecuted_blocks=1 00:21:30.012 00:21:30.012 ' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:30.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.012 --rc genhtml_branch_coverage=1 00:21:30.012 --rc genhtml_function_coverage=1 00:21:30.012 --rc genhtml_legend=1 00:21:30.012 --rc geninfo_all_blocks=1 00:21:30.012 --rc geninfo_unexecuted_blocks=1 00:21:30.012 00:21:30.012 ' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:30.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.012 --rc genhtml_branch_coverage=1 00:21:30.012 --rc genhtml_function_coverage=1 00:21:30.012 --rc genhtml_legend=1 00:21:30.012 --rc geninfo_all_blocks=1 00:21:30.012 --rc geninfo_unexecuted_blocks=1 00:21:30.012 00:21:30.012 ' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:30.012 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:30.012 --rc genhtml_branch_coverage=1 00:21:30.012 --rc genhtml_function_coverage=1 00:21:30.012 --rc genhtml_legend=1 00:21:30.012 --rc geninfo_all_blocks=1 00:21:30.012 --rc geninfo_unexecuted_blocks=1 00:21:30.012 00:21:30.012 ' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # uname -s 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@15 -- # shopt -s extglob 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@5 -- # export PATH 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@51 -- # : 0 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:30.012 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@12 -- # nvmftestinit 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@309 -- # xtrace_disable 00:21:30.012 13:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:31.916 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:21:31.916 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@315 -- # pci_devs=() 00:21:31.916 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@315 -- # local -a pci_devs 00:21:31.916 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@316 -- # pci_net_devs=() 00:21:31.916 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:21:31.916 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@317 -- # pci_drivers=() 00:21:32.175 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@317 -- # local -A pci_drivers 00:21:32.175 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@319 -- # net_devs=() 00:21:32.175 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@319 -- # local -ga net_devs 00:21:32.175 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@320 -- # e810=() 00:21:32.175 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@320 -- # local -ga e810 00:21:32.175 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@321 -- # x722=() 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@321 -- # local -ga x722 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@322 -- # mlx=() 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@322 -- # local -ga mlx 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:21:32.176 Found 0000:84:00.0 (0x8086 - 0x159b) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:21:32.176 Found 0000:84:00.1 (0x8086 - 0x159b) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:21:32.176 Found net devices under 0000:84:00.0: cvl_0_0 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:21:32.176 Found net devices under 0000:84:00.1: cvl_0_1 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@440 -- # is_hw=yes 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:21:32.176 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:32.176 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:21:32.176 00:21:32.176 --- 10.0.0.2 ping statistics --- 00:21:32.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:32.176 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:32.176 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:32.176 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:21:32.176 00:21:32.176 --- 10.0.0.1 ping statistics --- 00:21:32.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:32.176 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@448 -- # return 0 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:32.176 13:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:32.176 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@13 -- # nvmfappstart --wait-for-rpc 00:21:32.176 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:32.176 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:32.176 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.176 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@507 -- # nvmfpid=675645 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@508 -- # waitforlisten 675645 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@831 -- # '[' -z 675645 ']' 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:32.177 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:32.177 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.177 [2024-10-07 13:32:28.076976] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:32.177 [2024-10-07 13:32:28.077046] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:32.435 [2024-10-07 13:32:28.137939] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:32.435 [2024-10-07 13:32:28.237761] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:32.435 [2024-10-07 13:32:28.237832] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:32.435 [2024-10-07 13:32:28.237852] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:32.435 [2024-10-07 13:32:28.237863] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:32.435 [2024-10-07 13:32:28.237873] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:32.435 [2024-10-07 13:32:28.238515] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@864 -- # return 0 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@16 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@19 -- # rpc_cmd accel_set_options --small-cache-size 0 --large-cache-size 0 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@20 -- # rpc_cmd iobuf_set_options --small-pool-count 154 --small_bufsize=8192 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@21 -- # rpc_cmd framework_start_init 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.435 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@22 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.693 Malloc0 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@23 -- # rpc_cmd nvmf_create_transport '-t tcp -o' -u 8192 -n 24 -b 24 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.693 [2024-10-07 13:32:28.437576] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a -s SPDK00000000000001 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.693 [2024-10-07 13:32:28.461813] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:32.693 13:32:28 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 4 -o 131072 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:21:32.693 [2024-10-07 13:32:28.533646] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:34.082 Initializing NVMe Controllers 00:21:34.082 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2024-07.io.spdk:cnode0 00:21:34.082 Associating TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 0 00:21:34.082 Initialization complete. Launching workers. 00:21:34.082 ======================================================== 00:21:34.082 Latency(us) 00:21:34.082 Device Information : IOPS MiB/s Average min max 00:21:34.082 TCP (addr:10.0.0.2 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 0: 129.00 16.12 32226.07 7131.44 63850.43 00:21:34.082 ======================================================== 00:21:34.082 Total : 129.00 16.12 32226.07 7131.44 63850.43 00:21:34.082 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # rpc_cmd iobuf_get_stats 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # jq -r '.[] | select(.module == "nvmf_TCP") | .small_pool.retry' 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # retry_count=2038 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@33 -- # [[ 2038 -eq 0 ]] 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@38 -- # nvmftestfini 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@121 -- # sync 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@124 -- # set +e 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:34.082 rmmod nvme_tcp 00:21:34.082 rmmod nvme_fabrics 00:21:34.082 rmmod nvme_keyring 00:21:34.082 13:32:29 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:34.082 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@128 -- # set -e 00:21:34.082 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@129 -- # return 0 00:21:34.082 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@515 -- # '[' -n 675645 ']' 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@516 -- # killprocess 675645 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@950 -- # '[' -z 675645 ']' 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@954 -- # kill -0 675645 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # uname 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 675645 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 675645' 00:21:34.340 killing process with pid 675645 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@969 -- # kill 675645 00:21:34.340 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@974 -- # wait 675645 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@297 -- # iptr 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-save 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-restore 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@302 -- # remove_spdk_ns 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:34.599 13:32:30 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:21:36.501 00:21:36.501 real 0m6.945s 00:21:36.501 user 0m3.241s 00:21:36.501 sys 0m2.167s 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:36.501 ************************************ 00:21:36.501 END TEST nvmf_wait_for_buf 00:21:36.501 ************************************ 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@47 -- # '[' 0 -eq 1 ']' 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@53 -- # [[ phy == phy ]] 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@54 -- # '[' tcp = tcp ']' 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@55 -- # gather_supported_nvmf_pci_devs 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@309 -- # xtrace_disable 00:21:36.501 13:32:32 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@315 -- # pci_devs=() 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@315 -- # local -a pci_devs 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@316 -- # pci_net_devs=() 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@317 -- # pci_drivers=() 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@317 -- # local -A pci_drivers 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@319 -- # net_devs=() 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@319 -- # local -ga net_devs 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@320 -- # e810=() 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@320 -- # local -ga e810 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@321 -- # x722=() 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@321 -- # local -ga x722 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@322 -- # mlx=() 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@322 -- # local -ga mlx 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:21:39.033 Found 0000:84:00.0 (0x8086 - 0x159b) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:21:39.033 Found 0000:84:00.1 (0x8086 - 0x159b) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:21:39.033 Found net devices under 0000:84:00.0: cvl_0_0 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:21:39.033 Found net devices under 0000:84:00.1: cvl_0_1 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@56 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@57 -- # (( 2 > 0 )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@58 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:39.033 ************************************ 00:21:39.033 START TEST nvmf_perf_adq 00:21:39.033 ************************************ 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:39.033 * Looking for test storage... 00:21:39.033 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1681 -- # lcov --version 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@336 -- # IFS=.-: 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@336 -- # read -ra ver1 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@337 -- # IFS=.-: 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@337 -- # read -ra ver2 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@338 -- # local 'op=<' 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@340 -- # ver1_l=2 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@341 -- # ver2_l=1 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@344 -- # case "$op" in 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@345 -- # : 1 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:39.033 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@365 -- # decimal 1 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@353 -- # local d=1 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@355 -- # echo 1 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@365 -- # ver1[v]=1 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@366 -- # decimal 2 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@353 -- # local d=2 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@355 -- # echo 2 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@366 -- # ver2[v]=2 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@368 -- # return 0 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:39.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:39.034 --rc genhtml_branch_coverage=1 00:21:39.034 --rc genhtml_function_coverage=1 00:21:39.034 --rc genhtml_legend=1 00:21:39.034 --rc geninfo_all_blocks=1 00:21:39.034 --rc geninfo_unexecuted_blocks=1 00:21:39.034 00:21:39.034 ' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:39.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:39.034 --rc genhtml_branch_coverage=1 00:21:39.034 --rc genhtml_function_coverage=1 00:21:39.034 --rc genhtml_legend=1 00:21:39.034 --rc geninfo_all_blocks=1 00:21:39.034 --rc geninfo_unexecuted_blocks=1 00:21:39.034 00:21:39.034 ' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:39.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:39.034 --rc genhtml_branch_coverage=1 00:21:39.034 --rc genhtml_function_coverage=1 00:21:39.034 --rc genhtml_legend=1 00:21:39.034 --rc geninfo_all_blocks=1 00:21:39.034 --rc geninfo_unexecuted_blocks=1 00:21:39.034 00:21:39.034 ' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:39.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:39.034 --rc genhtml_branch_coverage=1 00:21:39.034 --rc genhtml_function_coverage=1 00:21:39.034 --rc genhtml_legend=1 00:21:39.034 --rc geninfo_all_blocks=1 00:21:39.034 --rc geninfo_unexecuted_blocks=1 00:21:39.034 00:21:39.034 ' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@7 -- # uname -s 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@15 -- # shopt -s extglob 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- paths/export.sh@5 -- # export PATH 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@51 -- # : 0 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:39.034 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@309 -- # xtrace_disable 00:21:39.034 13:32:34 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@315 -- # pci_devs=() 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@315 -- # local -a pci_devs 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@316 -- # pci_net_devs=() 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@317 -- # pci_drivers=() 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@317 -- # local -A pci_drivers 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@319 -- # net_devs=() 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@319 -- # local -ga net_devs 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@320 -- # e810=() 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@320 -- # local -ga e810 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@321 -- # x722=() 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@321 -- # local -ga x722 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@322 -- # mlx=() 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@322 -- # local -ga mlx 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:21:40.937 Found 0000:84:00.0 (0x8086 - 0x159b) 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:40.937 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:21:40.938 Found 0000:84:00.1 (0x8086 - 0x159b) 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:21:40.938 Found net devices under 0000:84:00.0: cvl_0_0 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:21:40.938 Found net devices under 0000:84:00.1: cvl_0_1 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:21:40.938 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:41.195 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:41.195 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:41.195 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@68 -- # adq_reload_driver 00:21:41.195 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@58 -- # modprobe -a sch_mqprio 00:21:41.195 13:32:36 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@61 -- # rmmod ice 00:21:41.763 13:32:37 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@62 -- # modprobe ice 00:21:43.666 13:32:39 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@63 -- # sleep 5 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@76 -- # nvmftestinit 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:48.944 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@309 -- # xtrace_disable 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@315 -- # pci_devs=() 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@315 -- # local -a pci_devs 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@316 -- # pci_net_devs=() 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@317 -- # pci_drivers=() 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@317 -- # local -A pci_drivers 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@319 -- # net_devs=() 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@319 -- # local -ga net_devs 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@320 -- # e810=() 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@320 -- # local -ga e810 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@321 -- # x722=() 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@321 -- # local -ga x722 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@322 -- # mlx=() 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@322 -- # local -ga mlx 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:21:48.945 Found 0000:84:00.0 (0x8086 - 0x159b) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:21:48.945 Found 0000:84:00.1 (0x8086 - 0x159b) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:21:48.945 Found net devices under 0000:84:00.0: cvl_0_0 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@416 -- # [[ up == up ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:21:48.945 Found net devices under 0000:84:00.1: cvl_0_1 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@440 -- # is_hw=yes 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:21:48.945 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:21:48.946 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:48.946 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:21:48.946 00:21:48.946 --- 10.0.0.2 ping statistics --- 00:21:48.946 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:48.946 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:48.946 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:48.946 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:21:48.946 00:21:48.946 --- 10.0.0.1 ping statistics --- 00:21:48.946 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:48.946 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@448 -- # return 0 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@77 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@507 -- # nvmfpid=680396 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@508 -- # waitforlisten 680396 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@831 -- # '[' -z 680396 ']' 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:48.946 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:48.946 [2024-10-07 13:32:44.626703] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:48.946 [2024-10-07 13:32:44.626801] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:48.946 [2024-10-07 13:32:44.695145] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:48.946 [2024-10-07 13:32:44.803437] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:48.946 [2024-10-07 13:32:44.803509] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:48.946 [2024-10-07 13:32:44.803539] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:48.946 [2024-10-07 13:32:44.803552] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:48.946 [2024-10-07 13:32:44.803562] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:48.946 [2024-10-07 13:32:44.805356] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:48.946 [2024-10-07 13:32:44.805422] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:21:48.946 [2024-10-07 13:32:44.805502] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:21:48.946 [2024-10-07 13:32:44.805520] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@864 -- # return 0 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:48.946 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@78 -- # adq_configure_nvmf_target 0 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@42 -- # rpc_cmd sock_get_default_impl 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@42 -- # jq -r .impl_name 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@42 -- # socket_impl=posix 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@43 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@44 -- # rpc_cmd framework_start_init 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:44 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 [2024-10-07 13:32:45.052164] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@46 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 Malloc1 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:49.204 [2024-10-07 13:32:45.105695] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@82 -- # perfpid=680546 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@83 -- # sleep 2 00:21:49.204 13:32:45 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@85 -- # rpc_cmd nvmf_get_stats 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@85 -- # nvmf_stats='{ 00:21:51.734 "tick_rate": 2700000000, 00:21:51.734 "poll_groups": [ 00:21:51.734 { 00:21:51.734 "name": "nvmf_tgt_poll_group_000", 00:21:51.734 "admin_qpairs": 1, 00:21:51.734 "io_qpairs": 1, 00:21:51.734 "current_admin_qpairs": 1, 00:21:51.734 "current_io_qpairs": 1, 00:21:51.734 "pending_bdev_io": 0, 00:21:51.734 "completed_nvme_io": 19251, 00:21:51.734 "transports": [ 00:21:51.734 { 00:21:51.734 "trtype": "TCP" 00:21:51.734 } 00:21:51.734 ] 00:21:51.734 }, 00:21:51.734 { 00:21:51.734 "name": "nvmf_tgt_poll_group_001", 00:21:51.734 "admin_qpairs": 0, 00:21:51.734 "io_qpairs": 1, 00:21:51.734 "current_admin_qpairs": 0, 00:21:51.734 "current_io_qpairs": 1, 00:21:51.734 "pending_bdev_io": 0, 00:21:51.734 "completed_nvme_io": 19148, 00:21:51.734 "transports": [ 00:21:51.734 { 00:21:51.734 "trtype": "TCP" 00:21:51.734 } 00:21:51.734 ] 00:21:51.734 }, 00:21:51.734 { 00:21:51.734 "name": "nvmf_tgt_poll_group_002", 00:21:51.734 "admin_qpairs": 0, 00:21:51.734 "io_qpairs": 1, 00:21:51.734 "current_admin_qpairs": 0, 00:21:51.734 "current_io_qpairs": 1, 00:21:51.734 "pending_bdev_io": 0, 00:21:51.734 "completed_nvme_io": 19295, 00:21:51.734 "transports": [ 00:21:51.734 { 00:21:51.734 "trtype": "TCP" 00:21:51.734 } 00:21:51.734 ] 00:21:51.734 }, 00:21:51.734 { 00:21:51.734 "name": "nvmf_tgt_poll_group_003", 00:21:51.734 "admin_qpairs": 0, 00:21:51.734 "io_qpairs": 1, 00:21:51.734 "current_admin_qpairs": 0, 00:21:51.734 "current_io_qpairs": 1, 00:21:51.734 "pending_bdev_io": 0, 00:21:51.734 "completed_nvme_io": 19004, 00:21:51.734 "transports": [ 00:21:51.734 { 00:21:51.734 "trtype": "TCP" 00:21:51.734 } 00:21:51.734 ] 00:21:51.734 } 00:21:51.734 ] 00:21:51.734 }' 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@86 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@86 -- # wc -l 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@86 -- # count=4 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@87 -- # [[ 4 -ne 4 ]] 00:21:51.734 13:32:47 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@91 -- # wait 680546 00:21:59.853 Initializing NVMe Controllers 00:21:59.853 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:59.853 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:59.853 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:59.853 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:59.853 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:59.853 Initialization complete. Launching workers. 00:21:59.853 ======================================================== 00:21:59.853 Latency(us) 00:21:59.853 Device Information : IOPS MiB/s Average min max 00:21:59.853 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10038.74 39.21 6376.75 1575.98 10842.56 00:21:59.853 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10123.34 39.54 6320.96 2337.30 10797.06 00:21:59.853 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10252.32 40.05 6241.86 2720.32 10412.66 00:21:59.853 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10170.83 39.73 6291.21 2145.79 10614.14 00:21:59.853 ======================================================== 00:21:59.853 Total : 40585.24 158.54 6307.32 1575.98 10842.56 00:21:59.853 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@92 -- # nvmftestfini 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@121 -- # sync 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@124 -- # set +e 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:59.853 rmmod nvme_tcp 00:21:59.853 rmmod nvme_fabrics 00:21:59.853 rmmod nvme_keyring 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@128 -- # set -e 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@129 -- # return 0 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@515 -- # '[' -n 680396 ']' 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@516 -- # killprocess 680396 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@950 -- # '[' -z 680396 ']' 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@954 -- # kill -0 680396 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@955 -- # uname 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 680396 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@968 -- # echo 'killing process with pid 680396' 00:21:59.853 killing process with pid 680396 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@969 -- # kill 680396 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@974 -- # wait 680396 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@297 -- # iptr 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@789 -- # iptables-save 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@789 -- # iptables-restore 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@302 -- # remove_spdk_ns 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:59.853 13:32:55 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:01.757 13:32:57 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:22:02.016 13:32:57 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@94 -- # adq_reload_driver 00:22:02.016 13:32:57 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@58 -- # modprobe -a sch_mqprio 00:22:02.016 13:32:57 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@61 -- # rmmod ice 00:22:02.596 13:32:58 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@62 -- # modprobe ice 00:22:04.588 13:33:00 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@63 -- # sleep 5 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@97 -- # nvmftestinit 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@474 -- # prepare_net_devs 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@436 -- # local -g is_hw=no 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@438 -- # remove_spdk_ns 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@309 -- # xtrace_disable 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@315 -- # pci_devs=() 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@315 -- # local -a pci_devs 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@316 -- # pci_net_devs=() 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@317 -- # pci_drivers=() 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@317 -- # local -A pci_drivers 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@319 -- # net_devs=() 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@319 -- # local -ga net_devs 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@320 -- # e810=() 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@320 -- # local -ga e810 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@321 -- # x722=() 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@321 -- # local -ga x722 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@322 -- # mlx=() 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@322 -- # local -ga mlx 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:09.862 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:22:09.863 Found 0000:84:00.0 (0x8086 - 0x159b) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:22:09.863 Found 0000:84:00.1 (0x8086 - 0x159b) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:22:09.863 Found net devices under 0000:84:00.0: cvl_0_0 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:22:09.863 Found net devices under 0000:84:00.1: cvl_0_1 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@440 -- # is_hw=yes 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:22:09.863 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:09.863 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:22:09.863 00:22:09.863 --- 10.0.0.2 ping statistics --- 00:22:09.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.863 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:09.863 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:09.863 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:22:09.863 00:22:09.863 --- 10.0.0.1 ping statistics --- 00:22:09.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.863 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@448 -- # return 0 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:09.863 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@98 -- # adq_configure_driver 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:09.874 net.core.busy_poll = 1 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:09.874 net.core.busy_read = 1 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@99 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:09.874 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@507 -- # nvmfpid=683280 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@508 -- # waitforlisten 683280 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@831 -- # '[' -z 683280 ']' 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:09.875 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:09.875 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:09.875 [2024-10-07 13:33:05.635638] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:09.875 [2024-10-07 13:33:05.635721] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:09.875 [2024-10-07 13:33:05.701120] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:10.132 [2024-10-07 13:33:05.810923] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:10.132 [2024-10-07 13:33:05.810984] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:10.132 [2024-10-07 13:33:05.811014] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:10.132 [2024-10-07 13:33:05.811026] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:10.132 [2024-10-07 13:33:05.811037] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:10.132 [2024-10-07 13:33:05.812974] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:22:10.132 [2024-10-07 13:33:05.813041] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:22:10.132 [2024-10-07 13:33:05.813109] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:10.132 [2024-10-07 13:33:05.813106] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@864 -- # return 0 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@100 -- # adq_configure_nvmf_target 1 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@42 -- # rpc_cmd sock_get_default_impl 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@42 -- # jq -r .impl_name 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@42 -- # socket_impl=posix 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@43 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@44 -- # rpc_cmd framework_start_init 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.132 13:33:05 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.132 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.132 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:10.132 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.132 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.132 [2024-10-07 13:33:06.058803] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@46 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.391 Malloc1 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:10.391 [2024-10-07 13:33:06.110193] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@104 -- # perfpid=683312 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@105 -- # sleep 2 00:22:10.391 13:33:06 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@107 -- # rpc_cmd nvmf_get_stats 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@107 -- # nvmf_stats='{ 00:22:12.289 "tick_rate": 2700000000, 00:22:12.289 "poll_groups": [ 00:22:12.289 { 00:22:12.289 "name": "nvmf_tgt_poll_group_000", 00:22:12.289 "admin_qpairs": 1, 00:22:12.289 "io_qpairs": 1, 00:22:12.289 "current_admin_qpairs": 1, 00:22:12.289 "current_io_qpairs": 1, 00:22:12.289 "pending_bdev_io": 0, 00:22:12.289 "completed_nvme_io": 23250, 00:22:12.289 "transports": [ 00:22:12.289 { 00:22:12.289 "trtype": "TCP" 00:22:12.289 } 00:22:12.289 ] 00:22:12.289 }, 00:22:12.289 { 00:22:12.289 "name": "nvmf_tgt_poll_group_001", 00:22:12.289 "admin_qpairs": 0, 00:22:12.289 "io_qpairs": 3, 00:22:12.289 "current_admin_qpairs": 0, 00:22:12.289 "current_io_qpairs": 3, 00:22:12.289 "pending_bdev_io": 0, 00:22:12.289 "completed_nvme_io": 26219, 00:22:12.289 "transports": [ 00:22:12.289 { 00:22:12.289 "trtype": "TCP" 00:22:12.289 } 00:22:12.289 ] 00:22:12.289 }, 00:22:12.289 { 00:22:12.289 "name": "nvmf_tgt_poll_group_002", 00:22:12.289 "admin_qpairs": 0, 00:22:12.289 "io_qpairs": 0, 00:22:12.289 "current_admin_qpairs": 0, 00:22:12.289 "current_io_qpairs": 0, 00:22:12.289 "pending_bdev_io": 0, 00:22:12.289 "completed_nvme_io": 0, 00:22:12.289 "transports": [ 00:22:12.289 { 00:22:12.289 "trtype": "TCP" 00:22:12.289 } 00:22:12.289 ] 00:22:12.289 }, 00:22:12.289 { 00:22:12.289 "name": "nvmf_tgt_poll_group_003", 00:22:12.289 "admin_qpairs": 0, 00:22:12.289 "io_qpairs": 0, 00:22:12.289 "current_admin_qpairs": 0, 00:22:12.289 "current_io_qpairs": 0, 00:22:12.289 "pending_bdev_io": 0, 00:22:12.289 "completed_nvme_io": 0, 00:22:12.289 "transports": [ 00:22:12.289 { 00:22:12.289 "trtype": "TCP" 00:22:12.289 } 00:22:12.289 ] 00:22:12.289 } 00:22:12.289 ] 00:22:12.289 }' 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@108 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@108 -- # wc -l 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@108 -- # count=2 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@109 -- # [[ 2 -lt 2 ]] 00:22:12.289 13:33:08 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@114 -- # wait 683312 00:22:20.413 Initializing NVMe Controllers 00:22:20.413 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:20.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:20.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:20.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:20.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:20.413 Initialization complete. Launching workers. 00:22:20.413 ======================================================== 00:22:20.413 Latency(us) 00:22:20.413 Device Information : IOPS MiB/s Average min max 00:22:20.413 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4460.20 17.42 14349.59 1670.93 62926.47 00:22:20.413 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4400.40 17.19 14550.18 2181.96 62439.19 00:22:20.413 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 12990.70 50.74 4926.75 1613.78 46004.79 00:22:20.413 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4486.50 17.53 14270.15 2011.17 62534.58 00:22:20.413 ======================================================== 00:22:20.413 Total : 26337.80 102.88 9721.91 1613.78 62926.47 00:22:20.413 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@115 -- # nvmftestfini 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@121 -- # sync 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@124 -- # set +e 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:20.413 rmmod nvme_tcp 00:22:20.413 rmmod nvme_fabrics 00:22:20.413 rmmod nvme_keyring 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@128 -- # set -e 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@129 -- # return 0 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@515 -- # '[' -n 683280 ']' 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@516 -- # killprocess 683280 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@950 -- # '[' -z 683280 ']' 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@954 -- # kill -0 683280 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@955 -- # uname 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 683280 00:22:20.413 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:22:20.414 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:22:20.414 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@968 -- # echo 'killing process with pid 683280' 00:22:20.414 killing process with pid 683280 00:22:20.414 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@969 -- # kill 683280 00:22:20.414 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@974 -- # wait 683280 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@297 -- # iptr 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@789 -- # iptables-save 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@789 -- # iptables-restore 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@302 -- # remove_spdk_ns 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:20.982 13:33:16 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- target/perf_adq.sh@117 -- # trap - SIGINT SIGTERM EXIT 00:22:24.271 00:22:24.271 real 0m45.074s 00:22:24.271 user 2m40.501s 00:22:24.271 sys 0m9.506s 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@1126 -- # xtrace_disable 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_perf_adq -- common/autotest_common.sh@10 -- # set +x 00:22:24.271 ************************************ 00:22:24.271 END TEST nvmf_perf_adq 00:22:24.271 ************************************ 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@65 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:22:24.271 ************************************ 00:22:24.271 START TEST nvmf_shutdown 00:22:24.271 ************************************ 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:24.271 * Looking for test storage... 00:22:24.271 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1681 -- # lcov --version 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@333 -- # local ver1 ver1_l 00:22:24.271 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@334 -- # local ver2 ver2_l 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@336 -- # IFS=.-: 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@336 -- # read -ra ver1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@337 -- # IFS=.-: 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@337 -- # read -ra ver2 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@338 -- # local 'op=<' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@340 -- # ver1_l=2 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@341 -- # ver2_l=1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@344 -- # case "$op" in 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@345 -- # : 1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@364 -- # (( v = 0 )) 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@365 -- # decimal 1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@353 -- # local d=1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@355 -- # echo 1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@365 -- # ver1[v]=1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@366 -- # decimal 2 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@353 -- # local d=2 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@355 -- # echo 2 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@366 -- # ver2[v]=2 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@368 -- # return 0 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:22:24.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:24.272 --rc genhtml_branch_coverage=1 00:22:24.272 --rc genhtml_function_coverage=1 00:22:24.272 --rc genhtml_legend=1 00:22:24.272 --rc geninfo_all_blocks=1 00:22:24.272 --rc geninfo_unexecuted_blocks=1 00:22:24.272 00:22:24.272 ' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:22:24.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:24.272 --rc genhtml_branch_coverage=1 00:22:24.272 --rc genhtml_function_coverage=1 00:22:24.272 --rc genhtml_legend=1 00:22:24.272 --rc geninfo_all_blocks=1 00:22:24.272 --rc geninfo_unexecuted_blocks=1 00:22:24.272 00:22:24.272 ' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:22:24.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:24.272 --rc genhtml_branch_coverage=1 00:22:24.272 --rc genhtml_function_coverage=1 00:22:24.272 --rc genhtml_legend=1 00:22:24.272 --rc geninfo_all_blocks=1 00:22:24.272 --rc geninfo_unexecuted_blocks=1 00:22:24.272 00:22:24.272 ' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:22:24.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:24.272 --rc genhtml_branch_coverage=1 00:22:24.272 --rc genhtml_function_coverage=1 00:22:24.272 --rc genhtml_legend=1 00:22:24.272 --rc geninfo_all_blocks=1 00:22:24.272 --rc geninfo_unexecuted_blocks=1 00:22:24.272 00:22:24.272 ' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@7 -- # uname -s 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@15 -- # shopt -s extglob 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- paths/export.sh@5 -- # export PATH 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@51 -- # : 0 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:22:24.272 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- nvmf/common.sh@55 -- # have_pci_nics=0 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@162 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1107 -- # xtrace_disable 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@10 -- # set +x 00:22:24.272 ************************************ 00:22:24.272 START TEST nvmf_shutdown_tc1 00:22:24.272 ************************************ 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@1125 -- # nvmf_shutdown_tc1 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@75 -- # starttarget 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@16 -- # nvmftestinit 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@474 -- # prepare_net_devs 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@436 -- # local -g is_hw=no 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@438 -- # remove_spdk_ns 00:22:24.272 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:24.273 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:24.273 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:24.273 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:22:24.273 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:22:24.273 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@309 -- # xtrace_disable 00:22:24.273 13:33:19 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@315 -- # pci_devs=() 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@315 -- # local -a pci_devs 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@316 -- # pci_net_devs=() 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@317 -- # pci_drivers=() 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@317 -- # local -A pci_drivers 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@319 -- # net_devs=() 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@319 -- # local -ga net_devs 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@320 -- # e810=() 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@320 -- # local -ga e810 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@321 -- # x722=() 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@321 -- # local -ga x722 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@322 -- # mlx=() 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@322 -- # local -ga mlx 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:26.805 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:22:26.805 Found 0000:84:00.0 (0x8086 - 0x159b) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:22:26.806 Found 0000:84:00.1 (0x8086 - 0x159b) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:22:26.806 Found net devices under 0000:84:00.0: cvl_0_0 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:22:26.806 Found net devices under 0000:84:00.1: cvl_0_1 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@440 -- # is_hw=yes 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:22:26.806 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:26.806 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:22:26.806 00:22:26.806 --- 10.0.0.2 ping statistics --- 00:22:26.806 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:26.806 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:26.806 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:26.806 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:22:26.806 00:22:26.806 --- 10.0.0.1 ping statistics --- 00:22:26.806 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:26.806 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@448 -- # return 0 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@19 -- # nvmfappstart -m 0x1E 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@507 -- # nvmfpid=687254 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@508 -- # waitforlisten 687254 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@831 -- # '[' -z 687254 ']' 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:26.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:26.806 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:26.806 [2024-10-07 13:33:22.342261] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:26.806 [2024-10-07 13:33:22.342338] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:26.806 [2024-10-07 13:33:22.408384] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:26.806 [2024-10-07 13:33:22.514541] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:26.806 [2024-10-07 13:33:22.514597] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:26.806 [2024-10-07 13:33:22.514627] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:26.806 [2024-10-07 13:33:22.514639] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:26.807 [2024-10-07 13:33:22.514649] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:26.807 [2024-10-07 13:33:22.516361] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:22:26.807 [2024-10-07 13:33:22.516424] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:22:26.807 [2024-10-07 13:33:22.516448] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:22:26.807 [2024-10-07 13:33:22.516452] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@864 -- # return 0 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:26.807 [2024-10-07 13:33:22.683814] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@23 -- # num_subsystems=({1..10}) 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@25 -- # timing_enter create_subsystems 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@27 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@29 -- # cat 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@36 -- # rpc_cmd 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:26.807 13:33:22 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:27.067 Malloc1 00:22:27.067 [2024-10-07 13:33:22.775335] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:27.067 Malloc2 00:22:27.067 Malloc3 00:22:27.067 Malloc4 00:22:27.067 Malloc5 00:22:27.067 Malloc6 00:22:27.326 Malloc7 00:22:27.326 Malloc8 00:22:27.326 Malloc9 00:22:27.326 Malloc10 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@37 -- # timing_exit create_subsystems 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@79 -- # perfpid=687316 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@80 -- # waitforlisten 687316 /var/tmp/bdevperf.sock 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@831 -- # '[' -z 687316 ']' 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@78 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@558 -- # config=() 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:27.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@558 -- # local subsystem config 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.326 { 00:22:27.326 "params": { 00:22:27.326 "name": "Nvme$subsystem", 00:22:27.326 "trtype": "$TEST_TRANSPORT", 00:22:27.326 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.326 "adrfam": "ipv4", 00:22:27.326 "trsvcid": "$NVMF_PORT", 00:22:27.326 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.326 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.326 "hdgst": ${hdgst:-false}, 00:22:27.326 "ddgst": ${ddgst:-false} 00:22:27.326 }, 00:22:27.326 "method": "bdev_nvme_attach_controller" 00:22:27.326 } 00:22:27.326 EOF 00:22:27.326 )") 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.326 { 00:22:27.326 "params": { 00:22:27.326 "name": "Nvme$subsystem", 00:22:27.326 "trtype": "$TEST_TRANSPORT", 00:22:27.326 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.326 "adrfam": "ipv4", 00:22:27.326 "trsvcid": "$NVMF_PORT", 00:22:27.326 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.326 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.326 "hdgst": ${hdgst:-false}, 00:22:27.326 "ddgst": ${ddgst:-false} 00:22:27.326 }, 00:22:27.326 "method": "bdev_nvme_attach_controller" 00:22:27.326 } 00:22:27.326 EOF 00:22:27.326 )") 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.326 { 00:22:27.326 "params": { 00:22:27.326 "name": "Nvme$subsystem", 00:22:27.326 "trtype": "$TEST_TRANSPORT", 00:22:27.326 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.326 "adrfam": "ipv4", 00:22:27.326 "trsvcid": "$NVMF_PORT", 00:22:27.326 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.326 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.326 "hdgst": ${hdgst:-false}, 00:22:27.326 "ddgst": ${ddgst:-false} 00:22:27.326 }, 00:22:27.326 "method": "bdev_nvme_attach_controller" 00:22:27.326 } 00:22:27.326 EOF 00:22:27.326 )") 00:22:27.326 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.585 { 00:22:27.585 "params": { 00:22:27.585 "name": "Nvme$subsystem", 00:22:27.585 "trtype": "$TEST_TRANSPORT", 00:22:27.585 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.585 "adrfam": "ipv4", 00:22:27.585 "trsvcid": "$NVMF_PORT", 00:22:27.585 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.585 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.585 "hdgst": ${hdgst:-false}, 00:22:27.585 "ddgst": ${ddgst:-false} 00:22:27.585 }, 00:22:27.585 "method": "bdev_nvme_attach_controller" 00:22:27.585 } 00:22:27.585 EOF 00:22:27.585 )") 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.585 { 00:22:27.585 "params": { 00:22:27.585 "name": "Nvme$subsystem", 00:22:27.585 "trtype": "$TEST_TRANSPORT", 00:22:27.585 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.585 "adrfam": "ipv4", 00:22:27.585 "trsvcid": "$NVMF_PORT", 00:22:27.585 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.585 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.585 "hdgst": ${hdgst:-false}, 00:22:27.585 "ddgst": ${ddgst:-false} 00:22:27.585 }, 00:22:27.585 "method": "bdev_nvme_attach_controller" 00:22:27.585 } 00:22:27.585 EOF 00:22:27.585 )") 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.585 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.585 { 00:22:27.585 "params": { 00:22:27.585 "name": "Nvme$subsystem", 00:22:27.585 "trtype": "$TEST_TRANSPORT", 00:22:27.585 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.585 "adrfam": "ipv4", 00:22:27.585 "trsvcid": "$NVMF_PORT", 00:22:27.585 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.585 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.585 "hdgst": ${hdgst:-false}, 00:22:27.585 "ddgst": ${ddgst:-false} 00:22:27.585 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 } 00:22:27.586 EOF 00:22:27.586 )") 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.586 { 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme$subsystem", 00:22:27.586 "trtype": "$TEST_TRANSPORT", 00:22:27.586 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "$NVMF_PORT", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.586 "hdgst": ${hdgst:-false}, 00:22:27.586 "ddgst": ${ddgst:-false} 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 } 00:22:27.586 EOF 00:22:27.586 )") 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.586 { 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme$subsystem", 00:22:27.586 "trtype": "$TEST_TRANSPORT", 00:22:27.586 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "$NVMF_PORT", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.586 "hdgst": ${hdgst:-false}, 00:22:27.586 "ddgst": ${ddgst:-false} 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 } 00:22:27.586 EOF 00:22:27.586 )") 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.586 { 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme$subsystem", 00:22:27.586 "trtype": "$TEST_TRANSPORT", 00:22:27.586 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "$NVMF_PORT", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.586 "hdgst": ${hdgst:-false}, 00:22:27.586 "ddgst": ${ddgst:-false} 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 } 00:22:27.586 EOF 00:22:27.586 )") 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:27.586 { 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme$subsystem", 00:22:27.586 "trtype": "$TEST_TRANSPORT", 00:22:27.586 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "$NVMF_PORT", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:27.586 "hdgst": ${hdgst:-false}, 00:22:27.586 "ddgst": ${ddgst:-false} 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 } 00:22:27.586 EOF 00:22:27.586 )") 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@582 -- # jq . 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@583 -- # IFS=, 00:22:27.586 13:33:23 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme1", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme2", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme3", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme4", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme5", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme6", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme7", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme8", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme9", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 },{ 00:22:27.586 "params": { 00:22:27.586 "name": "Nvme10", 00:22:27.586 "trtype": "tcp", 00:22:27.586 "traddr": "10.0.0.2", 00:22:27.586 "adrfam": "ipv4", 00:22:27.586 "trsvcid": "4420", 00:22:27.586 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:27.586 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:27.586 "hdgst": false, 00:22:27.586 "ddgst": false 00:22:27.586 }, 00:22:27.586 "method": "bdev_nvme_attach_controller" 00:22:27.586 }' 00:22:27.586 [2024-10-07 13:33:23.295640] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:27.586 [2024-10-07 13:33:23.295715] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:27.586 [2024-10-07 13:33:23.361729] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:27.586 [2024-10-07 13:33:23.473566] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@864 -- # return 0 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@81 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@84 -- # kill -9 687316 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@85 -- # rm -f /var/run/spdk_bdev1 00:22:29.492 13:33:25 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@88 -- # sleep 1 00:22:30.426 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 74: 687316 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@89 -- # kill -0 687254 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@92 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@558 -- # config=() 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@558 -- # local subsystem config 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.426 { 00:22:30.426 "params": { 00:22:30.426 "name": "Nvme$subsystem", 00:22:30.426 "trtype": "$TEST_TRANSPORT", 00:22:30.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.426 "adrfam": "ipv4", 00:22:30.426 "trsvcid": "$NVMF_PORT", 00:22:30.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.426 "hdgst": ${hdgst:-false}, 00:22:30.426 "ddgst": ${ddgst:-false} 00:22:30.426 }, 00:22:30.426 "method": "bdev_nvme_attach_controller" 00:22:30.426 } 00:22:30.426 EOF 00:22:30.426 )") 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.426 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.426 { 00:22:30.426 "params": { 00:22:30.426 "name": "Nvme$subsystem", 00:22:30.426 "trtype": "$TEST_TRANSPORT", 00:22:30.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.426 "adrfam": "ipv4", 00:22:30.426 "trsvcid": "$NVMF_PORT", 00:22:30.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.426 "hdgst": ${hdgst:-false}, 00:22:30.426 "ddgst": ${ddgst:-false} 00:22:30.426 }, 00:22:30.426 "method": "bdev_nvme_attach_controller" 00:22:30.426 } 00:22:30.426 EOF 00:22:30.426 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:30.427 { 00:22:30.427 "params": { 00:22:30.427 "name": "Nvme$subsystem", 00:22:30.427 "trtype": "$TEST_TRANSPORT", 00:22:30.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.427 "adrfam": "ipv4", 00:22:30.427 "trsvcid": "$NVMF_PORT", 00:22:30.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.427 "hdgst": ${hdgst:-false}, 00:22:30.427 "ddgst": ${ddgst:-false} 00:22:30.427 }, 00:22:30.427 "method": "bdev_nvme_attach_controller" 00:22:30.427 } 00:22:30.427 EOF 00:22:30.427 )") 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@580 -- # cat 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@582 -- # jq . 00:22:30.427 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@583 -- # IFS=, 00:22:30.687 13:33:26 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme1", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme2", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme3", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme4", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme5", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme6", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme7", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme8", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme9", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 },{ 00:22:30.687 "params": { 00:22:30.687 "name": "Nvme10", 00:22:30.687 "trtype": "tcp", 00:22:30.687 "traddr": "10.0.0.2", 00:22:30.687 "adrfam": "ipv4", 00:22:30.687 "trsvcid": "4420", 00:22:30.687 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:30.687 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:30.687 "hdgst": false, 00:22:30.687 "ddgst": false 00:22:30.687 }, 00:22:30.687 "method": "bdev_nvme_attach_controller" 00:22:30.687 }' 00:22:30.687 [2024-10-07 13:33:26.371112] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:30.687 [2024-10-07 13:33:26.371184] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid687738 ] 00:22:30.687 [2024-10-07 13:33:26.434561] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:30.687 [2024-10-07 13:33:26.551275] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:32.068 Running I/O for 1 seconds... 00:22:33.440 1664.00 IOPS, 104.00 MiB/s 00:22:33.440 Latency(us) 00:22:33.440 [2024-10-07T11:33:29.373Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:33.440 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme1n1 : 1.16 219.85 13.74 0.00 0.00 287418.03 19709.35 264085.81 00:22:33.440 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme2n1 : 1.18 217.59 13.60 0.00 0.00 286289.16 19709.35 268746.15 00:22:33.440 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme3n1 : 1.17 218.46 13.65 0.00 0.00 280507.54 17573.36 274959.93 00:22:33.440 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme4n1 : 1.16 220.92 13.81 0.00 0.00 272361.62 23204.60 274959.93 00:22:33.440 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme5n1 : 1.19 215.31 13.46 0.00 0.00 275037.11 22524.97 276513.37 00:22:33.440 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme6n1 : 1.20 214.03 13.38 0.00 0.00 271711.57 22622.06 290494.39 00:22:33.440 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme7n1 : 1.18 216.21 13.51 0.00 0.00 263825.07 21651.15 254765.13 00:22:33.440 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme8n1 : 1.20 213.56 13.35 0.00 0.00 262798.41 18932.62 288940.94 00:22:33.440 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme9n1 : 1.20 212.50 13.28 0.00 0.00 259774.96 21942.42 285834.05 00:22:33.440 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.440 Verification LBA range: start 0x0 length 0x400 00:22:33.440 Nvme10n1 : 1.21 211.89 13.24 0.00 0.00 256076.23 20291.89 298261.62 00:22:33.440 [2024-10-07T11:33:29.373Z] =================================================================================================================== 00:22:33.440 [2024-10-07T11:33:29.373Z] Total : 2160.31 135.02 0.00 0.00 271579.97 17573.36 298261.62 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@95 -- # stoptarget 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@42 -- # rm -f ./local-job0-0-verify.state 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@44 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- target/shutdown.sh@46 -- # nvmftestfini 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@121 -- # sync 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@124 -- # set +e 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:33.699 rmmod nvme_tcp 00:22:33.699 rmmod nvme_fabrics 00:22:33.699 rmmod nvme_keyring 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@128 -- # set -e 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@129 -- # return 0 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@515 -- # '[' -n 687254 ']' 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@516 -- # killprocess 687254 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@950 -- # '[' -z 687254 ']' 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@954 -- # kill -0 687254 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@955 -- # uname 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 687254 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@968 -- # echo 'killing process with pid 687254' 00:22:33.699 killing process with pid 687254 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@969 -- # kill 687254 00:22:33.699 13:33:29 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@974 -- # wait 687254 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@297 -- # iptr 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@789 -- # iptables-save 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@789 -- # iptables-restore 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@302 -- # remove_spdk_ns 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:34.267 13:33:30 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.174 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:22:36.174 00:22:36.174 real 0m12.169s 00:22:36.174 user 0m34.820s 00:22:36.174 sys 0m3.508s 00:22:36.174 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:22:36.174 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc1 -- common/autotest_common.sh@10 -- # set +x 00:22:36.174 ************************************ 00:22:36.174 END TEST nvmf_shutdown_tc1 00:22:36.174 ************************************ 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@163 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1107 -- # xtrace_disable 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@10 -- # set +x 00:22:36.433 ************************************ 00:22:36.433 START TEST nvmf_shutdown_tc2 00:22:36.433 ************************************ 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@1125 -- # nvmf_shutdown_tc2 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@100 -- # starttarget 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@16 -- # nvmftestinit 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@474 -- # prepare_net_devs 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@436 -- # local -g is_hw=no 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@438 -- # remove_spdk_ns 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@309 -- # xtrace_disable 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@315 -- # pci_devs=() 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@315 -- # local -a pci_devs 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@316 -- # pci_net_devs=() 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@317 -- # pci_drivers=() 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@317 -- # local -A pci_drivers 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@319 -- # net_devs=() 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@319 -- # local -ga net_devs 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@320 -- # e810=() 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@320 -- # local -ga e810 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@321 -- # x722=() 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@321 -- # local -ga x722 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@322 -- # mlx=() 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@322 -- # local -ga mlx 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:36.433 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:22:36.434 Found 0000:84:00.0 (0x8086 - 0x159b) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:22:36.434 Found 0000:84:00.1 (0x8086 - 0x159b) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:22:36.434 Found net devices under 0000:84:00.0: cvl_0_0 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:22:36.434 Found net devices under 0000:84:00.1: cvl_0_1 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@440 -- # is_hw=yes 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:22:36.434 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:36.434 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:22:36.434 00:22:36.434 --- 10.0.0.2 ping statistics --- 00:22:36.434 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.434 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:36.434 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:36.434 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:22:36.434 00:22:36.434 --- 10.0.0.1 ping statistics --- 00:22:36.434 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:36.434 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@448 -- # return 0 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@19 -- # nvmfappstart -m 0x1E 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@507 -- # nvmfpid=688518 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@508 -- # waitforlisten 688518 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@831 -- # '[' -z 688518 ']' 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:36.434 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:36.435 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:36.435 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:36.435 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:36.435 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:36.693 [2024-10-07 13:33:32.402955] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:36.693 [2024-10-07 13:33:32.403032] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:36.693 [2024-10-07 13:33:32.469858] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:36.693 [2024-10-07 13:33:32.572561] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:36.693 [2024-10-07 13:33:32.572628] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:36.693 [2024-10-07 13:33:32.572664] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:36.693 [2024-10-07 13:33:32.572676] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:36.693 [2024-10-07 13:33:32.572685] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:36.693 [2024-10-07 13:33:32.574262] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:22:36.693 [2024-10-07 13:33:32.574368] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:22:36.693 [2024-10-07 13:33:32.574454] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:22:36.693 [2024-10-07 13:33:32.574456] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@864 -- # return 0 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:36.951 [2024-10-07 13:33:32.717252] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@23 -- # num_subsystems=({1..10}) 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@25 -- # timing_enter create_subsystems 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@27 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@29 -- # cat 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@36 -- # rpc_cmd 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.951 13:33:32 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:36.951 Malloc1 00:22:36.951 [2024-10-07 13:33:32.791992] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:36.951 Malloc2 00:22:36.951 Malloc3 00:22:37.210 Malloc4 00:22:37.210 Malloc5 00:22:37.210 Malloc6 00:22:37.210 Malloc7 00:22:37.210 Malloc8 00:22:37.469 Malloc9 00:22:37.470 Malloc10 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@37 -- # timing_exit create_subsystems 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@104 -- # perfpid=688680 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@105 -- # waitforlisten 688680 /var/tmp/bdevperf.sock 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@831 -- # '[' -z 688680 ']' 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@103 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:37.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@558 -- # config=() 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@558 -- # local subsystem config 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.470 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.470 { 00:22:37.470 "params": { 00:22:37.470 "name": "Nvme$subsystem", 00:22:37.470 "trtype": "$TEST_TRANSPORT", 00:22:37.470 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.470 "adrfam": "ipv4", 00:22:37.470 "trsvcid": "$NVMF_PORT", 00:22:37.470 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.470 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.470 "hdgst": ${hdgst:-false}, 00:22:37.470 "ddgst": ${ddgst:-false} 00:22:37.470 }, 00:22:37.470 "method": "bdev_nvme_attach_controller" 00:22:37.470 } 00:22:37.470 EOF 00:22:37.470 )") 00:22:37.471 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.471 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:37.471 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:37.471 { 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme$subsystem", 00:22:37.471 "trtype": "$TEST_TRANSPORT", 00:22:37.471 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "$NVMF_PORT", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:37.471 "hdgst": ${hdgst:-false}, 00:22:37.471 "ddgst": ${ddgst:-false} 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 } 00:22:37.471 EOF 00:22:37.471 )") 00:22:37.471 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@580 -- # cat 00:22:37.471 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@582 -- # jq . 00:22:37.471 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@583 -- # IFS=, 00:22:37.471 13:33:33 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme1", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme2", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme3", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme4", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme5", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme6", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme7", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme8", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme9", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 },{ 00:22:37.471 "params": { 00:22:37.471 "name": "Nvme10", 00:22:37.471 "trtype": "tcp", 00:22:37.471 "traddr": "10.0.0.2", 00:22:37.471 "adrfam": "ipv4", 00:22:37.471 "trsvcid": "4420", 00:22:37.471 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:37.471 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:37.471 "hdgst": false, 00:22:37.471 "ddgst": false 00:22:37.471 }, 00:22:37.471 "method": "bdev_nvme_attach_controller" 00:22:37.471 }' 00:22:37.471 [2024-10-07 13:33:33.300325] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:37.471 [2024-10-07 13:33:33.300413] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid688680 ] 00:22:37.471 [2024-10-07 13:33:33.362460] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:37.730 [2024-10-07 13:33:33.474118] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:39.633 Running I/O for 10 seconds... 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@864 -- # return 0 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@108 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:39.633 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@51 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@55 -- # '[' -z Nvme1n1 ']' 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@58 -- # local ret=1 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@59 -- # local i 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@60 -- # (( i = 10 )) 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@60 -- # (( i != 0 )) 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # jq -r '.bdevs[0].num_read_ops' 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # read_io_count=3 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@64 -- # '[' 3 -ge 100 ']' 00:22:39.634 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@68 -- # sleep 0.25 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@60 -- # (( i-- )) 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@60 -- # (( i != 0 )) 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # jq -r '.bdevs[0].num_read_ops' 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # read_io_count=67 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@64 -- # '[' 67 -ge 100 ']' 00:22:39.892 13:33:35 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@68 -- # sleep 0.25 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@60 -- # (( i-- )) 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@60 -- # (( i != 0 )) 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # jq -r '.bdevs[0].num_read_ops' 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@61 -- # read_io_count=131 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@64 -- # '[' 131 -ge 100 ']' 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@65 -- # ret=0 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@66 -- # break 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@70 -- # return 0 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@111 -- # killprocess 688680 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@950 -- # '[' -z 688680 ']' 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@954 -- # kill -0 688680 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@955 -- # uname 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:40.150 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 688680 00:22:40.408 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:22:40.408 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:22:40.408 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@968 -- # echo 'killing process with pid 688680' 00:22:40.408 killing process with pid 688680 00:22:40.408 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@969 -- # kill 688680 00:22:40.408 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@974 -- # wait 688680 00:22:40.408 Received shutdown signal, test time was about 0.960948 seconds 00:22:40.408 00:22:40.408 Latency(us) 00:22:40.408 [2024-10-07T11:33:36.341Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:40.408 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme1n1 : 0.93 224.85 14.05 0.00 0.00 276489.10 11990.66 268746.15 00:22:40.408 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme2n1 : 0.93 217.03 13.56 0.00 0.00 282584.06 6505.05 260978.92 00:22:40.408 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme3n1 : 0.96 267.71 16.73 0.00 0.00 226423.85 22330.79 267192.70 00:22:40.408 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme4n1 : 0.96 266.64 16.66 0.00 0.00 222685.68 17864.63 264085.81 00:22:40.408 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme5n1 : 0.93 206.54 12.91 0.00 0.00 280533.27 21651.15 265639.25 00:22:40.408 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme6n1 : 0.94 204.22 12.76 0.00 0.00 277028.16 21262.79 267192.70 00:22:40.408 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme7n1 : 0.91 210.56 13.16 0.00 0.00 261575.62 34369.99 256318.58 00:22:40.408 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme8n1 : 0.94 205.16 12.82 0.00 0.00 263371.28 34175.81 251658.24 00:22:40.408 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme9n1 : 0.95 202.78 12.67 0.00 0.00 260894.72 19515.16 273406.48 00:22:40.408 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:40.408 Verification LBA range: start 0x0 length 0x400 00:22:40.408 Nvme10n1 : 0.95 201.57 12.60 0.00 0.00 256715.54 19806.44 296708.17 00:22:40.408 [2024-10-07T11:33:36.341Z] =================================================================================================================== 00:22:40.408 [2024-10-07T11:33:36.341Z] Total : 2207.07 137.94 0.00 0.00 258805.56 6505.05 296708.17 00:22:40.667 13:33:36 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@114 -- # sleep 1 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@115 -- # kill -0 688518 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@117 -- # stoptarget 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@42 -- # rm -f ./local-job0-0-verify.state 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@44 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- target/shutdown.sh@46 -- # nvmftestfini 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@121 -- # sync 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@124 -- # set +e 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:41.603 rmmod nvme_tcp 00:22:41.603 rmmod nvme_fabrics 00:22:41.603 rmmod nvme_keyring 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@128 -- # set -e 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@129 -- # return 0 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@515 -- # '[' -n 688518 ']' 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@516 -- # killprocess 688518 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@950 -- # '[' -z 688518 ']' 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@954 -- # kill -0 688518 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@955 -- # uname 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:41.603 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 688518 00:22:41.861 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:22:41.861 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:22:41.861 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@968 -- # echo 'killing process with pid 688518' 00:22:41.861 killing process with pid 688518 00:22:41.861 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@969 -- # kill 688518 00:22:41.861 13:33:37 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@974 -- # wait 688518 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@297 -- # iptr 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@789 -- # iptables-save 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@789 -- # iptables-restore 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@302 -- # remove_spdk_ns 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:42.119 13:33:38 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:22:44.656 00:22:44.656 real 0m7.925s 00:22:44.656 user 0m24.498s 00:22:44.656 sys 0m1.509s 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc2 -- common/autotest_common.sh@10 -- # set +x 00:22:44.656 ************************************ 00:22:44.656 END TEST nvmf_shutdown_tc2 00:22:44.656 ************************************ 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@164 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1107 -- # xtrace_disable 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@10 -- # set +x 00:22:44.656 ************************************ 00:22:44.656 START TEST nvmf_shutdown_tc3 00:22:44.656 ************************************ 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@1125 -- # nvmf_shutdown_tc3 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@122 -- # starttarget 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@16 -- # nvmftestinit 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@474 -- # prepare_net_devs 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@436 -- # local -g is_hw=no 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@438 -- # remove_spdk_ns 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@309 -- # xtrace_disable 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@315 -- # pci_devs=() 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@315 -- # local -a pci_devs 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@316 -- # pci_net_devs=() 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@317 -- # pci_drivers=() 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@317 -- # local -A pci_drivers 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@319 -- # net_devs=() 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@319 -- # local -ga net_devs 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@320 -- # e810=() 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@320 -- # local -ga e810 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@321 -- # x722=() 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@321 -- # local -ga x722 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@322 -- # mlx=() 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@322 -- # local -ga mlx 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:22:44.656 Found 0000:84:00.0 (0x8086 - 0x159b) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:22:44.656 Found 0000:84:00.1 (0x8086 - 0x159b) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:22:44.656 Found net devices under 0000:84:00.0: cvl_0_0 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:44.656 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:22:44.657 Found net devices under 0000:84:00.1: cvl_0_1 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@440 -- # is_hw=yes 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:22:44.657 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:44.657 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:22:44.657 00:22:44.657 --- 10.0.0.2 ping statistics --- 00:22:44.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.657 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:44.657 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:44.657 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:22:44.657 00:22:44.657 --- 10.0.0.1 ping statistics --- 00:22:44.657 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.657 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@448 -- # return 0 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@19 -- # nvmfappstart -m 0x1E 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@507 -- # nvmfpid=689663 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@508 -- # waitforlisten 689663 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@831 -- # '[' -z 689663 ']' 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:44.657 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:44.657 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:44.657 [2024-10-07 13:33:40.374446] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:44.657 [2024-10-07 13:33:40.374566] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:44.657 [2024-10-07 13:33:40.438991] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:44.657 [2024-10-07 13:33:40.542210] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:44.657 [2024-10-07 13:33:40.542281] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:44.657 [2024-10-07 13:33:40.542320] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:44.657 [2024-10-07 13:33:40.542340] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:44.657 [2024-10-07 13:33:40.542350] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:44.657 [2024-10-07 13:33:40.544045] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:22:44.657 [2024-10-07 13:33:40.544118] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:22:44.657 [2024-10-07 13:33:40.544226] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:22:44.657 [2024-10-07 13:33:40.544237] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@864 -- # return 0 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:44.916 [2024-10-07 13:33:40.706660] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@23 -- # num_subsystems=({1..10}) 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@25 -- # timing_enter create_subsystems 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@27 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@29 -- # cat 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@36 -- # rpc_cmd 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:44.916 13:33:40 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:44.916 Malloc1 00:22:44.916 [2024-10-07 13:33:40.792290] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:44.916 Malloc2 00:22:45.174 Malloc3 00:22:45.174 Malloc4 00:22:45.174 Malloc5 00:22:45.174 Malloc6 00:22:45.174 Malloc7 00:22:45.174 Malloc8 00:22:45.433 Malloc9 00:22:45.433 Malloc10 00:22:45.433 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@37 -- # timing_exit create_subsystems 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@126 -- # perfpid=689778 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@127 -- # waitforlisten 689778 /var/tmp/bdevperf.sock 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@831 -- # '[' -z 689778 ']' 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@125 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@558 -- # config=() 00:22:45.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@558 -- # local subsystem config 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.434 { 00:22:45.434 "params": { 00:22:45.434 "name": "Nvme$subsystem", 00:22:45.434 "trtype": "$TEST_TRANSPORT", 00:22:45.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.434 "adrfam": "ipv4", 00:22:45.434 "trsvcid": "$NVMF_PORT", 00:22:45.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.434 "hdgst": ${hdgst:-false}, 00:22:45.434 "ddgst": ${ddgst:-false} 00:22:45.434 }, 00:22:45.434 "method": "bdev_nvme_attach_controller" 00:22:45.434 } 00:22:45.434 EOF 00:22:45.434 )") 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:22:45.434 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:22:45.435 { 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme$subsystem", 00:22:45.435 "trtype": "$TEST_TRANSPORT", 00:22:45.435 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "$NVMF_PORT", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:45.435 "hdgst": ${hdgst:-false}, 00:22:45.435 "ddgst": ${ddgst:-false} 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 } 00:22:45.435 EOF 00:22:45.435 )") 00:22:45.435 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@580 -- # cat 00:22:45.435 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@582 -- # jq . 00:22:45.435 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@583 -- # IFS=, 00:22:45.435 13:33:41 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme1", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme2", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme3", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme4", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme5", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme6", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme7", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme8", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme9", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 },{ 00:22:45.435 "params": { 00:22:45.435 "name": "Nvme10", 00:22:45.435 "trtype": "tcp", 00:22:45.435 "traddr": "10.0.0.2", 00:22:45.435 "adrfam": "ipv4", 00:22:45.435 "trsvcid": "4420", 00:22:45.435 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:45.435 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:45.435 "hdgst": false, 00:22:45.435 "ddgst": false 00:22:45.435 }, 00:22:45.435 "method": "bdev_nvme_attach_controller" 00:22:45.435 }' 00:22:45.435 [2024-10-07 13:33:41.284831] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:45.435 [2024-10-07 13:33:41.284915] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid689778 ] 00:22:45.435 [2024-10-07 13:33:41.348050] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:45.700 [2024-10-07 13:33:41.460568] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:47.117 Running I/O for 10 seconds... 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@864 -- # return 0 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@128 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@131 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@133 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@51 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@55 -- # '[' -z Nvme1n1 ']' 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@58 -- # local ret=1 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@59 -- # local i 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@60 -- # (( i = 10 )) 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@60 -- # (( i != 0 )) 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@61 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@61 -- # jq -r '.bdevs[0].num_read_ops' 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@61 -- # read_io_count=82 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@64 -- # '[' 82 -ge 100 ']' 00:22:47.683 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@68 -- # sleep 0.25 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@60 -- # (( i-- )) 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@60 -- # (( i != 0 )) 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@61 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@61 -- # jq -r '.bdevs[0].num_read_ops' 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@61 -- # read_io_count=131 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@64 -- # '[' 131 -ge 100 ']' 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@65 -- # ret=0 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@66 -- # break 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@70 -- # return 0 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@136 -- # killprocess 689663 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@950 -- # '[' -z 689663 ']' 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@954 -- # kill -0 689663 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@955 -- # uname 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 689663 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@968 -- # echo 'killing process with pid 689663' 00:22:47.959 killing process with pid 689663 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@969 -- # kill 689663 00:22:47.959 13:33:43 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@974 -- # wait 689663 00:22:47.959 [2024-10-07 13:33:43.740444] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf569a0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.740576] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf569a0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.740602] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf569a0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741516] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741565] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741582] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741596] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741609] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741622] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741634] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741647] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.959 [2024-10-07 13:33:43.741659] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741672] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741684] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741696] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741709] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741721] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741734] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741747] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741759] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741772] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741792] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741804] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741817] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741830] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741843] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741869] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741882] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741894] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741907] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741920] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741932] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741944] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741956] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741968] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741980] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.741993] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742005] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742018] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742030] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742043] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742055] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742067] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742079] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742091] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742103] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742115] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742127] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742139] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742151] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742163] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742181] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742194] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742211] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742224] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742236] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742249] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742261] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742274] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742286] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742298] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742310] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742324] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742337] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742349] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.742362] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85ee0 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743891] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743916] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743930] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743943] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743955] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743968] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743980] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.743993] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744005] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744017] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744029] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744041] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744053] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744066] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744083] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744096] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744108] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744121] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744134] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744146] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744158] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744170] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744182] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744194] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744206] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744219] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744231] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744243] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744255] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744267] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744279] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744290] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744302] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744315] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.960 [2024-10-07 13:33:43.744327] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744339] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744351] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744363] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744374] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744386] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744398] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744410] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744426] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744438] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744450] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744462] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744474] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744493] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744508] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744520] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744532] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744544] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744556] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744568] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744580] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744592] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744604] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744616] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744630] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744642] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744654] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744666] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.744678] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf56e70 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746399] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746433] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746465] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746478] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746499] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746513] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746532] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746546] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746558] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746570] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746582] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746594] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746607] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746619] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746632] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746644] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746657] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746670] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746682] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746694] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746706] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746718] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746730] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746743] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746755] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746767] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746783] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746795] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746807] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746819] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746832] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746860] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746873] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746895] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746908] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746920] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746932] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746945] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746957] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746969] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746982] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.746994] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747006] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747018] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747031] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747043] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747055] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747066] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747079] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747091] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747103] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747115] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747127] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747139] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747151] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747173] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747186] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747198] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747211] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.961 [2024-10-07 13:33:43.747223] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.747239] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.747252] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.747264] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57340 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748579] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748612] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748627] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748639] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748652] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748665] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748677] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748689] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748701] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748714] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748726] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748737] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748749] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748761] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748773] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748794] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748806] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748818] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748829] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748841] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748854] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748866] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748878] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748890] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748902] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748920] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748933] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748945] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748957] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748969] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748981] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.748994] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749005] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749017] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749029] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749042] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749053] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749065] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749077] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749089] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749101] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749113] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749125] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749136] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749148] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749160] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749172] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749185] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749197] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749210] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749222] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749235] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749251] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749264] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749276] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749289] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749302] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749314] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749325] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749337] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749349] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749361] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.749373] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57830 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750149] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750175] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750190] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750203] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750218] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750231] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750243] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750256] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750270] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750284] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750297] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750311] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750324] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750339] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750353] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750365] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750387] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750403] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750418] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750431] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750443] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.962 [2024-10-07 13:33:43.750456] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750469] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750482] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750507] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750523] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750537] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750556] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750569] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750582] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750594] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750607] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750619] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750631] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750644] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750656] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750668] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750680] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750692] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750704] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750717] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750729] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750741] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750754] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750770] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750783] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750795] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750824] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750838] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750850] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750863] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750875] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750887] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750899] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750912] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750924] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750936] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750948] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750960] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750972] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750985] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.750997] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.751008] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf57bb0 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752116] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752141] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752157] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752171] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752183] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752195] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752209] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752223] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752240] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752253] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752265] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752280] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752293] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752305] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752318] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752333] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752346] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752359] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752371] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752386] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752399] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752411] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752424] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752436] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752449] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752463] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752478] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752501] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752514] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752527] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752539] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752552] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.963 [2024-10-07 13:33:43.752564] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752576] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752588] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752607] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752620] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752632] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752644] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752656] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752668] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752680] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752692] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752704] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752716] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752728] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752740] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752752] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752763] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752776] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752788] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752800] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752813] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752824] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752843] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752855] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752868] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752881] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752893] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752905] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752918] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752930] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.752941] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58080 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755094] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755229] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2124fb0 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755381] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755411] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbec50 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbfe50 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755665] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755693] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755708] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755722] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755735] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755741] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755747] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755761] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755769] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.964 [2024-10-07 13:33:43.755773] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.964 [2024-10-07 13:33:43.755787] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c331e0 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755800] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755820] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755832] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755844] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.964 [2024-10-07 13:33:43.755856] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755856] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.755868] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with t[2024-10-07 13:33:43.755876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(6) to be set 00:22:47.965 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.755899] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.755912] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.755925] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755929] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.755937] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.755951] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755957] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.755964] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-10-07 13:33:43.755983] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 he state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.755997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc09c0 is same [2024-10-07 13:33:43.755997] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with twith the state(6) to be set 00:22:47.965 he state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756013] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756025] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756047] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756058] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756058] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756070] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756083] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756093] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756096] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756113] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756121] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756126] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756139] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756152] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756165] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc1950 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756177] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756190] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756202] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756214] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756226] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-10-07 13:33:43.756239] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 he state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-10-07 13:33:43.756255] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 he state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-10-07 13:33:43.756269] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 he state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756284] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756285] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756296] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756309] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-10-07 13:33:43.756321] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 he state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756335] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with t[2024-10-07 13:33:43.756335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(6) to be set 00:22:47.965 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756358] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with t[2024-10-07 13:33:43.756358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccadb0 is same he state(6) to be set 00:22:47.965 with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756371] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756384] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756396] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756408] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756420] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756432] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756442] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756444] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58550 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.756456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756470] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.965 [2024-10-07 13:33:43.756520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.756532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20f59e0 is same with the state(6) to be set 00:22:47.965 [2024-10-07 13:33:43.757033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.965 [2024-10-07 13:33:43.757057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.757082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.965 [2024-10-07 13:33:43.757103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.757121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.965 [2024-10-07 13:33:43.757135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.757151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.965 [2024-10-07 13:33:43.757165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.965 [2024-10-07 13:33:43.757190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757466] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757508] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.757510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26368 len:1he state(6) to be set 00:22:47.966 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757526] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.757527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(6) to be set 00:22:47.966 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757548] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757560] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757574] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757588] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757600] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757612] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.757612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26752 len:1he state(6) to be set 00:22:47.966 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757626] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757641] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757654] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757667] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757679] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-07 13:33:43.757693] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 he state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757708] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757720] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757732] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757747] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757760] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757772] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.757772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:27392 len:1he state(6) to be set 00:22:47.966 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757790] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.757791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(6) to be set 00:22:47.966 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757806] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757819] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757831] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757845] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757858] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757872] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-07 13:33:43.757886] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 he state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757901] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757913] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-07 13:33:43.757925] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 he state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757939] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 [2024-10-07 13:33:43.757956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 [2024-10-07 13:33:43.757959] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28160 len:1[2024-10-07 13:33:43.757973] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.966 he state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.757988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-07 13:33:43.757988] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.966 he state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.758004] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.966 [2024-10-07 13:33:43.758006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758016] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758029] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758042] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758055] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28544 len:1[2024-10-07 13:33:43.758068] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 he state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758083] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.758083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(6) to be set 00:22:47.967 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758100] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758112] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758125] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758138] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758150] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758162] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758174] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758187] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758201] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.758201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29056 len:1he state(6) to be set 00:22:47.967 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758215] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758228] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758240] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758252] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758264] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758276] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with t[2024-10-07 13:33:43.758280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(6) to be set 00:22:47.967 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758294] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758307] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758320] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758332] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with the state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-07 13:33:43.758345] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf58a40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 he state(6) to be set 00:22:47.967 [2024-10-07 13:33:43.758360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.967 [2024-10-07 13:33:43.758932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.967 [2024-10-07 13:33:43.758946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.968 [2024-10-07 13:33:43.758961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.968 [2024-10-07 13:33:43.758975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.968 [2024-10-07 13:33:43.758994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.968 [2024-10-07 13:33:43.759009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.968 [2024-10-07 13:33:43.759025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.968 [2024-10-07 13:33:43.759039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.968 [2024-10-07 13:33:43.759054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.968 [2024-10-07 13:33:43.759068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.968 [2024-10-07 13:33:43.759083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.968 [2024-10-07 13:33:43.759096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.968 [2024-10-07 13:33:43.759119] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759144] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759158] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759170] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759182] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759195] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759193] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20d1250 was disconnected and freed. reset controller. 00:22:47.968 [2024-10-07 13:33:43.759208] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759220] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759232] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759244] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759256] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759269] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759281] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759293] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759305] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759317] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759329] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759340] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759358] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759370] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759393] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759404] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759416] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759428] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759440] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759452] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759464] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759477] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759497] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759511] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759523] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759535] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759547] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759564] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759577] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759589] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759601] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759614] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759626] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759638] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759650] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759662] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759683] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759696] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759708] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759724] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759736] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759748] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759760] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759773] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759785] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759797] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759809] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759821] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759833] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759845] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759857] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759869] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759881] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759893] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759904] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759916] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.759928] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf85a10 is same with the state(6) to be set 00:22:47.968 [2024-10-07 13:33:43.761145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:47.968 [2024-10-07 13:33:43.761186] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbfe50 (9): Bad file descriptor 00:22:47.968 [2024-10-07 13:33:43.763264] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.968 [2024-10-07 13:33:43.763461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.968 [2024-10-07 13:33:43.763499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbfe50 with addr=10.0.0.2, port=4420 00:22:47.968 [2024-10-07 13:33:43.763519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbfe50 is same with the state(6) to be set 00:22:47.969 [2024-10-07 13:33:43.763552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.763974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.763988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.969 [2024-10-07 13:33:43.764863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.969 [2024-10-07 13:33:43.764877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.764893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.764907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.764922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.764936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.764952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.764966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.764982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.764995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.765415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.765517] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1eceeb0 was disconnected and freed. reset controller. 00:22:47.970 [2024-10-07 13:33:43.765603] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.970 [2024-10-07 13:33:43.765681] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.970 [2024-10-07 13:33:43.765762] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.970 [2024-10-07 13:33:43.765835] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.970 [2024-10-07 13:33:43.765907] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.970 [2024-10-07 13:33:43.765979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.766000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.970 [2024-10-07 13:33:43.766039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20d2780 is same with the state(6) to be set 00:22:47.970 [2024-10-07 13:33:43.766141] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20d2780 was disconnected and freed. reset controller. 00:22:47.970 [2024-10-07 13:33:43.766276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbfe50 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.766346] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766383] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766411] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2137ef0 is same with the state(6) to be set 00:22:47.970 [2024-10-07 13:33:43.766519] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766583] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766610] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:47.970 [2024-10-07 13:33:43.766623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.970 [2024-10-07 13:33:43.766636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2125cc0 is same with the state(6) to be set 00:22:47.970 [2024-10-07 13:33:43.766678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2124fb0 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.766711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbec50 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.766745] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c331e0 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.766776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cc09c0 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.766807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cc1950 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.766837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ccadb0 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.766868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20f59e0 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.769017] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:47.970 [2024-10-07 13:33:43.769073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:47.970 [2024-10-07 13:33:43.769102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:47.970 [2024-10-07 13:33:43.769123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2137ef0 (9): Bad file descriptor 00:22:47.970 [2024-10-07 13:33:43.769153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:47.970 [2024-10-07 13:33:43.769170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:47.970 [2024-10-07 13:33:43.769187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:47.970 [2024-10-07 13:33:43.769285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.970 [2024-10-07 13:33:43.769470] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.970 [2024-10-07 13:33:43.769515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ccadb0 with addr=10.0.0.2, port=4420 00:22:47.970 [2024-10-07 13:33:43.769532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccadb0 is same with the state(6) to be set 00:22:47.970 [2024-10-07 13:33:43.770344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.970 [2024-10-07 13:33:43.770372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2137ef0 with addr=10.0.0.2, port=4420 00:22:47.970 [2024-10-07 13:33:43.770388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2137ef0 is same with the state(6) to be set 00:22:47.970 [2024-10-07 13:33:43.770406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ccadb0 (9): Bad file descriptor 00:22:47.971 [2024-10-07 13:33:43.770482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2137ef0 (9): Bad file descriptor 00:22:47.971 [2024-10-07 13:33:43.770516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:47.971 [2024-10-07 13:33:43.770530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:47.971 [2024-10-07 13:33:43.770543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:47.971 [2024-10-07 13:33:43.770639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.971 [2024-10-07 13:33:43.770660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:47.971 [2024-10-07 13:33:43.770674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:47.971 [2024-10-07 13:33:43.770687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:47.971 [2024-10-07 13:33:43.770743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.971 [2024-10-07 13:33:43.771942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:47.971 [2024-10-07 13:33:43.772234] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.971 [2024-10-07 13:33:43.772264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbfe50 with addr=10.0.0.2, port=4420 00:22:47.971 [2024-10-07 13:33:43.772281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbfe50 is same with the state(6) to be set 00:22:47.971 [2024-10-07 13:33:43.772338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbfe50 (9): Bad file descriptor 00:22:47.971 [2024-10-07 13:33:43.772402] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:47.971 [2024-10-07 13:33:43.772422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:47.971 [2024-10-07 13:33:43.772436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:47.971 [2024-10-07 13:33:43.772501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.971 [2024-10-07 13:33:43.776291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2125cc0 (9): Bad file descriptor 00:22:47.971 [2024-10-07 13:33:43.776530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.776977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.776994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.971 [2024-10-07 13:33:43.777564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.971 [2024-10-07 13:33:43.777580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.777970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.777987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.778544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.778559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ed0090 is same with the state(6) to be set 00:22:47.972 [2024-10-07 13:33:43.779852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.779875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.779895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.779912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.779929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.779943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.779960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.779974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.779990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.780004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.780020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.780034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.972 [2024-10-07 13:33:43.780050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.972 [2024-10-07 13:33:43.780065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.780979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.780996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.973 [2024-10-07 13:33:43.781362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.973 [2024-10-07 13:33:43.781377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.781845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.781859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20bff40 is same with the state(6) to be set 00:22:47.974 [2024-10-07 13:33:43.783129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.974 [2024-10-07 13:33:43.783857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.974 [2024-10-07 13:33:43.783871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.783886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.783900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.783916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.783929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.783945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.783958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.783974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.783987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.784972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.784989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.785004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.785020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.785034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.785051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.785066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.785082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.785096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.785111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20cd2c0 is same with the state(6) to be set 00:22:47.975 [2024-10-07 13:33:43.786361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.975 [2024-10-07 13:33:43.786384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.975 [2024-10-07 13:33:43.786409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.786979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.786998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.976 [2024-10-07 13:33:43.787645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.976 [2024-10-07 13:33:43.787661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.787980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.787994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.788455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.788470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20ce7f0 is same with the state(6) to be set 00:22:47.977 [2024-10-07 13:33:43.789724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.789972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.789989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.790019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.790050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.790080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.790112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.790142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.790173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.977 [2024-10-07 13:33:43.790203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.977 [2024-10-07 13:33:43.790217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.790977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.790992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.978 [2024-10-07 13:33:43.791543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.978 [2024-10-07 13:33:43.791560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.791575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.791592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.791606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.791630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.791645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.791661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.791676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.791693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.791708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.791725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.791740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.791757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.791772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.791787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20cfd20 is same with the state(6) to be set 00:22:47.979 [2024-10-07 13:33:43.793090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.793980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.793999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.979 [2024-10-07 13:33:43.794232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.979 [2024-10-07 13:33:43.794246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.794974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.794988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.795005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.795020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.795037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.795051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.795068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.795082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.795099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.795113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.795129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.795144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.795160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.980 [2024-10-07 13:33:43.795174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.980 [2024-10-07 13:33:43.795192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f556a0 is same with the state(6) to be set 00:22:47.980 [2024-10-07 13:33:43.796405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:47.980 [2024-10-07 13:33:43.796438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:47.980 [2024-10-07 13:33:43.796458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:47.980 [2024-10-07 13:33:43.796476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:47.980 [2024-10-07 13:33:43.796613] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.980 [2024-10-07 13:33:43.796643] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.980 [2024-10-07 13:33:43.812542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:47.980 [2024-10-07 13:33:43.812645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:47.980 [2024-10-07 13:33:43.812994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.980 [2024-10-07 13:33:43.813031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cc1950 with addr=10.0.0.2, port=4420 00:22:47.980 [2024-10-07 13:33:43.813053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc1950 is same with the state(6) to be set 00:22:47.980 [2024-10-07 13:33:43.813216] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.980 [2024-10-07 13:33:43.813243] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbec50 with addr=10.0.0.2, port=4420 00:22:47.980 [2024-10-07 13:33:43.813265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbec50 is same with the state(6) to be set 00:22:47.980 [2024-10-07 13:33:43.813458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.980 [2024-10-07 13:33:43.813495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cc09c0 with addr=10.0.0.2, port=4420 00:22:47.980 [2024-10-07 13:33:43.813513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc09c0 is same with the state(6) to be set 00:22:47.980 [2024-10-07 13:33:43.813667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.980 [2024-10-07 13:33:43.813694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20f59e0 with addr=10.0.0.2, port=4420 00:22:47.980 [2024-10-07 13:33:43.813710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20f59e0 is same with the state(6) to be set 00:22:47.980 [2024-10-07 13:33:43.813761] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.981 [2024-10-07 13:33:43.813783] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.981 [2024-10-07 13:33:43.813805] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.981 [2024-10-07 13:33:43.813826] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.981 [2024-10-07 13:33:43.813856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20f59e0 (9): Bad file descriptor 00:22:47.981 [2024-10-07 13:33:43.813896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cc09c0 (9): Bad file descriptor 00:22:47.981 [2024-10-07 13:33:43.813923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbec50 (9): Bad file descriptor 00:22:47.981 [2024-10-07 13:33:43.813946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cc1950 (9): Bad file descriptor 00:22:47.981 [2024-10-07 13:33:43.815423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.815970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.815985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.981 [2024-10-07 13:33:43.816665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.981 [2024-10-07 13:33:43.816679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.816974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.816989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:47.982 [2024-10-07 13:33:43.817512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:47.982 [2024-10-07 13:33:43.817527] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f54190 is same with the state(6) to be set 00:22:47.982 task offset: 24576 on job bdev=Nvme7n1 fails 00:22:47.982 1676.31 IOPS, 104.77 MiB/s [2024-10-07T11:33:43.915Z] [2024-10-07 13:33:43.819080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:47.982 [2024-10-07 13:33:43.819108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:47.982 [2024-10-07 13:33:43.819126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:47.982 00:22:47.982 Latency(us) 00:22:47.982 [2024-10-07T11:33:43.915Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:47.982 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme1n1 ended in about 0.99 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme1n1 : 0.99 198.34 12.40 60.72 0.00 244306.87 5267.15 268746.15 00:22:47.982 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme2n1 ended in about 1.00 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme2n1 : 1.00 197.02 12.31 64.01 0.00 237885.17 20000.62 251658.24 00:22:47.982 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme3n1 ended in about 1.00 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme3n1 : 1.00 191.39 11.96 63.80 0.00 238521.84 18544.26 267192.70 00:22:47.982 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme4n1 ended in about 1.01 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme4n1 : 1.01 194.75 12.17 63.59 0.00 230921.04 18835.53 267192.70 00:22:47.982 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme5n1 ended in about 1.01 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme5n1 : 1.01 126.76 7.92 63.38 0.00 307594.43 35146.71 253211.69 00:22:47.982 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme6n1 ended in about 1.01 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme6n1 : 1.01 126.35 7.90 63.17 0.00 302262.55 21262.79 271853.04 00:22:47.982 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme7n1 ended in about 0.98 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme7n1 : 0.98 195.69 12.23 65.23 0.00 213917.16 5339.97 274959.93 00:22:47.982 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme8n1 ended in about 0.99 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme8n1 : 0.99 192.08 12.01 2.02 0.00 279982.33 19612.25 271853.04 00:22:47.982 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme9n1 ended in about 1.04 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme9n1 : 1.04 123.22 7.70 61.61 0.00 291959.85 25243.50 273406.48 00:22:47.982 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:47.982 Job: Nvme10n1 ended in about 1.02 seconds with error 00:22:47.982 Verification LBA range: start 0x0 length 0x400 00:22:47.982 Nvme10n1 : 1.02 125.93 7.87 62.96 0.00 278516.88 20680.25 292047.83 00:22:47.982 [2024-10-07T11:33:43.915Z] =================================================================================================================== 00:22:47.982 [2024-10-07T11:33:43.915Z] Total : 1671.53 104.47 570.49 0.00 258281.51 5267.15 292047.83 00:22:47.982 [2024-10-07 13:33:43.856123] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:47.983 [2024-10-07 13:33:43.856229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:47.983 [2024-10-07 13:33:43.856632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.983 [2024-10-07 13:33:43.856669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c331e0 with addr=10.0.0.2, port=4420 00:22:47.983 [2024-10-07 13:33:43.856692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c331e0 is same with the state(6) to be set 00:22:47.983 [2024-10-07 13:33:43.856910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.983 [2024-10-07 13:33:43.856938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2124fb0 with addr=10.0.0.2, port=4420 00:22:47.983 [2024-10-07 13:33:43.856955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2124fb0 is same with the state(6) to be set 00:22:47.983 [2024-10-07 13:33:43.857364] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.983 [2024-10-07 13:33:43.857397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ccadb0 with addr=10.0.0.2, port=4420 00:22:47.983 [2024-10-07 13:33:43.857416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccadb0 is same with the state(6) to be set 00:22:47.983 [2024-10-07 13:33:43.857587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.983 [2024-10-07 13:33:43.857617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2137ef0 with addr=10.0.0.2, port=4420 00:22:47.983 [2024-10-07 13:33:43.857635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2137ef0 is same with the state(6) to be set 00:22:47.983 [2024-10-07 13:33:43.857719] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.983 [2024-10-07 13:33:43.857746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbfe50 with addr=10.0.0.2, port=4420 00:22:47.983 [2024-10-07 13:33:43.857762] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbfe50 is same with the state(6) to be set 00:22:47.983 [2024-10-07 13:33:43.857969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:47.983 [2024-10-07 13:33:43.857994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2125cc0 with addr=10.0.0.2, port=4420 00:22:47.983 [2024-10-07 13:33:43.858010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2125cc0 is same with the state(6) to be set 00:22:47.983 [2024-10-07 13:33:43.858037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c331e0 (9): Bad file descriptor 00:22:47.983 [2024-10-07 13:33:43.858061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2124fb0 (9): Bad file descriptor 00:22:47.983 [2024-10-07 13:33:43.858078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.858092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.858109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:47.983 [2024-10-07 13:33:43.858131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.858146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.858159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:47.983 [2024-10-07 13:33:43.858176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.858215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.858229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:47.983 [2024-10-07 13:33:43.858246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.858260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.858277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:47.983 [2024-10-07 13:33:43.858309] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.983 [2024-10-07 13:33:43.858337] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.983 [2024-10-07 13:33:43.858361] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.983 [2024-10-07 13:33:43.858386] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.983 [2024-10-07 13:33:43.858407] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.983 [2024-10-07 13:33:43.858425] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:47.983 [2024-10-07 13:33:43.858847] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.858873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.858886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.858898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.858915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ccadb0 (9): Bad file descriptor 00:22:47.983 [2024-10-07 13:33:43.858935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2137ef0 (9): Bad file descriptor 00:22:47.983 [2024-10-07 13:33:43.858953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbfe50 (9): Bad file descriptor 00:22:47.983 [2024-10-07 13:33:43.858972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2125cc0 (9): Bad file descriptor 00:22:47.983 [2024-10-07 13:33:43.858988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.859001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.859014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:47.983 [2024-10-07 13:33:43.859031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.859046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.859060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:47.983 [2024-10-07 13:33:43.859385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.859410] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.859423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.859437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.859451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:47.983 [2024-10-07 13:33:43.859473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.859498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.859515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:47.983 [2024-10-07 13:33:43.859532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.859546] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.859558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:47.983 [2024-10-07 13:33:43.859574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:47.983 [2024-10-07 13:33:43.859587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:47.983 [2024-10-07 13:33:43.859600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:47.983 [2024-10-07 13:33:43.859649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.859668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.859680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:47.983 [2024-10-07 13:33:43.859691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:48.551 13:33:44 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@137 -- # sleep 1 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@138 -- # NOT wait 689778 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@650 -- # local es=0 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 689778 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@638 -- # local arg=wait 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@642 -- # type -t wait 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@653 -- # wait 689778 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@653 -- # es=255 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@662 -- # es=127 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@663 -- # case "$es" in 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@670 -- # es=1 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@140 -- # stoptarget 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@42 -- # rm -f ./local-job0-0-verify.state 00:22:49.487 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@44 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- target/shutdown.sh@46 -- # nvmftestfini 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@121 -- # sync 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@124 -- # set +e 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:49.488 rmmod nvme_tcp 00:22:49.488 rmmod nvme_fabrics 00:22:49.488 rmmod nvme_keyring 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@128 -- # set -e 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@129 -- # return 0 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@515 -- # '[' -n 689663 ']' 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@516 -- # killprocess 689663 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@950 -- # '[' -z 689663 ']' 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@954 -- # kill -0 689663 00:22:49.488 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 954: kill: (689663) - No such process 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@977 -- # echo 'Process with pid 689663 is not found' 00:22:49.488 Process with pid 689663 is not found 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@297 -- # iptr 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@789 -- # iptables-save 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:49.488 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@789 -- # iptables-restore 00:22:49.748 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:49.748 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@302 -- # remove_spdk_ns 00:22:49.748 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:49.748 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:49.748 13:33:45 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:22:51.656 00:22:51.656 real 0m7.329s 00:22:51.656 user 0m17.499s 00:22:51.656 sys 0m1.514s 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc3 -- common/autotest_common.sh@10 -- # set +x 00:22:51.656 ************************************ 00:22:51.656 END TEST nvmf_shutdown_tc3 00:22:51.656 ************************************ 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@166 -- # [[ e810 == \e\8\1\0 ]] 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@166 -- # [[ tcp == \r\d\m\a ]] 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@167 -- # run_test nvmf_shutdown_tc4 nvmf_shutdown_tc4 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1107 -- # xtrace_disable 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@10 -- # set +x 00:22:51.656 ************************************ 00:22:51.656 START TEST nvmf_shutdown_tc4 00:22:51.656 ************************************ 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@1125 -- # nvmf_shutdown_tc4 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@145 -- # starttarget 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@16 -- # nvmftestinit 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@474 -- # prepare_net_devs 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@436 -- # local -g is_hw=no 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@438 -- # remove_spdk_ns 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@309 -- # xtrace_disable 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@315 -- # pci_devs=() 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@315 -- # local -a pci_devs 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@316 -- # pci_net_devs=() 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@317 -- # pci_drivers=() 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@317 -- # local -A pci_drivers 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@319 -- # net_devs=() 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@319 -- # local -ga net_devs 00:22:51.656 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@320 -- # e810=() 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@320 -- # local -ga e810 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@321 -- # x722=() 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@321 -- # local -ga x722 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@322 -- # mlx=() 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@322 -- # local -ga mlx 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:22:51.657 Found 0000:84:00.0 (0x8086 - 0x159b) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:22:51.657 Found 0000:84:00.1 (0x8086 - 0x159b) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:22:51.657 Found net devices under 0000:84:00.0: cvl_0_0 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@416 -- # [[ up == up ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:22:51.657 Found net devices under 0000:84:00.1: cvl_0_1 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@440 -- # is_hw=yes 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:22:51.657 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:22:51.917 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:51.917 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:22:51.917 00:22:51.917 --- 10.0.0.2 ping statistics --- 00:22:51.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:51.917 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:51.917 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:51.917 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:22:51.917 00:22:51.917 --- 10.0.0.1 ping statistics --- 00:22:51.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:51.917 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@448 -- # return 0 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@19 -- # nvmfappstart -m 0x1E 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@507 -- # nvmfpid=690684 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@508 -- # waitforlisten 690684 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@831 -- # '[' -z 690684 ']' 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:51.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:51.917 13:33:47 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:51.917 [2024-10-07 13:33:47.750502] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:51.917 [2024-10-07 13:33:47.750575] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:51.917 [2024-10-07 13:33:47.813707] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:52.176 [2024-10-07 13:33:47.922066] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:52.176 [2024-10-07 13:33:47.922127] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:52.176 [2024-10-07 13:33:47.922156] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:52.176 [2024-10-07 13:33:47.922168] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:52.176 [2024-10-07 13:33:47.922178] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:52.176 [2024-10-07 13:33:47.923954] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:22:52.176 [2024-10-07 13:33:47.924019] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:22:52.176 [2024-10-07 13:33:47.924084] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:22:52.176 [2024-10-07 13:33:47.924087] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@864 -- # return 0 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:52.176 [2024-10-07 13:33:48.064387] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@23 -- # num_subsystems=({1..10}) 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@25 -- # timing_enter create_subsystems 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@27 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.176 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@28 -- # for i in "${num_subsystems[@]}" 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@29 -- # cat 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@36 -- # rpc_cmd 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.177 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:52.436 Malloc1 00:22:52.436 [2024-10-07 13:33:48.139933] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:52.436 Malloc2 00:22:52.436 Malloc3 00:22:52.436 Malloc4 00:22:52.436 Malloc5 00:22:52.436 Malloc6 00:22:52.695 Malloc7 00:22:52.695 Malloc8 00:22:52.695 Malloc9 00:22:52.695 Malloc10 00:22:52.695 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.695 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@37 -- # timing_exit create_subsystems 00:22:52.695 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:52.695 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:22:52.695 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@149 -- # perfpid=690861 00:22:52.695 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@148 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 45056 -O 4096 -w randwrite -t 20 -r 'trtype:tcp adrfam:IPV4 traddr:10.0.0.2 trsvcid:4420' -P 4 00:22:52.695 13:33:48 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@150 -- # sleep 5 00:22:52.953 [2024-10-07 13:33:48.659379] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@152 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@155 -- # killprocess 690684 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@950 -- # '[' -z 690684 ']' 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@954 -- # kill -0 690684 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@955 -- # uname 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 690684 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@968 -- # echo 'killing process with pid 690684' 00:22:58.233 killing process with pid 690684 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@969 -- # kill 690684 00:22:58.233 13:33:53 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@974 -- # wait 690684 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.233 starting I/O failed: -6 00:22:58.233 Write completed with error (sct=0, sc=8) 00:22:58.234 [2024-10-07 13:33:53.658866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 [2024-10-07 13:33:53.660035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 [2024-10-07 13:33:53.661258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.234 starting I/O failed: -6 00:22:58.234 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 [2024-10-07 13:33:53.663095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.235 NVMe io qpair process completion error 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 [2024-10-07 13:33:53.664437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 [2024-10-07 13:33:53.665583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.235 starting I/O failed: -6 00:22:58.235 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 [2024-10-07 13:33:53.666865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 [2024-10-07 13:33:53.668986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.236 NVMe io qpair process completion error 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 [2024-10-07 13:33:53.670239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.236 starting I/O failed: -6 00:22:58.236 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 [2024-10-07 13:33:53.671297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 [2024-10-07 13:33:53.672647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.237 Write completed with error (sct=0, sc=8) 00:22:58.237 starting I/O failed: -6 00:22:58.238 [2024-10-07 13:33:53.674881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.238 NVMe io qpair process completion error 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 [2024-10-07 13:33:53.676325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 [2024-10-07 13:33:53.677377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.238 starting I/O failed: -6 00:22:58.238 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 [2024-10-07 13:33:53.678699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 [2024-10-07 13:33:53.680694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.239 NVMe io qpair process completion error 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 [2024-10-07 13:33:53.682012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.239 starting I/O failed: -6 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.239 Write completed with error (sct=0, sc=8) 00:22:58.239 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 [2024-10-07 13:33:53.683091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 [2024-10-07 13:33:53.684437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.240 [2024-10-07 13:33:53.688604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.240 NVMe io qpair process completion error 00:22:58.240 Write completed with error (sct=0, sc=8) 00:22:58.240 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 [2024-10-07 13:33:53.689940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 [2024-10-07 13:33:53.690960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 [2024-10-07 13:33:53.692265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.241 starting I/O failed: -6 00:22:58.241 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 [2024-10-07 13:33:53.696053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.242 NVMe io qpair process completion error 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 [2024-10-07 13:33:53.697602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 [2024-10-07 13:33:53.698630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.242 Write completed with error (sct=0, sc=8) 00:22:58.242 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 [2024-10-07 13:33:53.699938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 [2024-10-07 13:33:53.702268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.243 NVMe io qpair process completion error 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 starting I/O failed: -6 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.243 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 [2024-10-07 13:33:53.703730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.244 starting I/O failed: -6 00:22:58.244 starting I/O failed: -6 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 [2024-10-07 13:33:53.704960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 [2024-10-07 13:33:53.706295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.244 Write completed with error (sct=0, sc=8) 00:22:58.244 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 [2024-10-07 13:33:53.708409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.245 NVMe io qpair process completion error 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 [2024-10-07 13:33:53.709790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 [2024-10-07 13:33:53.710936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.245 Write completed with error (sct=0, sc=8) 00:22:58.245 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 [2024-10-07 13:33:53.712234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 [2024-10-07 13:33:53.716124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.246 NVMe io qpair process completion error 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 [2024-10-07 13:33:53.717455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:22:58.246 Write completed with error (sct=0, sc=8) 00:22:58.246 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 [2024-10-07 13:33:53.718627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 [2024-10-07 13:33:53.719951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.247 Write completed with error (sct=0, sc=8) 00:22:58.247 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 Write completed with error (sct=0, sc=8) 00:22:58.248 starting I/O failed: -6 00:22:58.248 [2024-10-07 13:33:53.724303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:22:58.248 NVMe io qpair process completion error 00:22:58.248 Initializing NVMe Controllers 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode7 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode2 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode5 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode9 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode3 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode8 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode6 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode10 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode4 00:22:58.248 Controller IO queue size 128, less than required. 00:22:58.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode7) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode2) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode5) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode9) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode3) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode8) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode6) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode10) NSID 1 with lcore 0 00:22:58.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode4) NSID 1 with lcore 0 00:22:58.248 Initialization complete. Launching workers. 00:22:58.248 ======================================================== 00:22:58.248 Latency(us) 00:22:58.248 Device Information : IOPS MiB/s Average min max 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode7) NSID 1 from core 0: 1741.80 74.84 73495.98 883.33 134253.14 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode2) NSID 1 from core 0: 1719.99 73.91 74444.90 811.39 131303.49 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode5) NSID 1 from core 0: 1729.94 74.33 74064.38 1013.52 130996.32 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode9) NSID 1 from core 0: 1719.35 73.88 74566.54 1003.74 142578.50 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode3) NSID 1 from core 0: 1651.36 70.96 77661.89 928.32 145813.12 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode8) NSID 1 from core 0: 1621.29 69.66 79123.29 1176.96 148888.64 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode6) NSID 1 from core 0: 1634.84 70.25 78514.77 1204.33 153510.04 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1654.75 71.10 76533.31 1017.23 131457.14 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode10) NSID 1 from core 0: 1668.10 71.68 75935.82 929.86 131406.79 00:22:58.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode4) NSID 1 from core 0: 1682.29 72.29 75314.87 902.73 131168.50 00:22:58.248 ======================================================== 00:22:58.248 Total : 16823.71 722.89 75922.31 811.39 153510.04 00:22:58.248 00:22:58.248 [2024-10-07 13:33:53.728936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a4040 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109fbb0 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109dde0 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a46a0 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109d780 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a4370 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a3d10 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109f7f0 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109f9d0 is same with the state(6) to be set 00:22:58.248 [2024-10-07 13:33:53.729510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x109dab0 is same with the state(6) to be set 00:22:58.248 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:22:58.508 13:33:54 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@156 -- # sleep 1 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@158 -- # NOT wait 690861 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@650 -- # local es=0 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 690861 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@638 -- # local arg=wait 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@642 -- # type -t wait 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@653 -- # wait 690861 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@653 -- # es=1 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@159 -- # stoptarget 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@42 -- # rm -f ./local-job0-0-verify.state 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@44 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- target/shutdown.sh@46 -- # nvmftestfini 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@121 -- # sync 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@124 -- # set +e 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:59.447 rmmod nvme_tcp 00:22:59.447 rmmod nvme_fabrics 00:22:59.447 rmmod nvme_keyring 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@128 -- # set -e 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@129 -- # return 0 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@515 -- # '[' -n 690684 ']' 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@516 -- # killprocess 690684 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@950 -- # '[' -z 690684 ']' 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@954 -- # kill -0 690684 00:22:59.447 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 954: kill: (690684) - No such process 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@977 -- # echo 'Process with pid 690684 is not found' 00:22:59.447 Process with pid 690684 is not found 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@297 -- # iptr 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@789 -- # iptables-save 00:22:59.447 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:59.448 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@789 -- # iptables-restore 00:22:59.448 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:59.448 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@302 -- # remove_spdk_ns 00:22:59.448 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:59.448 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:59.448 13:33:55 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.357 13:33:57 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:23:01.357 00:23:01.357 real 0m9.769s 00:23:01.357 user 0m24.057s 00:23:01.357 sys 0m6.155s 00:23:01.357 13:33:57 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:01.357 13:33:57 nvmf_tcp.nvmf_target_extra.nvmf_shutdown.nvmf_shutdown_tc4 -- common/autotest_common.sh@10 -- # set +x 00:23:01.357 ************************************ 00:23:01.357 END TEST nvmf_shutdown_tc4 00:23:01.357 ************************************ 00:23:01.624 13:33:57 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- target/shutdown.sh@170 -- # trap - SIGINT SIGTERM EXIT 00:23:01.625 00:23:01.625 real 0m37.578s 00:23:01.625 user 1m41.062s 00:23:01.625 sys 0m12.906s 00:23:01.625 13:33:57 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:01.625 13:33:57 nvmf_tcp.nvmf_target_extra.nvmf_shutdown -- common/autotest_common.sh@10 -- # set +x 00:23:01.625 ************************************ 00:23:01.625 END TEST nvmf_shutdown 00:23:01.625 ************************************ 00:23:01.625 13:33:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:23:01.625 00:23:01.625 real 11m37.586s 00:23:01.625 user 27m34.944s 00:23:01.625 sys 2m54.714s 00:23:01.625 13:33:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:01.625 13:33:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:23:01.625 ************************************ 00:23:01.625 END TEST nvmf_target_extra 00:23:01.625 ************************************ 00:23:01.625 13:33:57 nvmf_tcp -- nvmf/nvmf.sh@16 -- # run_test nvmf_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:23:01.625 13:33:57 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:01.625 13:33:57 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:01.625 13:33:57 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:23:01.625 ************************************ 00:23:01.625 START TEST nvmf_host 00:23:01.625 ************************************ 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:23:01.625 * Looking for test storage... 00:23:01.625 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lcov --version 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # IFS=.-: 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # read -ra ver1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # IFS=.-: 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # read -ra ver2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@338 -- # local 'op=<' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@340 -- # ver1_l=2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@341 -- # ver2_l=1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@344 -- # case "$op" in 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@345 -- # : 1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # decimal 1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # ver1[v]=1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # decimal 2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # ver2[v]=2 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # return 0 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.625 --rc genhtml_branch_coverage=1 00:23:01.625 --rc genhtml_function_coverage=1 00:23:01.625 --rc genhtml_legend=1 00:23:01.625 --rc geninfo_all_blocks=1 00:23:01.625 --rc geninfo_unexecuted_blocks=1 00:23:01.625 00:23:01.625 ' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.625 --rc genhtml_branch_coverage=1 00:23:01.625 --rc genhtml_function_coverage=1 00:23:01.625 --rc genhtml_legend=1 00:23:01.625 --rc geninfo_all_blocks=1 00:23:01.625 --rc geninfo_unexecuted_blocks=1 00:23:01.625 00:23:01.625 ' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.625 --rc genhtml_branch_coverage=1 00:23:01.625 --rc genhtml_function_coverage=1 00:23:01.625 --rc genhtml_legend=1 00:23:01.625 --rc geninfo_all_blocks=1 00:23:01.625 --rc geninfo_unexecuted_blocks=1 00:23:01.625 00:23:01.625 ' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:01.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.625 --rc genhtml_branch_coverage=1 00:23:01.625 --rc genhtml_function_coverage=1 00:23:01.625 --rc genhtml_legend=1 00:23:01.625 --rc geninfo_all_blocks=1 00:23:01.625 --rc geninfo_unexecuted_blocks=1 00:23:01.625 00:23:01.625 ' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # uname -s 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@15 -- # shopt -s extglob 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:01.625 13:33:57 nvmf_tcp.nvmf_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- paths/export.sh@5 -- # export PATH 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@51 -- # : 0 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:01.626 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:01.626 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@13 -- # TEST_ARGS=("$@") 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@15 -- # [[ 0 -eq 0 ]] 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@16 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:23:01.887 ************************************ 00:23:01.887 START TEST nvmf_multicontroller 00:23:01.887 ************************************ 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:01.887 * Looking for test storage... 00:23:01.887 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # lcov --version 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@336 -- # IFS=.-: 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@336 -- # read -ra ver1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@337 -- # IFS=.-: 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@337 -- # read -ra ver2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@338 -- # local 'op=<' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@340 -- # ver1_l=2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@341 -- # ver2_l=1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@344 -- # case "$op" in 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@345 -- # : 1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@365 -- # decimal 1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@353 -- # local d=1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@355 -- # echo 1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@365 -- # ver1[v]=1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@366 -- # decimal 2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@353 -- # local d=2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@355 -- # echo 2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@366 -- # ver2[v]=2 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@368 -- # return 0 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:01.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.887 --rc genhtml_branch_coverage=1 00:23:01.887 --rc genhtml_function_coverage=1 00:23:01.887 --rc genhtml_legend=1 00:23:01.887 --rc geninfo_all_blocks=1 00:23:01.887 --rc geninfo_unexecuted_blocks=1 00:23:01.887 00:23:01.887 ' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:01.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.887 --rc genhtml_branch_coverage=1 00:23:01.887 --rc genhtml_function_coverage=1 00:23:01.887 --rc genhtml_legend=1 00:23:01.887 --rc geninfo_all_blocks=1 00:23:01.887 --rc geninfo_unexecuted_blocks=1 00:23:01.887 00:23:01.887 ' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:01.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.887 --rc genhtml_branch_coverage=1 00:23:01.887 --rc genhtml_function_coverage=1 00:23:01.887 --rc genhtml_legend=1 00:23:01.887 --rc geninfo_all_blocks=1 00:23:01.887 --rc geninfo_unexecuted_blocks=1 00:23:01.887 00:23:01.887 ' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:01.887 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.887 --rc genhtml_branch_coverage=1 00:23:01.887 --rc genhtml_function_coverage=1 00:23:01.887 --rc genhtml_legend=1 00:23:01.887 --rc geninfo_all_blocks=1 00:23:01.887 --rc geninfo_unexecuted_blocks=1 00:23:01.887 00:23:01.887 ' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@7 -- # uname -s 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:01.887 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@15 -- # shopt -s extglob 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@5 -- # export PATH 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@51 -- # : 0 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:01.888 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@23 -- # nvmftestinit 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@474 -- # prepare_net_devs 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@436 -- # local -g is_hw=no 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@438 -- # remove_spdk_ns 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@309 -- # xtrace_disable 00:23:01.888 13:33:57 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@315 -- # pci_devs=() 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@315 -- # local -a pci_devs 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@316 -- # pci_net_devs=() 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@317 -- # pci_drivers=() 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@317 -- # local -A pci_drivers 00:23:04.418 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@319 -- # net_devs=() 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@319 -- # local -ga net_devs 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@320 -- # e810=() 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@320 -- # local -ga e810 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@321 -- # x722=() 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@321 -- # local -ga x722 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@322 -- # mlx=() 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@322 -- # local -ga mlx 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:23:04.419 Found 0000:84:00.0 (0x8086 - 0x159b) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:23:04.419 Found 0000:84:00.1 (0x8086 - 0x159b) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:23:04.419 Found net devices under 0000:84:00.0: cvl_0_0 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:23:04.419 Found net devices under 0000:84:00.1: cvl_0_1 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@440 -- # is_hw=yes 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:23:04.419 13:33:59 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:23:04.419 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:04.419 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:23:04.419 00:23:04.419 --- 10.0.0.2 ping statistics --- 00:23:04.419 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:04.419 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:04.419 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:04.419 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:23:04.419 00:23:04.419 --- 10.0.0.1 ping statistics --- 00:23:04.419 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:04.419 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@448 -- # return 0 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:23:04.419 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@724 -- # xtrace_disable 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@507 -- # nvmfpid=693673 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@508 -- # waitforlisten 693673 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@831 -- # '[' -z 693673 ']' 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@836 -- # local max_retries=100 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:04.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@840 -- # xtrace_disable 00:23:04.420 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.420 [2024-10-07 13:34:00.168490] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:04.420 [2024-10-07 13:34:00.168572] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:04.420 [2024-10-07 13:34:00.232160] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:04.420 [2024-10-07 13:34:00.339212] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:04.420 [2024-10-07 13:34:00.339268] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:04.420 [2024-10-07 13:34:00.339296] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:04.420 [2024-10-07 13:34:00.339307] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:04.420 [2024-10-07 13:34:00.339317] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:04.420 [2024-10-07 13:34:00.340327] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:23:04.420 [2024-10-07 13:34:00.340397] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:23:04.420 [2024-10-07 13:34:00.340394] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@864 -- # return 0 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@730 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 [2024-10-07 13:34:00.477668] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 Malloc0 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 [2024-10-07 13:34:00.539194] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 [2024-10-07 13:34:00.547067] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 Malloc1 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@44 -- # bdevperf_pid=693699 00:23:04.678 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@47 -- # waitforlisten 693699 /var/tmp/bdevperf.sock 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@831 -- # '[' -z 693699 ']' 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@836 -- # local max_retries=100 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:04.679 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@840 -- # xtrace_disable 00:23:04.679 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.246 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:23:05.246 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@864 -- # return 0 00:23:05.246 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 00:23:05.246 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.246 13:34:00 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.246 NVMe0n1 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.246 1 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.246 request: 00:23:05.246 { 00:23:05.246 "name": "NVMe0", 00:23:05.246 "trtype": "tcp", 00:23:05.246 "traddr": "10.0.0.2", 00:23:05.246 "adrfam": "ipv4", 00:23:05.246 "trsvcid": "4420", 00:23:05.246 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:05.246 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:05.246 "hostaddr": "10.0.0.1", 00:23:05.246 "prchk_reftag": false, 00:23:05.246 "prchk_guard": false, 00:23:05.246 "hdgst": false, 00:23:05.246 "ddgst": false, 00:23:05.246 "allow_unrecognized_csi": false, 00:23:05.246 "method": "bdev_nvme_attach_controller", 00:23:05.246 "req_id": 1 00:23:05.246 } 00:23:05.246 Got JSON-RPC error response 00:23:05.246 response: 00:23:05.246 { 00:23:05.246 "code": -114, 00:23:05.246 "message": "A controller named NVMe0 already exists with the specified network path" 00:23:05.246 } 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.246 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.503 request: 00:23:05.503 { 00:23:05.503 "name": "NVMe0", 00:23:05.503 "trtype": "tcp", 00:23:05.503 "traddr": "10.0.0.2", 00:23:05.503 "adrfam": "ipv4", 00:23:05.503 "trsvcid": "4420", 00:23:05.503 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:05.503 "hostaddr": "10.0.0.1", 00:23:05.503 "prchk_reftag": false, 00:23:05.503 "prchk_guard": false, 00:23:05.503 "hdgst": false, 00:23:05.503 "ddgst": false, 00:23:05.503 "allow_unrecognized_csi": false, 00:23:05.503 "method": "bdev_nvme_attach_controller", 00:23:05.503 "req_id": 1 00:23:05.503 } 00:23:05.503 Got JSON-RPC error response 00:23:05.503 response: 00:23:05.503 { 00:23:05.503 "code": -114, 00:23:05.503 "message": "A controller named NVMe0 already exists with the specified network path" 00:23:05.503 } 00:23:05.503 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.503 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:23:05.503 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.503 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.503 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.503 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:23:05.503 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.504 request: 00:23:05.504 { 00:23:05.504 "name": "NVMe0", 00:23:05.504 "trtype": "tcp", 00:23:05.504 "traddr": "10.0.0.2", 00:23:05.504 "adrfam": "ipv4", 00:23:05.504 "trsvcid": "4420", 00:23:05.504 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:05.504 "hostaddr": "10.0.0.1", 00:23:05.504 "prchk_reftag": false, 00:23:05.504 "prchk_guard": false, 00:23:05.504 "hdgst": false, 00:23:05.504 "ddgst": false, 00:23:05.504 "multipath": "disable", 00:23:05.504 "allow_unrecognized_csi": false, 00:23:05.504 "method": "bdev_nvme_attach_controller", 00:23:05.504 "req_id": 1 00:23:05.504 } 00:23:05.504 Got JSON-RPC error response 00:23:05.504 response: 00:23:05.504 { 00:23:05.504 "code": -114, 00:23:05.504 "message": "A controller named NVMe0 already exists and multipath is disabled" 00:23:05.504 } 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.504 request: 00:23:05.504 { 00:23:05.504 "name": "NVMe0", 00:23:05.504 "trtype": "tcp", 00:23:05.504 "traddr": "10.0.0.2", 00:23:05.504 "adrfam": "ipv4", 00:23:05.504 "trsvcid": "4420", 00:23:05.504 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:05.504 "hostaddr": "10.0.0.1", 00:23:05.504 "prchk_reftag": false, 00:23:05.504 "prchk_guard": false, 00:23:05.504 "hdgst": false, 00:23:05.504 "ddgst": false, 00:23:05.504 "multipath": "failover", 00:23:05.504 "allow_unrecognized_csi": false, 00:23:05.504 "method": "bdev_nvme_attach_controller", 00:23:05.504 "req_id": 1 00:23:05.504 } 00:23:05.504 Got JSON-RPC error response 00:23:05.504 response: 00:23:05.504 { 00:23:05.504 "code": -114, 00:23:05.504 "message": "A controller named NVMe0 already exists with the specified network path" 00:23:05.504 } 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.504 NVMe0n1 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.504 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:05.504 13:34:01 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:06.875 { 00:23:06.875 "results": [ 00:23:06.875 { 00:23:06.875 "job": "NVMe0n1", 00:23:06.875 "core_mask": "0x1", 00:23:06.875 "workload": "write", 00:23:06.875 "status": "finished", 00:23:06.875 "queue_depth": 128, 00:23:06.875 "io_size": 4096, 00:23:06.875 "runtime": 1.006002, 00:23:06.875 "iops": 18762.388146345635, 00:23:06.875 "mibps": 73.29057869666264, 00:23:06.875 "io_failed": 0, 00:23:06.875 "io_timeout": 0, 00:23:06.875 "avg_latency_us": 6811.814733421635, 00:23:06.875 "min_latency_us": 4004.9777777777776, 00:23:06.875 "max_latency_us": 12427.567407407407 00:23:06.875 } 00:23:06.875 ], 00:23:06.875 "core_count": 1 00:23:06.875 } 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@100 -- # [[ -n '' ]] 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@116 -- # killprocess 693699 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@950 -- # '[' -z 693699 ']' 00:23:06.875 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@954 -- # kill -0 693699 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # uname 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 693699 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@968 -- # echo 'killing process with pid 693699' 00:23:06.876 killing process with pid 693699 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@969 -- # kill 693699 00:23:06.876 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@974 -- # wait 693699 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@118 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@119 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@123 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1597 -- # read -r file 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1596 -- # sort -u 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1598 -- # cat 00:23:07.135 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:07.135 [2024-10-07 13:34:00.650979] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:07.135 [2024-10-07 13:34:00.651064] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid693699 ] 00:23:07.135 [2024-10-07 13:34:00.713435] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:07.135 [2024-10-07 13:34:00.831121] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:23:07.135 [2024-10-07 13:34:01.346868] bdev.c:4701:bdev_name_add: *ERROR*: Bdev name 4c402158-ebef-4080-99c1-16b49beedc7e already exists 00:23:07.135 [2024-10-07 13:34:01.346908] bdev.c:7846:bdev_register: *ERROR*: Unable to add uuid:4c402158-ebef-4080-99c1-16b49beedc7e alias for bdev NVMe1n1 00:23:07.135 [2024-10-07 13:34:01.346938] bdev_nvme.c:4483:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:07.135 Running I/O for 1 seconds... 00:23:07.135 18747.00 IOPS, 73.23 MiB/s 00:23:07.135 Latency(us) 00:23:07.135 [2024-10-07T11:34:03.068Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:07.135 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:07.135 NVMe0n1 : 1.01 18762.39 73.29 0.00 0.00 6811.81 4004.98 12427.57 00:23:07.135 [2024-10-07T11:34:03.068Z] =================================================================================================================== 00:23:07.135 [2024-10-07T11:34:03.068Z] Total : 18762.39 73.29 0.00 0.00 6811.81 4004.98 12427.57 00:23:07.135 Received shutdown signal, test time was about 1.000000 seconds 00:23:07.135 00:23:07.135 Latency(us) 00:23:07.135 [2024-10-07T11:34:03.068Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:07.135 [2024-10-07T11:34:03.068Z] =================================================================================================================== 00:23:07.135 [2024-10-07T11:34:03.068Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:07.135 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1597 -- # read -r file 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@124 -- # nvmftestfini 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@514 -- # nvmfcleanup 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@121 -- # sync 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@124 -- # set +e 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@125 -- # for i in {1..20} 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:23:07.135 rmmod nvme_tcp 00:23:07.135 rmmod nvme_fabrics 00:23:07.135 rmmod nvme_keyring 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@128 -- # set -e 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@129 -- # return 0 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@515 -- # '[' -n 693673 ']' 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@516 -- # killprocess 693673 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@950 -- # '[' -z 693673 ']' 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@954 -- # kill -0 693673 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # uname 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 693673 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@968 -- # echo 'killing process with pid 693673' 00:23:07.135 killing process with pid 693673 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@969 -- # kill 693673 00:23:07.135 13:34:02 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@974 -- # wait 693673 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@297 -- # iptr 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # iptables-save 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # iptables-restore 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@302 -- # remove_spdk_ns 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:07.395 13:34:03 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:09.933 13:34:05 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:23:09.933 00:23:09.933 real 0m7.746s 00:23:09.933 user 0m11.835s 00:23:09.933 sys 0m2.567s 00:23:09.933 13:34:05 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:09.933 13:34:05 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:23:09.933 ************************************ 00:23:09.933 END TEST nvmf_multicontroller 00:23:09.933 ************************************ 00:23:09.933 13:34:05 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@17 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:09.933 13:34:05 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:09.933 13:34:05 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:09.933 13:34:05 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:23:09.933 ************************************ 00:23:09.934 START TEST nvmf_aer 00:23:09.934 ************************************ 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:09.934 * Looking for test storage... 00:23:09.934 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # lcov --version 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@336 -- # IFS=.-: 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@336 -- # read -ra ver1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@337 -- # IFS=.-: 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@337 -- # read -ra ver2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@338 -- # local 'op=<' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@340 -- # ver1_l=2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@341 -- # ver2_l=1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@344 -- # case "$op" in 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@345 -- # : 1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@365 -- # decimal 1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@353 -- # local d=1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@355 -- # echo 1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@365 -- # ver1[v]=1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@366 -- # decimal 2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@353 -- # local d=2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@355 -- # echo 2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@366 -- # ver2[v]=2 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@368 -- # return 0 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:09.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.934 --rc genhtml_branch_coverage=1 00:23:09.934 --rc genhtml_function_coverage=1 00:23:09.934 --rc genhtml_legend=1 00:23:09.934 --rc geninfo_all_blocks=1 00:23:09.934 --rc geninfo_unexecuted_blocks=1 00:23:09.934 00:23:09.934 ' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:09.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.934 --rc genhtml_branch_coverage=1 00:23:09.934 --rc genhtml_function_coverage=1 00:23:09.934 --rc genhtml_legend=1 00:23:09.934 --rc geninfo_all_blocks=1 00:23:09.934 --rc geninfo_unexecuted_blocks=1 00:23:09.934 00:23:09.934 ' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:09.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.934 --rc genhtml_branch_coverage=1 00:23:09.934 --rc genhtml_function_coverage=1 00:23:09.934 --rc genhtml_legend=1 00:23:09.934 --rc geninfo_all_blocks=1 00:23:09.934 --rc geninfo_unexecuted_blocks=1 00:23:09.934 00:23:09.934 ' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:09.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.934 --rc genhtml_branch_coverage=1 00:23:09.934 --rc genhtml_function_coverage=1 00:23:09.934 --rc genhtml_legend=1 00:23:09.934 --rc geninfo_all_blocks=1 00:23:09.934 --rc geninfo_unexecuted_blocks=1 00:23:09.934 00:23:09.934 ' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@7 -- # uname -s 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@15 -- # shopt -s extglob 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@5 -- # export PATH 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@51 -- # : 0 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:09.934 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@11 -- # nvmftestinit 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@474 -- # prepare_net_devs 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@436 -- # local -g is_hw=no 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@438 -- # remove_spdk_ns 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:09.934 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:23:09.935 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:23:09.935 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@309 -- # xtrace_disable 00:23:09.935 13:34:05 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@315 -- # pci_devs=() 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@315 -- # local -a pci_devs 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@316 -- # pci_net_devs=() 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@317 -- # pci_drivers=() 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@317 -- # local -A pci_drivers 00:23:11.840 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@319 -- # net_devs=() 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@319 -- # local -ga net_devs 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@320 -- # e810=() 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@320 -- # local -ga e810 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@321 -- # x722=() 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@321 -- # local -ga x722 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@322 -- # mlx=() 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@322 -- # local -ga mlx 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:23:11.841 Found 0000:84:00.0 (0x8086 - 0x159b) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:23:11.841 Found 0000:84:00.1 (0x8086 - 0x159b) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:23:11.841 Found net devices under 0000:84:00.0: cvl_0_0 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:23:11.841 Found net devices under 0000:84:00.1: cvl_0_1 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@440 -- # is_hw=yes 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:23:11.841 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:11.841 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:23:11.841 00:23:11.841 --- 10.0.0.2 ping statistics --- 00:23:11.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.841 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:11.841 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:11.841 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:23:11.841 00:23:11.841 --- 10.0.0.1 ping statistics --- 00:23:11.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.841 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@448 -- # return 0 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:23:11.841 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@724 -- # xtrace_disable 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@507 -- # nvmfpid=696053 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@508 -- # waitforlisten 696053 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@831 -- # '[' -z 696053 ']' 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@836 -- # local max_retries=100 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:12.101 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@840 -- # xtrace_disable 00:23:12.101 13:34:07 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.101 [2024-10-07 13:34:07.841894] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:12.101 [2024-10-07 13:34:07.841963] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:12.101 [2024-10-07 13:34:07.906300] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:12.101 [2024-10-07 13:34:08.018963] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:12.101 [2024-10-07 13:34:08.019051] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:12.101 [2024-10-07 13:34:08.019079] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:12.101 [2024-10-07 13:34:08.019091] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:12.102 [2024-10-07 13:34:08.019100] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:12.102 [2024-10-07 13:34:08.021154] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:23:12.102 [2024-10-07 13:34:08.021240] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:23:12.102 [2024-10-07 13:34:08.021180] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:23:12.102 [2024-10-07 13:34:08.021243] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@864 -- # return 0 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@730 -- # xtrace_disable 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.360 [2024-10-07 13:34:08.191435] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.360 Malloc0 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.360 [2024-10-07 13:34:08.245296] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.360 [ 00:23:12.360 { 00:23:12.360 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:12.360 "subtype": "Discovery", 00:23:12.360 "listen_addresses": [], 00:23:12.360 "allow_any_host": true, 00:23:12.360 "hosts": [] 00:23:12.360 }, 00:23:12.360 { 00:23:12.360 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:12.360 "subtype": "NVMe", 00:23:12.360 "listen_addresses": [ 00:23:12.360 { 00:23:12.360 "trtype": "TCP", 00:23:12.360 "adrfam": "IPv4", 00:23:12.360 "traddr": "10.0.0.2", 00:23:12.360 "trsvcid": "4420" 00:23:12.360 } 00:23:12.360 ], 00:23:12.360 "allow_any_host": true, 00:23:12.360 "hosts": [], 00:23:12.360 "serial_number": "SPDK00000000000001", 00:23:12.360 "model_number": "SPDK bdev Controller", 00:23:12.360 "max_namespaces": 2, 00:23:12.360 "min_cntlid": 1, 00:23:12.360 "max_cntlid": 65519, 00:23:12.360 "namespaces": [ 00:23:12.360 { 00:23:12.360 "nsid": 1, 00:23:12.360 "bdev_name": "Malloc0", 00:23:12.360 "name": "Malloc0", 00:23:12.360 "nguid": "FF5F9C5F8BD740E09799F81E66C92F6F", 00:23:12.360 "uuid": "ff5f9c5f-8bd7-40e0-9799-f81e66c92f6f" 00:23:12.360 } 00:23:12.360 ] 00:23:12.360 } 00:23:12.360 ] 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@33 -- # aerpid=696083 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1265 -- # local i=0 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1267 -- # '[' 0 -lt 200 ']' 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1268 -- # i=1 00:23:12.360 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1269 -- # sleep 0.1 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1267 -- # '[' 1 -lt 200 ']' 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1268 -- # i=2 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1269 -- # sleep 0.1 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1272 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1276 -- # return 0 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.633 Malloc1 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.633 Asynchronous Event Request test 00:23:12.633 Attaching to 10.0.0.2 00:23:12.633 Attached to 10.0.0.2 00:23:12.633 Registering asynchronous event callbacks... 00:23:12.633 Starting namespace attribute notice tests for all controllers... 00:23:12.633 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:12.633 aer_cb - Changed Namespace 00:23:12.633 Cleaning up... 00:23:12.633 [ 00:23:12.633 { 00:23:12.633 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:12.633 "subtype": "Discovery", 00:23:12.633 "listen_addresses": [], 00:23:12.633 "allow_any_host": true, 00:23:12.633 "hosts": [] 00:23:12.633 }, 00:23:12.633 { 00:23:12.633 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:12.633 "subtype": "NVMe", 00:23:12.633 "listen_addresses": [ 00:23:12.633 { 00:23:12.633 "trtype": "TCP", 00:23:12.633 "adrfam": "IPv4", 00:23:12.633 "traddr": "10.0.0.2", 00:23:12.633 "trsvcid": "4420" 00:23:12.633 } 00:23:12.633 ], 00:23:12.633 "allow_any_host": true, 00:23:12.633 "hosts": [], 00:23:12.633 "serial_number": "SPDK00000000000001", 00:23:12.633 "model_number": "SPDK bdev Controller", 00:23:12.633 "max_namespaces": 2, 00:23:12.633 "min_cntlid": 1, 00:23:12.633 "max_cntlid": 65519, 00:23:12.633 "namespaces": [ 00:23:12.633 { 00:23:12.633 "nsid": 1, 00:23:12.633 "bdev_name": "Malloc0", 00:23:12.633 "name": "Malloc0", 00:23:12.633 "nguid": "FF5F9C5F8BD740E09799F81E66C92F6F", 00:23:12.633 "uuid": "ff5f9c5f-8bd7-40e0-9799-f81e66c92f6f" 00:23:12.633 }, 00:23:12.633 { 00:23:12.633 "nsid": 2, 00:23:12.633 "bdev_name": "Malloc1", 00:23:12.633 "name": "Malloc1", 00:23:12.633 "nguid": "3C2CDE5681D242EABA117A8FFFCCB13F", 00:23:12.633 "uuid": "3c2cde56-81d2-42ea-ba11-7a8fffccb13f" 00:23:12.633 } 00:23:12.633 ] 00:23:12.633 } 00:23:12.633 ] 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@43 -- # wait 696083 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.633 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@51 -- # nvmftestfini 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@514 -- # nvmfcleanup 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@121 -- # sync 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@124 -- # set +e 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@125 -- # for i in {1..20} 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:23:12.896 rmmod nvme_tcp 00:23:12.896 rmmod nvme_fabrics 00:23:12.896 rmmod nvme_keyring 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@128 -- # set -e 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@129 -- # return 0 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@515 -- # '[' -n 696053 ']' 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@516 -- # killprocess 696053 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@950 -- # '[' -z 696053 ']' 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@954 -- # kill -0 696053 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@955 -- # uname 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 696053 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@968 -- # echo 'killing process with pid 696053' 00:23:12.896 killing process with pid 696053 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@969 -- # kill 696053 00:23:12.896 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@974 -- # wait 696053 00:23:13.154 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:23:13.154 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:23:13.154 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:23:13.154 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@297 -- # iptr 00:23:13.154 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # iptables-save 00:23:13.154 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:23:13.154 13:34:08 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # iptables-restore 00:23:13.154 13:34:09 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:23:13.154 13:34:09 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@302 -- # remove_spdk_ns 00:23:13.154 13:34:09 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.154 13:34:09 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:13.154 13:34:09 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:15.702 13:34:11 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:23:15.702 00:23:15.702 real 0m5.668s 00:23:15.702 user 0m4.531s 00:23:15.703 sys 0m2.062s 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:23:15.703 ************************************ 00:23:15.703 END TEST nvmf_aer 00:23:15.703 ************************************ 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@18 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:23:15.703 ************************************ 00:23:15.703 START TEST nvmf_async_init 00:23:15.703 ************************************ 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:15.703 * Looking for test storage... 00:23:15.703 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # lcov --version 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@336 -- # IFS=.-: 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@336 -- # read -ra ver1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@337 -- # IFS=.-: 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@337 -- # read -ra ver2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@338 -- # local 'op=<' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@340 -- # ver1_l=2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@341 -- # ver2_l=1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@344 -- # case "$op" in 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@345 -- # : 1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@365 -- # decimal 1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@353 -- # local d=1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@355 -- # echo 1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@365 -- # ver1[v]=1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@366 -- # decimal 2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@353 -- # local d=2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@355 -- # echo 2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@366 -- # ver2[v]=2 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@368 -- # return 0 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:15.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.703 --rc genhtml_branch_coverage=1 00:23:15.703 --rc genhtml_function_coverage=1 00:23:15.703 --rc genhtml_legend=1 00:23:15.703 --rc geninfo_all_blocks=1 00:23:15.703 --rc geninfo_unexecuted_blocks=1 00:23:15.703 00:23:15.703 ' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:15.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.703 --rc genhtml_branch_coverage=1 00:23:15.703 --rc genhtml_function_coverage=1 00:23:15.703 --rc genhtml_legend=1 00:23:15.703 --rc geninfo_all_blocks=1 00:23:15.703 --rc geninfo_unexecuted_blocks=1 00:23:15.703 00:23:15.703 ' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:15.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.703 --rc genhtml_branch_coverage=1 00:23:15.703 --rc genhtml_function_coverage=1 00:23:15.703 --rc genhtml_legend=1 00:23:15.703 --rc geninfo_all_blocks=1 00:23:15.703 --rc geninfo_unexecuted_blocks=1 00:23:15.703 00:23:15.703 ' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:15.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.703 --rc genhtml_branch_coverage=1 00:23:15.703 --rc genhtml_function_coverage=1 00:23:15.703 --rc genhtml_legend=1 00:23:15.703 --rc geninfo_all_blocks=1 00:23:15.703 --rc geninfo_unexecuted_blocks=1 00:23:15.703 00:23:15.703 ' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@7 -- # uname -s 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@15 -- # shopt -s extglob 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@5 -- # export PATH 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@51 -- # : 0 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:15.703 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:15.703 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@14 -- # null_block_size=512 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@15 -- # null_bdev=null0 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # uuidgen 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # tr -d - 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # nguid=b86f12158232424fb25305d911f2c6a7 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@22 -- # nvmftestinit 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@474 -- # prepare_net_devs 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@436 -- # local -g is_hw=no 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@438 -- # remove_spdk_ns 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@309 -- # xtrace_disable 00:23:15.704 13:34:11 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@315 -- # pci_devs=() 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@315 -- # local -a pci_devs 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@316 -- # pci_net_devs=() 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@317 -- # pci_drivers=() 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@317 -- # local -A pci_drivers 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@319 -- # net_devs=() 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@319 -- # local -ga net_devs 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@320 -- # e810=() 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@320 -- # local -ga e810 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@321 -- # x722=() 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@321 -- # local -ga x722 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@322 -- # mlx=() 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@322 -- # local -ga mlx 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:23:17.625 Found 0000:84:00.0 (0x8086 - 0x159b) 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:17.625 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:23:17.626 Found 0000:84:00.1 (0x8086 - 0x159b) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:23:17.626 Found net devices under 0000:84:00.0: cvl_0_0 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:23:17.626 Found net devices under 0000:84:00.1: cvl_0_1 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@440 -- # is_hw=yes 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:17.626 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:23:17.885 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:17.885 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:23:17.885 00:23:17.885 --- 10.0.0.2 ping statistics --- 00:23:17.885 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:17.885 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:17.885 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:17.885 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:23:17.885 00:23:17.885 --- 10.0.0.1 ping statistics --- 00:23:17.885 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:17.885 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@448 -- # return 0 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@724 -- # xtrace_disable 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@507 -- # nvmfpid=698166 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@508 -- # waitforlisten 698166 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@831 -- # '[' -z 698166 ']' 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@836 -- # local max_retries=100 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:17.885 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@840 -- # xtrace_disable 00:23:17.885 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:17.885 [2024-10-07 13:34:13.645594] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:17.885 [2024-10-07 13:34:13.645675] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:17.885 [2024-10-07 13:34:13.705598] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:17.885 [2024-10-07 13:34:13.806478] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:17.885 [2024-10-07 13:34:13.806566] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:17.885 [2024-10-07 13:34:13.806596] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:17.885 [2024-10-07 13:34:13.806608] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:17.885 [2024-10-07 13:34:13.806618] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:17.885 [2024-10-07 13:34:13.807277] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@864 -- # return 0 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@730 -- # xtrace_disable 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.143 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.144 [2024-10-07 13:34:13.951317] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.144 null0 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g b86f12158232424fb25305d911f2c6a7 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.144 [2024-10-07 13:34:13.991647] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.144 13:34:13 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.402 nvme0n1 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.402 [ 00:23:18.402 { 00:23:18.402 "name": "nvme0n1", 00:23:18.402 "aliases": [ 00:23:18.402 "b86f1215-8232-424f-b253-05d911f2c6a7" 00:23:18.402 ], 00:23:18.402 "product_name": "NVMe disk", 00:23:18.402 "block_size": 512, 00:23:18.402 "num_blocks": 2097152, 00:23:18.402 "uuid": "b86f1215-8232-424f-b253-05d911f2c6a7", 00:23:18.402 "numa_id": 1, 00:23:18.402 "assigned_rate_limits": { 00:23:18.402 "rw_ios_per_sec": 0, 00:23:18.402 "rw_mbytes_per_sec": 0, 00:23:18.402 "r_mbytes_per_sec": 0, 00:23:18.402 "w_mbytes_per_sec": 0 00:23:18.402 }, 00:23:18.402 "claimed": false, 00:23:18.402 "zoned": false, 00:23:18.402 "supported_io_types": { 00:23:18.402 "read": true, 00:23:18.402 "write": true, 00:23:18.402 "unmap": false, 00:23:18.402 "flush": true, 00:23:18.402 "reset": true, 00:23:18.402 "nvme_admin": true, 00:23:18.402 "nvme_io": true, 00:23:18.402 "nvme_io_md": false, 00:23:18.402 "write_zeroes": true, 00:23:18.402 "zcopy": false, 00:23:18.402 "get_zone_info": false, 00:23:18.402 "zone_management": false, 00:23:18.402 "zone_append": false, 00:23:18.402 "compare": true, 00:23:18.402 "compare_and_write": true, 00:23:18.402 "abort": true, 00:23:18.402 "seek_hole": false, 00:23:18.402 "seek_data": false, 00:23:18.402 "copy": true, 00:23:18.402 "nvme_iov_md": false 00:23:18.402 }, 00:23:18.402 "memory_domains": [ 00:23:18.402 { 00:23:18.402 "dma_device_id": "system", 00:23:18.402 "dma_device_type": 1 00:23:18.402 } 00:23:18.402 ], 00:23:18.402 "driver_specific": { 00:23:18.402 "nvme": [ 00:23:18.402 { 00:23:18.402 "trid": { 00:23:18.402 "trtype": "TCP", 00:23:18.402 "adrfam": "IPv4", 00:23:18.402 "traddr": "10.0.0.2", 00:23:18.402 "trsvcid": "4420", 00:23:18.402 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:18.402 }, 00:23:18.402 "ctrlr_data": { 00:23:18.402 "cntlid": 1, 00:23:18.402 "vendor_id": "0x8086", 00:23:18.402 "model_number": "SPDK bdev Controller", 00:23:18.402 "serial_number": "00000000000000000000", 00:23:18.402 "firmware_revision": "25.01", 00:23:18.402 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:18.402 "oacs": { 00:23:18.402 "security": 0, 00:23:18.402 "format": 0, 00:23:18.402 "firmware": 0, 00:23:18.402 "ns_manage": 0 00:23:18.402 }, 00:23:18.402 "multi_ctrlr": true, 00:23:18.402 "ana_reporting": false 00:23:18.402 }, 00:23:18.402 "vs": { 00:23:18.402 "nvme_version": "1.3" 00:23:18.402 }, 00:23:18.402 "ns_data": { 00:23:18.402 "id": 1, 00:23:18.402 "can_share": true 00:23:18.402 } 00:23:18.402 } 00:23:18.402 ], 00:23:18.402 "mp_policy": "active_passive" 00:23:18.402 } 00:23:18.402 } 00:23:18.402 ] 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.402 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.402 [2024-10-07 13:34:14.240588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:18.402 [2024-10-07 13:34:14.240680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xab4560 (9): Bad file descriptor 00:23:18.661 [2024-10-07 13:34:14.372630] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.661 [ 00:23:18.661 { 00:23:18.661 "name": "nvme0n1", 00:23:18.661 "aliases": [ 00:23:18.661 "b86f1215-8232-424f-b253-05d911f2c6a7" 00:23:18.661 ], 00:23:18.661 "product_name": "NVMe disk", 00:23:18.661 "block_size": 512, 00:23:18.661 "num_blocks": 2097152, 00:23:18.661 "uuid": "b86f1215-8232-424f-b253-05d911f2c6a7", 00:23:18.661 "numa_id": 1, 00:23:18.661 "assigned_rate_limits": { 00:23:18.661 "rw_ios_per_sec": 0, 00:23:18.661 "rw_mbytes_per_sec": 0, 00:23:18.661 "r_mbytes_per_sec": 0, 00:23:18.661 "w_mbytes_per_sec": 0 00:23:18.661 }, 00:23:18.661 "claimed": false, 00:23:18.661 "zoned": false, 00:23:18.661 "supported_io_types": { 00:23:18.661 "read": true, 00:23:18.661 "write": true, 00:23:18.661 "unmap": false, 00:23:18.661 "flush": true, 00:23:18.661 "reset": true, 00:23:18.661 "nvme_admin": true, 00:23:18.661 "nvme_io": true, 00:23:18.661 "nvme_io_md": false, 00:23:18.661 "write_zeroes": true, 00:23:18.661 "zcopy": false, 00:23:18.661 "get_zone_info": false, 00:23:18.661 "zone_management": false, 00:23:18.661 "zone_append": false, 00:23:18.661 "compare": true, 00:23:18.661 "compare_and_write": true, 00:23:18.661 "abort": true, 00:23:18.661 "seek_hole": false, 00:23:18.661 "seek_data": false, 00:23:18.661 "copy": true, 00:23:18.661 "nvme_iov_md": false 00:23:18.661 }, 00:23:18.661 "memory_domains": [ 00:23:18.661 { 00:23:18.661 "dma_device_id": "system", 00:23:18.661 "dma_device_type": 1 00:23:18.661 } 00:23:18.661 ], 00:23:18.661 "driver_specific": { 00:23:18.661 "nvme": [ 00:23:18.661 { 00:23:18.661 "trid": { 00:23:18.661 "trtype": "TCP", 00:23:18.661 "adrfam": "IPv4", 00:23:18.661 "traddr": "10.0.0.2", 00:23:18.661 "trsvcid": "4420", 00:23:18.661 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:18.661 }, 00:23:18.661 "ctrlr_data": { 00:23:18.661 "cntlid": 2, 00:23:18.661 "vendor_id": "0x8086", 00:23:18.661 "model_number": "SPDK bdev Controller", 00:23:18.661 "serial_number": "00000000000000000000", 00:23:18.661 "firmware_revision": "25.01", 00:23:18.661 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:18.661 "oacs": { 00:23:18.661 "security": 0, 00:23:18.661 "format": 0, 00:23:18.661 "firmware": 0, 00:23:18.661 "ns_manage": 0 00:23:18.661 }, 00:23:18.661 "multi_ctrlr": true, 00:23:18.661 "ana_reporting": false 00:23:18.661 }, 00:23:18.661 "vs": { 00:23:18.661 "nvme_version": "1.3" 00:23:18.661 }, 00:23:18.661 "ns_data": { 00:23:18.661 "id": 1, 00:23:18.661 "can_share": true 00:23:18.661 } 00:23:18.661 } 00:23:18.661 ], 00:23:18.661 "mp_policy": "active_passive" 00:23:18.661 } 00:23:18.661 } 00:23:18.661 ] 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@53 -- # mktemp 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@53 -- # key_path=/tmp/tmp.5cQ2qD2pL6 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.5cQ2qD2pL6 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@56 -- # rpc_cmd keyring_file_add_key key0 /tmp/tmp.5cQ2qD2pL6 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.661 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@58 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.662 [2024-10-07 13:34:14.425214] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:18.662 [2024-10-07 13:34:14.425334] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@60 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk key0 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@66 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk key0 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.662 [2024-10-07 13:34:14.441266] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:18.662 nvme0n1 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@70 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.662 [ 00:23:18.662 { 00:23:18.662 "name": "nvme0n1", 00:23:18.662 "aliases": [ 00:23:18.662 "b86f1215-8232-424f-b253-05d911f2c6a7" 00:23:18.662 ], 00:23:18.662 "product_name": "NVMe disk", 00:23:18.662 "block_size": 512, 00:23:18.662 "num_blocks": 2097152, 00:23:18.662 "uuid": "b86f1215-8232-424f-b253-05d911f2c6a7", 00:23:18.662 "numa_id": 1, 00:23:18.662 "assigned_rate_limits": { 00:23:18.662 "rw_ios_per_sec": 0, 00:23:18.662 "rw_mbytes_per_sec": 0, 00:23:18.662 "r_mbytes_per_sec": 0, 00:23:18.662 "w_mbytes_per_sec": 0 00:23:18.662 }, 00:23:18.662 "claimed": false, 00:23:18.662 "zoned": false, 00:23:18.662 "supported_io_types": { 00:23:18.662 "read": true, 00:23:18.662 "write": true, 00:23:18.662 "unmap": false, 00:23:18.662 "flush": true, 00:23:18.662 "reset": true, 00:23:18.662 "nvme_admin": true, 00:23:18.662 "nvme_io": true, 00:23:18.662 "nvme_io_md": false, 00:23:18.662 "write_zeroes": true, 00:23:18.662 "zcopy": false, 00:23:18.662 "get_zone_info": false, 00:23:18.662 "zone_management": false, 00:23:18.662 "zone_append": false, 00:23:18.662 "compare": true, 00:23:18.662 "compare_and_write": true, 00:23:18.662 "abort": true, 00:23:18.662 "seek_hole": false, 00:23:18.662 "seek_data": false, 00:23:18.662 "copy": true, 00:23:18.662 "nvme_iov_md": false 00:23:18.662 }, 00:23:18.662 "memory_domains": [ 00:23:18.662 { 00:23:18.662 "dma_device_id": "system", 00:23:18.662 "dma_device_type": 1 00:23:18.662 } 00:23:18.662 ], 00:23:18.662 "driver_specific": { 00:23:18.662 "nvme": [ 00:23:18.662 { 00:23:18.662 "trid": { 00:23:18.662 "trtype": "TCP", 00:23:18.662 "adrfam": "IPv4", 00:23:18.662 "traddr": "10.0.0.2", 00:23:18.662 "trsvcid": "4421", 00:23:18.662 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:18.662 }, 00:23:18.662 "ctrlr_data": { 00:23:18.662 "cntlid": 3, 00:23:18.662 "vendor_id": "0x8086", 00:23:18.662 "model_number": "SPDK bdev Controller", 00:23:18.662 "serial_number": "00000000000000000000", 00:23:18.662 "firmware_revision": "25.01", 00:23:18.662 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:18.662 "oacs": { 00:23:18.662 "security": 0, 00:23:18.662 "format": 0, 00:23:18.662 "firmware": 0, 00:23:18.662 "ns_manage": 0 00:23:18.662 }, 00:23:18.662 "multi_ctrlr": true, 00:23:18.662 "ana_reporting": false 00:23:18.662 }, 00:23:18.662 "vs": { 00:23:18.662 "nvme_version": "1.3" 00:23:18.662 }, 00:23:18.662 "ns_data": { 00:23:18.662 "id": 1, 00:23:18.662 "can_share": true 00:23:18.662 } 00:23:18.662 } 00:23:18.662 ], 00:23:18.662 "mp_policy": "active_passive" 00:23:18.662 } 00:23:18.662 } 00:23:18.662 ] 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@73 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@76 -- # rm -f /tmp/tmp.5cQ2qD2pL6 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@78 -- # trap - SIGINT SIGTERM EXIT 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@79 -- # nvmftestfini 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@514 -- # nvmfcleanup 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@121 -- # sync 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@124 -- # set +e 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@125 -- # for i in {1..20} 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:23:18.662 rmmod nvme_tcp 00:23:18.662 rmmod nvme_fabrics 00:23:18.662 rmmod nvme_keyring 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@128 -- # set -e 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@129 -- # return 0 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@515 -- # '[' -n 698166 ']' 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@516 -- # killprocess 698166 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@950 -- # '[' -z 698166 ']' 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@954 -- # kill -0 698166 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@955 -- # uname 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:23:18.662 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 698166 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@968 -- # echo 'killing process with pid 698166' 00:23:18.921 killing process with pid 698166 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@969 -- # kill 698166 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@974 -- # wait 698166 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@297 -- # iptr 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # iptables-save 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:23:18.921 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # iptables-restore 00:23:18.922 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:23:18.922 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@302 -- # remove_spdk_ns 00:23:18.922 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:18.922 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:18.922 13:34:14 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:23:21.482 00:23:21.482 real 0m5.801s 00:23:21.482 user 0m2.306s 00:23:21.482 sys 0m1.970s 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:23:21.482 ************************************ 00:23:21.482 END TEST nvmf_async_init 00:23:21.482 ************************************ 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@19 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:23:21.482 ************************************ 00:23:21.482 START TEST dma 00:23:21.482 ************************************ 00:23:21.482 13:34:16 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:21.482 * Looking for test storage... 00:23:21.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # lcov --version 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@336 -- # IFS=.-: 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@336 -- # read -ra ver1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@337 -- # IFS=.-: 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@337 -- # read -ra ver2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@338 -- # local 'op=<' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@340 -- # ver1_l=2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@341 -- # ver2_l=1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@344 -- # case "$op" in 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@345 -- # : 1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@365 -- # decimal 1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@353 -- # local d=1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@355 -- # echo 1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@365 -- # ver1[v]=1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@366 -- # decimal 2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@353 -- # local d=2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@355 -- # echo 2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@366 -- # ver2[v]=2 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@368 -- # return 0 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:21.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.482 --rc genhtml_branch_coverage=1 00:23:21.482 --rc genhtml_function_coverage=1 00:23:21.482 --rc genhtml_legend=1 00:23:21.482 --rc geninfo_all_blocks=1 00:23:21.482 --rc geninfo_unexecuted_blocks=1 00:23:21.482 00:23:21.482 ' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:21.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.482 --rc genhtml_branch_coverage=1 00:23:21.482 --rc genhtml_function_coverage=1 00:23:21.482 --rc genhtml_legend=1 00:23:21.482 --rc geninfo_all_blocks=1 00:23:21.482 --rc geninfo_unexecuted_blocks=1 00:23:21.482 00:23:21.482 ' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:21.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.482 --rc genhtml_branch_coverage=1 00:23:21.482 --rc genhtml_function_coverage=1 00:23:21.482 --rc genhtml_legend=1 00:23:21.482 --rc geninfo_all_blocks=1 00:23:21.482 --rc geninfo_unexecuted_blocks=1 00:23:21.482 00:23:21.482 ' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:21.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.482 --rc genhtml_branch_coverage=1 00:23:21.482 --rc genhtml_function_coverage=1 00:23:21.482 --rc genhtml_legend=1 00:23:21.482 --rc geninfo_all_blocks=1 00:23:21.482 --rc geninfo_unexecuted_blocks=1 00:23:21.482 00:23:21.482 ' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@7 -- # uname -s 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@15 -- # shopt -s extglob 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:21.482 13:34:17 nvmf_tcp.nvmf_host.dma -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- paths/export.sh@5 -- # export PATH 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@51 -- # : 0 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:21.483 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- host/dma.sh@13 -- # exit 0 00:23:21.483 00:23:21.483 real 0m0.167s 00:23:21.483 user 0m0.116s 00:23:21.483 sys 0m0.061s 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@10 -- # set +x 00:23:21.483 ************************************ 00:23:21.483 END TEST dma 00:23:21.483 ************************************ 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@22 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:23:21.483 ************************************ 00:23:21.483 START TEST nvmf_identify 00:23:21.483 ************************************ 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:21.483 * Looking for test storage... 00:23:21.483 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lcov --version 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # IFS=.-: 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # read -ra ver1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # IFS=.-: 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # read -ra ver2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@338 -- # local 'op=<' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@340 -- # ver1_l=2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@341 -- # ver2_l=1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@344 -- # case "$op" in 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@345 -- # : 1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # decimal 1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # ver1[v]=1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # decimal 2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # ver2[v]=2 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # return 0 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:21.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.483 --rc genhtml_branch_coverage=1 00:23:21.483 --rc genhtml_function_coverage=1 00:23:21.483 --rc genhtml_legend=1 00:23:21.483 --rc geninfo_all_blocks=1 00:23:21.483 --rc geninfo_unexecuted_blocks=1 00:23:21.483 00:23:21.483 ' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:21.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.483 --rc genhtml_branch_coverage=1 00:23:21.483 --rc genhtml_function_coverage=1 00:23:21.483 --rc genhtml_legend=1 00:23:21.483 --rc geninfo_all_blocks=1 00:23:21.483 --rc geninfo_unexecuted_blocks=1 00:23:21.483 00:23:21.483 ' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:21.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.483 --rc genhtml_branch_coverage=1 00:23:21.483 --rc genhtml_function_coverage=1 00:23:21.483 --rc genhtml_legend=1 00:23:21.483 --rc geninfo_all_blocks=1 00:23:21.483 --rc geninfo_unexecuted_blocks=1 00:23:21.483 00:23:21.483 ' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:21.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.483 --rc genhtml_branch_coverage=1 00:23:21.483 --rc genhtml_function_coverage=1 00:23:21.483 --rc genhtml_legend=1 00:23:21.483 --rc geninfo_all_blocks=1 00:23:21.483 --rc geninfo_unexecuted_blocks=1 00:23:21.483 00:23:21.483 ' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # uname -s 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@15 -- # shopt -s extglob 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:21.483 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@5 -- # export PATH 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@51 -- # : 0 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:21.484 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@14 -- # nvmftestinit 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@474 -- # prepare_net_devs 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@436 -- # local -g is_hw=no 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@438 -- # remove_spdk_ns 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@309 -- # xtrace_disable 00:23:21.484 13:34:17 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.014 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@315 -- # pci_devs=() 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@315 -- # local -a pci_devs 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@316 -- # pci_net_devs=() 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@317 -- # pci_drivers=() 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@317 -- # local -A pci_drivers 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@319 -- # net_devs=() 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@319 -- # local -ga net_devs 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@320 -- # e810=() 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@320 -- # local -ga e810 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@321 -- # x722=() 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@321 -- # local -ga x722 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@322 -- # mlx=() 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@322 -- # local -ga mlx 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:23:24.015 Found 0000:84:00.0 (0x8086 - 0x159b) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:23:24.015 Found 0000:84:00.1 (0x8086 - 0x159b) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:23:24.015 Found net devices under 0000:84:00.0: cvl_0_0 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:23:24.015 Found net devices under 0000:84:00.1: cvl_0_1 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@440 -- # is_hw=yes 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:23:24.015 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:24.015 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:23:24.015 00:23:24.015 --- 10.0.0.2 ping statistics --- 00:23:24.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:24.015 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:24.015 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:24.015 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:23:24.015 00:23:24.015 --- 10.0.0.1 ping statistics --- 00:23:24.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:24.015 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@448 -- # return 0 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:23:24.015 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@724 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@19 -- # nvmfpid=700333 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@23 -- # waitforlisten 700333 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@831 -- # '[' -z 700333 ']' 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@836 -- # local max_retries=100 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:24.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@840 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 [2024-10-07 13:34:19.542208] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:24.016 [2024-10-07 13:34:19.542296] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:24.016 [2024-10-07 13:34:19.606513] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:24.016 [2024-10-07 13:34:19.713914] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:24.016 [2024-10-07 13:34:19.713972] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:24.016 [2024-10-07 13:34:19.714001] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:24.016 [2024-10-07 13:34:19.714013] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:24.016 [2024-10-07 13:34:19.714023] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:24.016 [2024-10-07 13:34:19.715787] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:23:24.016 [2024-10-07 13:34:19.715829] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:23:24.016 [2024-10-07 13:34:19.715886] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:23:24.016 [2024-10-07 13:34:19.715889] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@864 -- # return 0 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 [2024-10-07 13:34:19.843296] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@730 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 Malloc0 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 [2024-10-07 13:34:19.914093] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.016 [ 00:23:24.016 { 00:23:24.016 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:24.016 "subtype": "Discovery", 00:23:24.016 "listen_addresses": [ 00:23:24.016 { 00:23:24.016 "trtype": "TCP", 00:23:24.016 "adrfam": "IPv4", 00:23:24.016 "traddr": "10.0.0.2", 00:23:24.016 "trsvcid": "4420" 00:23:24.016 } 00:23:24.016 ], 00:23:24.016 "allow_any_host": true, 00:23:24.016 "hosts": [] 00:23:24.016 }, 00:23:24.016 { 00:23:24.016 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:24.016 "subtype": "NVMe", 00:23:24.016 "listen_addresses": [ 00:23:24.016 { 00:23:24.016 "trtype": "TCP", 00:23:24.016 "adrfam": "IPv4", 00:23:24.016 "traddr": "10.0.0.2", 00:23:24.016 "trsvcid": "4420" 00:23:24.016 } 00:23:24.016 ], 00:23:24.016 "allow_any_host": true, 00:23:24.016 "hosts": [], 00:23:24.016 "serial_number": "SPDK00000000000001", 00:23:24.016 "model_number": "SPDK bdev Controller", 00:23:24.016 "max_namespaces": 32, 00:23:24.016 "min_cntlid": 1, 00:23:24.016 "max_cntlid": 65519, 00:23:24.016 "namespaces": [ 00:23:24.016 { 00:23:24.016 "nsid": 1, 00:23:24.016 "bdev_name": "Malloc0", 00:23:24.016 "name": "Malloc0", 00:23:24.016 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:24.016 "eui64": "ABCDEF0123456789", 00:23:24.016 "uuid": "5e29a02b-49e6-43c0-acf6-4c40f4fd0ec9" 00:23:24.016 } 00:23:24.016 ] 00:23:24.016 } 00:23:24.016 ] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.016 13:34:19 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:24.276 [2024-10-07 13:34:19.952276] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:24.276 [2024-10-07 13:34:19.952314] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid700356 ] 00:23:24.276 [2024-10-07 13:34:19.982255] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:24.276 [2024-10-07 13:34:19.982313] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:24.276 [2024-10-07 13:34:19.982323] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:24.276 [2024-10-07 13:34:19.982339] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:24.276 [2024-10-07 13:34:19.982352] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:24.276 [2024-10-07 13:34:19.985965] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:24.276 [2024-10-07 13:34:19.986026] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1e5d760 0 00:23:24.276 [2024-10-07 13:34:19.993512] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:24.276 [2024-10-07 13:34:19.993535] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:24.276 [2024-10-07 13:34:19.993544] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:24.276 [2024-10-07 13:34:19.993550] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:24.276 [2024-10-07 13:34:19.993590] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.276 [2024-10-07 13:34:19.993603] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.276 [2024-10-07 13:34:19.993611] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.276 [2024-10-07 13:34:19.993631] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:24.276 [2024-10-07 13:34:19.993658] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.276 [2024-10-07 13:34:20.000500] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.276 [2024-10-07 13:34:20.000519] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.276 [2024-10-07 13:34:20.000527] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.276 [2024-10-07 13:34:20.000535] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.000555] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:24.277 [2024-10-07 13:34:20.000566] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:24.277 [2024-10-07 13:34:20.000576] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:24.277 [2024-10-07 13:34:20.000600] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.000609] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.000615] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.000626] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.277 [2024-10-07 13:34:20.000651] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.000802] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.277 [2024-10-07 13:34:20.000817] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.277 [2024-10-07 13:34:20.000823] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.000830] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.000839] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:24.277 [2024-10-07 13:34:20.000852] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:24.277 [2024-10-07 13:34:20.000864] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.000871] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.000877] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.000887] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.277 [2024-10-07 13:34:20.000908] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.000996] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.277 [2024-10-07 13:34:20.001009] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.277 [2024-10-07 13:34:20.001016] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001022] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.001032] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:24.277 [2024-10-07 13:34:20.001044] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:24.277 [2024-10-07 13:34:20.001056] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001063] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001069] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.001079] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.277 [2024-10-07 13:34:20.001100] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.001173] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.277 [2024-10-07 13:34:20.001202] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.277 [2024-10-07 13:34:20.001209] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001215] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.001225] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:24.277 [2024-10-07 13:34:20.001257] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001267] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001273] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.001284] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.277 [2024-10-07 13:34:20.001306] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.001401] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.277 [2024-10-07 13:34:20.001424] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.277 [2024-10-07 13:34:20.001442] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001453] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.001465] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:24.277 [2024-10-07 13:34:20.001481] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:24.277 [2024-10-07 13:34:20.001507] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:24.277 [2024-10-07 13:34:20.001619] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:24.277 [2024-10-07 13:34:20.001627] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:24.277 [2024-10-07 13:34:20.001644] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001653] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001659] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.001670] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.277 [2024-10-07 13:34:20.001693] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.001811] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.277 [2024-10-07 13:34:20.001831] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.277 [2024-10-07 13:34:20.001841] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001851] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.001863] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:24.277 [2024-10-07 13:34:20.001886] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001899] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.001908] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.001922] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.277 [2024-10-07 13:34:20.001951] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.002033] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.277 [2024-10-07 13:34:20.002054] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.277 [2024-10-07 13:34:20.002066] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002077] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.002090] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:24.277 [2024-10-07 13:34:20.002105] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:24.277 [2024-10-07 13:34:20.002126] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:24.277 [2024-10-07 13:34:20.002146] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:24.277 [2024-10-07 13:34:20.002170] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002187] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.002203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.277 [2024-10-07 13:34:20.002233] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.002395] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.277 [2024-10-07 13:34:20.002414] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.277 [2024-10-07 13:34:20.002425] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002435] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1e5d760): datao=0, datal=4096, cccid=0 00:23:24.277 [2024-10-07 13:34:20.002446] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ebd480) on tqpair(0x1e5d760): expected_datao=0, payload_size=4096 00:23:24.277 [2024-10-07 13:34:20.002457] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002483] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002508] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002530] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.277 [2024-10-07 13:34:20.002545] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.277 [2024-10-07 13:34:20.002555] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002564] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.277 [2024-10-07 13:34:20.002583] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:24.277 [2024-10-07 13:34:20.002596] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:24.277 [2024-10-07 13:34:20.002606] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:24.277 [2024-10-07 13:34:20.002618] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:24.277 [2024-10-07 13:34:20.002629] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:24.277 [2024-10-07 13:34:20.002641] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:24.277 [2024-10-07 13:34:20.002662] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:24.277 [2024-10-07 13:34:20.002682] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002693] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.277 [2024-10-07 13:34:20.002704] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.277 [2024-10-07 13:34:20.002719] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.277 [2024-10-07 13:34:20.002749] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.277 [2024-10-07 13:34:20.002856] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.278 [2024-10-07 13:34:20.002875] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.278 [2024-10-07 13:34:20.002885] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.002896] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.278 [2024-10-07 13:34:20.002914] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.002925] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.002934] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.002953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.278 [2024-10-07 13:34:20.002968] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.002978] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.002987] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.002999] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.278 [2024-10-07 13:34:20.003013] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003023] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003032] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.003043] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.278 [2024-10-07 13:34:20.003057] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003067] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003076] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.003088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.278 [2024-10-07 13:34:20.003104] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:24.278 [2024-10-07 13:34:20.003131] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:24.278 [2024-10-07 13:34:20.003149] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003160] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.003175] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.278 [2024-10-07 13:34:20.003208] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd480, cid 0, qid 0 00:23:24.278 [2024-10-07 13:34:20.003225] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd600, cid 1, qid 0 00:23:24.278 [2024-10-07 13:34:20.003238] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd780, cid 2, qid 0 00:23:24.278 [2024-10-07 13:34:20.003251] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd900, cid 3, qid 0 00:23:24.278 [2024-10-07 13:34:20.003264] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebda80, cid 4, qid 0 00:23:24.278 [2024-10-07 13:34:20.003368] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.278 [2024-10-07 13:34:20.003384] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.278 [2024-10-07 13:34:20.003391] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003398] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebda80) on tqpair=0x1e5d760 00:23:24.278 [2024-10-07 13:34:20.003408] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:24.278 [2024-10-07 13:34:20.003417] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:24.278 [2024-10-07 13:34:20.003436] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003445] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.003456] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.278 [2024-10-07 13:34:20.003484] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebda80, cid 4, qid 0 00:23:24.278 [2024-10-07 13:34:20.003593] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.278 [2024-10-07 13:34:20.003608] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.278 [2024-10-07 13:34:20.003615] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003622] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1e5d760): datao=0, datal=4096, cccid=4 00:23:24.278 [2024-10-07 13:34:20.003630] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ebda80) on tqpair(0x1e5d760): expected_datao=0, payload_size=4096 00:23:24.278 [2024-10-07 13:34:20.003637] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003654] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.003663] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.045507] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.278 [2024-10-07 13:34:20.045546] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.278 [2024-10-07 13:34:20.045555] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.045574] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebda80) on tqpair=0x1e5d760 00:23:24.278 [2024-10-07 13:34:20.045607] nvme_ctrlr.c:4189:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:24.278 [2024-10-07 13:34:20.045677] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.045690] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.045708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.278 [2024-10-07 13:34:20.045723] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.045731] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.045738] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.045747] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.278 [2024-10-07 13:34:20.045789] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebda80, cid 4, qid 0 00:23:24.278 [2024-10-07 13:34:20.045800] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebdc00, cid 5, qid 0 00:23:24.278 [2024-10-07 13:34:20.046058] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.278 [2024-10-07 13:34:20.046073] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.278 [2024-10-07 13:34:20.046095] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.046102] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1e5d760): datao=0, datal=1024, cccid=4 00:23:24.278 [2024-10-07 13:34:20.046110] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ebda80) on tqpair(0x1e5d760): expected_datao=0, payload_size=1024 00:23:24.278 [2024-10-07 13:34:20.046118] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.046129] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.046137] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.046153] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.278 [2024-10-07 13:34:20.046162] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.278 [2024-10-07 13:34:20.046168] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.046175] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebdc00) on tqpair=0x1e5d760 00:23:24.278 [2024-10-07 13:34:20.087631] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.278 [2024-10-07 13:34:20.087651] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.278 [2024-10-07 13:34:20.087670] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087678] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebda80) on tqpair=0x1e5d760 00:23:24.278 [2024-10-07 13:34:20.087704] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087715] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.087727] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.278 [2024-10-07 13:34:20.087758] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebda80, cid 4, qid 0 00:23:24.278 [2024-10-07 13:34:20.087880] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.278 [2024-10-07 13:34:20.087892] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.278 [2024-10-07 13:34:20.087899] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087905] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1e5d760): datao=0, datal=3072, cccid=4 00:23:24.278 [2024-10-07 13:34:20.087912] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ebda80) on tqpair(0x1e5d760): expected_datao=0, payload_size=3072 00:23:24.278 [2024-10-07 13:34:20.087919] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087929] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087936] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087947] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.278 [2024-10-07 13:34:20.087957] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.278 [2024-10-07 13:34:20.087963] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087969] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebda80) on tqpair=0x1e5d760 00:23:24.278 [2024-10-07 13:34:20.087984] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.087993] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1e5d760) 00:23:24.278 [2024-10-07 13:34:20.088003] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.278 [2024-10-07 13:34:20.088030] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebda80, cid 4, qid 0 00:23:24.278 [2024-10-07 13:34:20.088151] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.278 [2024-10-07 13:34:20.088164] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.278 [2024-10-07 13:34:20.088171] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.088193] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1e5d760): datao=0, datal=8, cccid=4 00:23:24.278 [2024-10-07 13:34:20.088201] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ebda80) on tqpair(0x1e5d760): expected_datao=0, payload_size=8 00:23:24.278 [2024-10-07 13:34:20.088208] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.088218] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.088225] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.128611] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.278 [2024-10-07 13:34:20.128631] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.278 [2024-10-07 13:34:20.128639] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.278 [2024-10-07 13:34:20.128646] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebda80) on tqpair=0x1e5d760 00:23:24.279 ===================================================== 00:23:24.279 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:24.279 ===================================================== 00:23:24.279 Controller Capabilities/Features 00:23:24.279 ================================ 00:23:24.279 Vendor ID: 0000 00:23:24.279 Subsystem Vendor ID: 0000 00:23:24.279 Serial Number: .................... 00:23:24.279 Model Number: ........................................ 00:23:24.279 Firmware Version: 25.01 00:23:24.279 Recommended Arb Burst: 0 00:23:24.279 IEEE OUI Identifier: 00 00 00 00:23:24.279 Multi-path I/O 00:23:24.279 May have multiple subsystem ports: No 00:23:24.279 May have multiple controllers: No 00:23:24.279 Associated with SR-IOV VF: No 00:23:24.279 Max Data Transfer Size: 131072 00:23:24.279 Max Number of Namespaces: 0 00:23:24.279 Max Number of I/O Queues: 1024 00:23:24.279 NVMe Specification Version (VS): 1.3 00:23:24.279 NVMe Specification Version (Identify): 1.3 00:23:24.279 Maximum Queue Entries: 128 00:23:24.279 Contiguous Queues Required: Yes 00:23:24.279 Arbitration Mechanisms Supported 00:23:24.279 Weighted Round Robin: Not Supported 00:23:24.279 Vendor Specific: Not Supported 00:23:24.279 Reset Timeout: 15000 ms 00:23:24.279 Doorbell Stride: 4 bytes 00:23:24.279 NVM Subsystem Reset: Not Supported 00:23:24.279 Command Sets Supported 00:23:24.279 NVM Command Set: Supported 00:23:24.279 Boot Partition: Not Supported 00:23:24.279 Memory Page Size Minimum: 4096 bytes 00:23:24.279 Memory Page Size Maximum: 4096 bytes 00:23:24.279 Persistent Memory Region: Not Supported 00:23:24.279 Optional Asynchronous Events Supported 00:23:24.279 Namespace Attribute Notices: Not Supported 00:23:24.279 Firmware Activation Notices: Not Supported 00:23:24.279 ANA Change Notices: Not Supported 00:23:24.279 PLE Aggregate Log Change Notices: Not Supported 00:23:24.279 LBA Status Info Alert Notices: Not Supported 00:23:24.279 EGE Aggregate Log Change Notices: Not Supported 00:23:24.279 Normal NVM Subsystem Shutdown event: Not Supported 00:23:24.279 Zone Descriptor Change Notices: Not Supported 00:23:24.279 Discovery Log Change Notices: Supported 00:23:24.279 Controller Attributes 00:23:24.279 128-bit Host Identifier: Not Supported 00:23:24.279 Non-Operational Permissive Mode: Not Supported 00:23:24.279 NVM Sets: Not Supported 00:23:24.279 Read Recovery Levels: Not Supported 00:23:24.279 Endurance Groups: Not Supported 00:23:24.279 Predictable Latency Mode: Not Supported 00:23:24.279 Traffic Based Keep ALive: Not Supported 00:23:24.279 Namespace Granularity: Not Supported 00:23:24.279 SQ Associations: Not Supported 00:23:24.279 UUID List: Not Supported 00:23:24.279 Multi-Domain Subsystem: Not Supported 00:23:24.279 Fixed Capacity Management: Not Supported 00:23:24.279 Variable Capacity Management: Not Supported 00:23:24.279 Delete Endurance Group: Not Supported 00:23:24.279 Delete NVM Set: Not Supported 00:23:24.279 Extended LBA Formats Supported: Not Supported 00:23:24.279 Flexible Data Placement Supported: Not Supported 00:23:24.279 00:23:24.279 Controller Memory Buffer Support 00:23:24.279 ================================ 00:23:24.279 Supported: No 00:23:24.279 00:23:24.279 Persistent Memory Region Support 00:23:24.279 ================================ 00:23:24.279 Supported: No 00:23:24.279 00:23:24.279 Admin Command Set Attributes 00:23:24.279 ============================ 00:23:24.279 Security Send/Receive: Not Supported 00:23:24.279 Format NVM: Not Supported 00:23:24.279 Firmware Activate/Download: Not Supported 00:23:24.279 Namespace Management: Not Supported 00:23:24.279 Device Self-Test: Not Supported 00:23:24.279 Directives: Not Supported 00:23:24.279 NVMe-MI: Not Supported 00:23:24.279 Virtualization Management: Not Supported 00:23:24.279 Doorbell Buffer Config: Not Supported 00:23:24.279 Get LBA Status Capability: Not Supported 00:23:24.279 Command & Feature Lockdown Capability: Not Supported 00:23:24.279 Abort Command Limit: 1 00:23:24.279 Async Event Request Limit: 4 00:23:24.279 Number of Firmware Slots: N/A 00:23:24.279 Firmware Slot 1 Read-Only: N/A 00:23:24.279 Firmware Activation Without Reset: N/A 00:23:24.279 Multiple Update Detection Support: N/A 00:23:24.279 Firmware Update Granularity: No Information Provided 00:23:24.279 Per-Namespace SMART Log: No 00:23:24.279 Asymmetric Namespace Access Log Page: Not Supported 00:23:24.279 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:24.279 Command Effects Log Page: Not Supported 00:23:24.279 Get Log Page Extended Data: Supported 00:23:24.279 Telemetry Log Pages: Not Supported 00:23:24.279 Persistent Event Log Pages: Not Supported 00:23:24.279 Supported Log Pages Log Page: May Support 00:23:24.279 Commands Supported & Effects Log Page: Not Supported 00:23:24.279 Feature Identifiers & Effects Log Page:May Support 00:23:24.279 NVMe-MI Commands & Effects Log Page: May Support 00:23:24.279 Data Area 4 for Telemetry Log: Not Supported 00:23:24.279 Error Log Page Entries Supported: 128 00:23:24.279 Keep Alive: Not Supported 00:23:24.279 00:23:24.279 NVM Command Set Attributes 00:23:24.279 ========================== 00:23:24.279 Submission Queue Entry Size 00:23:24.279 Max: 1 00:23:24.279 Min: 1 00:23:24.279 Completion Queue Entry Size 00:23:24.279 Max: 1 00:23:24.279 Min: 1 00:23:24.279 Number of Namespaces: 0 00:23:24.279 Compare Command: Not Supported 00:23:24.279 Write Uncorrectable Command: Not Supported 00:23:24.279 Dataset Management Command: Not Supported 00:23:24.279 Write Zeroes Command: Not Supported 00:23:24.279 Set Features Save Field: Not Supported 00:23:24.279 Reservations: Not Supported 00:23:24.279 Timestamp: Not Supported 00:23:24.279 Copy: Not Supported 00:23:24.279 Volatile Write Cache: Not Present 00:23:24.279 Atomic Write Unit (Normal): 1 00:23:24.279 Atomic Write Unit (PFail): 1 00:23:24.279 Atomic Compare & Write Unit: 1 00:23:24.279 Fused Compare & Write: Supported 00:23:24.279 Scatter-Gather List 00:23:24.279 SGL Command Set: Supported 00:23:24.279 SGL Keyed: Supported 00:23:24.279 SGL Bit Bucket Descriptor: Not Supported 00:23:24.279 SGL Metadata Pointer: Not Supported 00:23:24.279 Oversized SGL: Not Supported 00:23:24.279 SGL Metadata Address: Not Supported 00:23:24.279 SGL Offset: Supported 00:23:24.279 Transport SGL Data Block: Not Supported 00:23:24.279 Replay Protected Memory Block: Not Supported 00:23:24.279 00:23:24.279 Firmware Slot Information 00:23:24.279 ========================= 00:23:24.279 Active slot: 0 00:23:24.279 00:23:24.279 00:23:24.279 Error Log 00:23:24.279 ========= 00:23:24.279 00:23:24.279 Active Namespaces 00:23:24.279 ================= 00:23:24.279 Discovery Log Page 00:23:24.279 ================== 00:23:24.279 Generation Counter: 2 00:23:24.279 Number of Records: 2 00:23:24.279 Record Format: 0 00:23:24.279 00:23:24.279 Discovery Log Entry 0 00:23:24.279 ---------------------- 00:23:24.279 Transport Type: 3 (TCP) 00:23:24.279 Address Family: 1 (IPv4) 00:23:24.279 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:24.279 Entry Flags: 00:23:24.279 Duplicate Returned Information: 1 00:23:24.279 Explicit Persistent Connection Support for Discovery: 1 00:23:24.279 Transport Requirements: 00:23:24.279 Secure Channel: Not Required 00:23:24.279 Port ID: 0 (0x0000) 00:23:24.279 Controller ID: 65535 (0xffff) 00:23:24.279 Admin Max SQ Size: 128 00:23:24.279 Transport Service Identifier: 4420 00:23:24.279 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:24.279 Transport Address: 10.0.0.2 00:23:24.279 Discovery Log Entry 1 00:23:24.279 ---------------------- 00:23:24.279 Transport Type: 3 (TCP) 00:23:24.279 Address Family: 1 (IPv4) 00:23:24.279 Subsystem Type: 2 (NVM Subsystem) 00:23:24.279 Entry Flags: 00:23:24.279 Duplicate Returned Information: 0 00:23:24.279 Explicit Persistent Connection Support for Discovery: 0 00:23:24.279 Transport Requirements: 00:23:24.279 Secure Channel: Not Required 00:23:24.279 Port ID: 0 (0x0000) 00:23:24.279 Controller ID: 65535 (0xffff) 00:23:24.279 Admin Max SQ Size: 128 00:23:24.279 Transport Service Identifier: 4420 00:23:24.279 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:24.279 Transport Address: 10.0.0.2 [2024-10-07 13:34:20.128765] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:24.279 [2024-10-07 13:34:20.128799] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd480) on tqpair=0x1e5d760 00:23:24.279 [2024-10-07 13:34:20.128830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.279 [2024-10-07 13:34:20.128842] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd600) on tqpair=0x1e5d760 00:23:24.279 [2024-10-07 13:34:20.128850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.280 [2024-10-07 13:34:20.128858] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd780) on tqpair=0x1e5d760 00:23:24.280 [2024-10-07 13:34:20.128865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.280 [2024-10-07 13:34:20.128874] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd900) on tqpair=0x1e5d760 00:23:24.280 [2024-10-07 13:34:20.128907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.280 [2024-10-07 13:34:20.128924] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.128932] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.128939] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1e5d760) 00:23:24.280 [2024-10-07 13:34:20.128950] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.280 [2024-10-07 13:34:20.128975] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd900, cid 3, qid 0 00:23:24.280 [2024-10-07 13:34:20.129079] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.280 [2024-10-07 13:34:20.129091] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.280 [2024-10-07 13:34:20.129098] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.129104] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd900) on tqpair=0x1e5d760 00:23:24.280 [2024-10-07 13:34:20.129117] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.129125] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.129131] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1e5d760) 00:23:24.280 [2024-10-07 13:34:20.129141] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.280 [2024-10-07 13:34:20.129166] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd900, cid 3, qid 0 00:23:24.280 [2024-10-07 13:34:20.129273] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.280 [2024-10-07 13:34:20.129286] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.280 [2024-10-07 13:34:20.129293] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.129299] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd900) on tqpair=0x1e5d760 00:23:24.280 [2024-10-07 13:34:20.129308] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:24.280 [2024-10-07 13:34:20.129321] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:24.280 [2024-10-07 13:34:20.129337] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.129346] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.129353] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1e5d760) 00:23:24.280 [2024-10-07 13:34:20.129363] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.280 [2024-10-07 13:34:20.129383] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd900, cid 3, qid 0 00:23:24.280 [2024-10-07 13:34:20.129457] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.280 [2024-10-07 13:34:20.133496] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.280 [2024-10-07 13:34:20.133516] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.133525] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd900) on tqpair=0x1e5d760 00:23:24.280 [2024-10-07 13:34:20.133546] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.133556] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.133564] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1e5d760) 00:23:24.280 [2024-10-07 13:34:20.133575] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.280 [2024-10-07 13:34:20.133598] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ebd900, cid 3, qid 0 00:23:24.280 [2024-10-07 13:34:20.133712] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.280 [2024-10-07 13:34:20.133727] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.280 [2024-10-07 13:34:20.133735] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.280 [2024-10-07 13:34:20.133742] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1ebd900) on tqpair=0x1e5d760 00:23:24.280 [2024-10-07 13:34:20.133756] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:23:24.280 00:23:24.280 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:24.280 [2024-10-07 13:34:20.170947] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:24.280 [2024-10-07 13:34:20.171011] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid700387 ] 00:23:24.280 [2024-10-07 13:34:20.206292] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:24.280 [2024-10-07 13:34:20.206353] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:24.280 [2024-10-07 13:34:20.206363] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:24.280 [2024-10-07 13:34:20.206384] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:24.280 [2024-10-07 13:34:20.206398] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:24.541 [2024-10-07 13:34:20.209992] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:24.541 [2024-10-07 13:34:20.210044] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x16cd760 0 00:23:24.541 [2024-10-07 13:34:20.216505] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:24.541 [2024-10-07 13:34:20.216535] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:24.541 [2024-10-07 13:34:20.216544] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:24.541 [2024-10-07 13:34:20.216551] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:24.541 [2024-10-07 13:34:20.216583] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.216596] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.216603] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.541 [2024-10-07 13:34:20.216617] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:24.541 [2024-10-07 13:34:20.216645] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.541 [2024-10-07 13:34:20.224499] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.541 [2024-10-07 13:34:20.224518] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.541 [2024-10-07 13:34:20.224534] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.224540] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.541 [2024-10-07 13:34:20.224559] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:24.541 [2024-10-07 13:34:20.224572] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:24.541 [2024-10-07 13:34:20.224581] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:24.541 [2024-10-07 13:34:20.224599] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.224608] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.224615] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.541 [2024-10-07 13:34:20.224626] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.541 [2024-10-07 13:34:20.224650] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.541 [2024-10-07 13:34:20.224793] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.541 [2024-10-07 13:34:20.224808] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.541 [2024-10-07 13:34:20.224814] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.224821] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.541 [2024-10-07 13:34:20.224829] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:24.541 [2024-10-07 13:34:20.224842] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:24.541 [2024-10-07 13:34:20.224854] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.224861] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.224867] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.541 [2024-10-07 13:34:20.224877] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.541 [2024-10-07 13:34:20.224898] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.541 [2024-10-07 13:34:20.224992] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.541 [2024-10-07 13:34:20.225007] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.541 [2024-10-07 13:34:20.225013] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.225020] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.541 [2024-10-07 13:34:20.225029] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:24.541 [2024-10-07 13:34:20.225043] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:24.541 [2024-10-07 13:34:20.225055] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.225062] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.225068] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.541 [2024-10-07 13:34:20.225078] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.541 [2024-10-07 13:34:20.225099] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.541 [2024-10-07 13:34:20.225176] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.541 [2024-10-07 13:34:20.225190] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.541 [2024-10-07 13:34:20.225197] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.225204] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.541 [2024-10-07 13:34:20.225212] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:24.541 [2024-10-07 13:34:20.225251] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.225261] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.225267] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.541 [2024-10-07 13:34:20.225277] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.541 [2024-10-07 13:34:20.225297] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.541 [2024-10-07 13:34:20.225426] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.541 [2024-10-07 13:34:20.225440] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.541 [2024-10-07 13:34:20.225446] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.541 [2024-10-07 13:34:20.225452] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.541 [2024-10-07 13:34:20.225461] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:24.541 [2024-10-07 13:34:20.225484] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:24.541 [2024-10-07 13:34:20.225509] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:24.541 [2024-10-07 13:34:20.225620] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:24.541 [2024-10-07 13:34:20.225627] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:24.542 [2024-10-07 13:34:20.225641] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.225648] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.225655] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.225665] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.542 [2024-10-07 13:34:20.225688] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.542 [2024-10-07 13:34:20.225818] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.542 [2024-10-07 13:34:20.225832] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.542 [2024-10-07 13:34:20.225838] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.225845] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.542 [2024-10-07 13:34:20.225852] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:24.542 [2024-10-07 13:34:20.225868] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.225877] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.225883] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.225893] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.542 [2024-10-07 13:34:20.225913] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.542 [2024-10-07 13:34:20.226020] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.542 [2024-10-07 13:34:20.226035] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.542 [2024-10-07 13:34:20.226042] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226063] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.542 [2024-10-07 13:34:20.226071] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:24.542 [2024-10-07 13:34:20.226079] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.226093] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:24.542 [2024-10-07 13:34:20.226107] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.226122] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226129] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.226140] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.542 [2024-10-07 13:34:20.226162] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.542 [2024-10-07 13:34:20.226300] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.542 [2024-10-07 13:34:20.226316] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.542 [2024-10-07 13:34:20.226323] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226329] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=4096, cccid=0 00:23:24.542 [2024-10-07 13:34:20.226337] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172d480) on tqpair(0x16cd760): expected_datao=0, payload_size=4096 00:23:24.542 [2024-10-07 13:34:20.226360] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226371] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226378] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226404] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.542 [2024-10-07 13:34:20.226430] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.542 [2024-10-07 13:34:20.226437] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226443] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.542 [2024-10-07 13:34:20.226454] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:24.542 [2024-10-07 13:34:20.226464] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:24.542 [2024-10-07 13:34:20.226471] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:24.542 [2024-10-07 13:34:20.226478] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:24.542 [2024-10-07 13:34:20.226506] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:24.542 [2024-10-07 13:34:20.226516] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.226535] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.226548] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226555] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226565] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.226577] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.542 [2024-10-07 13:34:20.226598] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.542 [2024-10-07 13:34:20.226713] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.542 [2024-10-07 13:34:20.226727] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.542 [2024-10-07 13:34:20.226734] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226740] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.542 [2024-10-07 13:34:20.226751] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226759] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226765] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.226775] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.542 [2024-10-07 13:34:20.226785] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226792] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226798] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.226822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.542 [2024-10-07 13:34:20.226832] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226838] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226844] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.226852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.542 [2024-10-07 13:34:20.226861] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226868] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226873] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.226881] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.542 [2024-10-07 13:34:20.226890] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.226908] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.226921] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.226928] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.226946] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.542 [2024-10-07 13:34:20.226968] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d480, cid 0, qid 0 00:23:24.542 [2024-10-07 13:34:20.226979] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d600, cid 1, qid 0 00:23:24.542 [2024-10-07 13:34:20.226987] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d780, cid 2, qid 0 00:23:24.542 [2024-10-07 13:34:20.226995] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d900, cid 3, qid 0 00:23:24.542 [2024-10-07 13:34:20.227002] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172da80, cid 4, qid 0 00:23:24.542 [2024-10-07 13:34:20.227189] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.542 [2024-10-07 13:34:20.227203] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.542 [2024-10-07 13:34:20.227210] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.227217] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172da80) on tqpair=0x16cd760 00:23:24.542 [2024-10-07 13:34:20.227226] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:24.542 [2024-10-07 13:34:20.227245] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.227259] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.227276] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.227288] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.227295] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.227301] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16cd760) 00:23:24.542 [2024-10-07 13:34:20.227312] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:24.542 [2024-10-07 13:34:20.227333] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172da80, cid 4, qid 0 00:23:24.542 [2024-10-07 13:34:20.227471] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.542 [2024-10-07 13:34:20.227484] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.542 [2024-10-07 13:34:20.227499] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.227505] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172da80) on tqpair=0x16cd760 00:23:24.542 [2024-10-07 13:34:20.227589] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.227611] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:24.542 [2024-10-07 13:34:20.227626] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.542 [2024-10-07 13:34:20.227634] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.227645] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.227667] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172da80, cid 4, qid 0 00:23:24.543 [2024-10-07 13:34:20.227810] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.543 [2024-10-07 13:34:20.227850] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.543 [2024-10-07 13:34:20.227857] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.227863] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=4096, cccid=4 00:23:24.543 [2024-10-07 13:34:20.227870] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172da80) on tqpair(0x16cd760): expected_datao=0, payload_size=4096 00:23:24.543 [2024-10-07 13:34:20.227877] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.227894] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.227903] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.271497] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.271518] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.271526] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.271556] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172da80) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.271576] nvme_ctrlr.c:4722:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:24.543 [2024-10-07 13:34:20.271601] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.271622] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.271637] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.271645] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.271657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.271682] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172da80, cid 4, qid 0 00:23:24.543 [2024-10-07 13:34:20.271901] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.543 [2024-10-07 13:34:20.271916] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.543 [2024-10-07 13:34:20.271938] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.271944] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=4096, cccid=4 00:23:24.543 [2024-10-07 13:34:20.271952] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172da80) on tqpair(0x16cd760): expected_datao=0, payload_size=4096 00:23:24.543 [2024-10-07 13:34:20.271959] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.271977] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.272001] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.313633] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.313651] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.313658] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.313665] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172da80) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.313688] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.313708] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.313723] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.313731] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.313743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.313780] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172da80, cid 4, qid 0 00:23:24.543 [2024-10-07 13:34:20.313868] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.543 [2024-10-07 13:34:20.313882] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.543 [2024-10-07 13:34:20.313889] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.313894] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=4096, cccid=4 00:23:24.543 [2024-10-07 13:34:20.313902] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172da80) on tqpair(0x16cd760): expected_datao=0, payload_size=4096 00:23:24.543 [2024-10-07 13:34:20.313908] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.313925] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.313933] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.355649] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.355668] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.355676] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.355683] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172da80) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.355697] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.355713] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.355728] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.355740] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host behavior support feature (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.355748] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.355757] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.355766] nvme_ctrlr.c:3134:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:24.543 [2024-10-07 13:34:20.355773] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:24.543 [2024-10-07 13:34:20.355781] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:24.543 [2024-10-07 13:34:20.355813] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.355822] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.355833] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.355844] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.355851] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.355857] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.355866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:24.543 [2024-10-07 13:34:20.355888] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172da80, cid 4, qid 0 00:23:24.543 [2024-10-07 13:34:20.355900] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172dc00, cid 5, qid 0 00:23:24.543 [2024-10-07 13:34:20.356003] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.356015] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.356022] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356028] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172da80) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.356037] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.356046] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.356052] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356058] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172dc00) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.356073] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356081] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.356091] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.356116] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172dc00, cid 5, qid 0 00:23:24.543 [2024-10-07 13:34:20.356194] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.356206] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.356212] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356218] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172dc00) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.356233] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356241] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.356251] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.356271] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172dc00, cid 5, qid 0 00:23:24.543 [2024-10-07 13:34:20.356348] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.356361] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.356368] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356374] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172dc00) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.356389] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356397] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.356407] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.356428] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172dc00, cid 5, qid 0 00:23:24.543 [2024-10-07 13:34:20.356531] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.543 [2024-10-07 13:34:20.356546] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.543 [2024-10-07 13:34:20.356553] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356559] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172dc00) on tqpair=0x16cd760 00:23:24.543 [2024-10-07 13:34:20.356584] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356595] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x16cd760) 00:23:24.543 [2024-10-07 13:34:20.356606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.543 [2024-10-07 13:34:20.356618] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.543 [2024-10-07 13:34:20.356626] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x16cd760) 00:23:24.544 [2024-10-07 13:34:20.356635] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.544 [2024-10-07 13:34:20.356646] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.356654] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x16cd760) 00:23:24.544 [2024-10-07 13:34:20.356663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.544 [2024-10-07 13:34:20.356679] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.356687] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x16cd760) 00:23:24.544 [2024-10-07 13:34:20.356697] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.544 [2024-10-07 13:34:20.356723] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172dc00, cid 5, qid 0 00:23:24.544 [2024-10-07 13:34:20.356735] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172da80, cid 4, qid 0 00:23:24.544 [2024-10-07 13:34:20.356743] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172dd80, cid 6, qid 0 00:23:24.544 [2024-10-07 13:34:20.356751] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172df00, cid 7, qid 0 00:23:24.544 [2024-10-07 13:34:20.356962] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.544 [2024-10-07 13:34:20.356975] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.544 [2024-10-07 13:34:20.356981] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.356987] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=8192, cccid=5 00:23:24.544 [2024-10-07 13:34:20.356994] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172dc00) on tqpair(0x16cd760): expected_datao=0, payload_size=8192 00:23:24.544 [2024-10-07 13:34:20.357001] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357019] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357028] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357041] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.544 [2024-10-07 13:34:20.357050] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.544 [2024-10-07 13:34:20.357056] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357062] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=512, cccid=4 00:23:24.544 [2024-10-07 13:34:20.357068] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172da80) on tqpair(0x16cd760): expected_datao=0, payload_size=512 00:23:24.544 [2024-10-07 13:34:20.357075] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357084] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357090] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357098] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.544 [2024-10-07 13:34:20.357106] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.544 [2024-10-07 13:34:20.357112] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357117] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=512, cccid=6 00:23:24.544 [2024-10-07 13:34:20.357124] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172dd80) on tqpair(0x16cd760): expected_datao=0, payload_size=512 00:23:24.544 [2024-10-07 13:34:20.357131] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357139] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357145] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357153] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:24.544 [2024-10-07 13:34:20.357161] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:24.544 [2024-10-07 13:34:20.357167] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357173] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x16cd760): datao=0, datal=4096, cccid=7 00:23:24.544 [2024-10-07 13:34:20.357180] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x172df00) on tqpair(0x16cd760): expected_datao=0, payload_size=4096 00:23:24.544 [2024-10-07 13:34:20.357186] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357195] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357201] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357209] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.544 [2024-10-07 13:34:20.357220] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.544 [2024-10-07 13:34:20.357227] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357233] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172dc00) on tqpair=0x16cd760 00:23:24.544 [2024-10-07 13:34:20.357250] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.544 [2024-10-07 13:34:20.357261] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.544 [2024-10-07 13:34:20.357267] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357273] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172da80) on tqpair=0x16cd760 00:23:24.544 [2024-10-07 13:34:20.357287] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.544 [2024-10-07 13:34:20.357297] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.544 [2024-10-07 13:34:20.357303] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357309] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172dd80) on tqpair=0x16cd760 00:23:24.544 [2024-10-07 13:34:20.357319] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.544 [2024-10-07 13:34:20.357328] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.544 [2024-10-07 13:34:20.357334] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.544 [2024-10-07 13:34:20.357340] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172df00) on tqpair=0x16cd760 00:23:24.544 ===================================================== 00:23:24.544 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:24.544 ===================================================== 00:23:24.544 Controller Capabilities/Features 00:23:24.544 ================================ 00:23:24.544 Vendor ID: 8086 00:23:24.544 Subsystem Vendor ID: 8086 00:23:24.544 Serial Number: SPDK00000000000001 00:23:24.544 Model Number: SPDK bdev Controller 00:23:24.544 Firmware Version: 25.01 00:23:24.544 Recommended Arb Burst: 6 00:23:24.544 IEEE OUI Identifier: e4 d2 5c 00:23:24.544 Multi-path I/O 00:23:24.544 May have multiple subsystem ports: Yes 00:23:24.544 May have multiple controllers: Yes 00:23:24.544 Associated with SR-IOV VF: No 00:23:24.544 Max Data Transfer Size: 131072 00:23:24.544 Max Number of Namespaces: 32 00:23:24.544 Max Number of I/O Queues: 127 00:23:24.544 NVMe Specification Version (VS): 1.3 00:23:24.544 NVMe Specification Version (Identify): 1.3 00:23:24.544 Maximum Queue Entries: 128 00:23:24.544 Contiguous Queues Required: Yes 00:23:24.544 Arbitration Mechanisms Supported 00:23:24.544 Weighted Round Robin: Not Supported 00:23:24.544 Vendor Specific: Not Supported 00:23:24.544 Reset Timeout: 15000 ms 00:23:24.544 Doorbell Stride: 4 bytes 00:23:24.544 NVM Subsystem Reset: Not Supported 00:23:24.544 Command Sets Supported 00:23:24.544 NVM Command Set: Supported 00:23:24.544 Boot Partition: Not Supported 00:23:24.544 Memory Page Size Minimum: 4096 bytes 00:23:24.544 Memory Page Size Maximum: 4096 bytes 00:23:24.544 Persistent Memory Region: Not Supported 00:23:24.544 Optional Asynchronous Events Supported 00:23:24.544 Namespace Attribute Notices: Supported 00:23:24.544 Firmware Activation Notices: Not Supported 00:23:24.544 ANA Change Notices: Not Supported 00:23:24.544 PLE Aggregate Log Change Notices: Not Supported 00:23:24.544 LBA Status Info Alert Notices: Not Supported 00:23:24.544 EGE Aggregate Log Change Notices: Not Supported 00:23:24.544 Normal NVM Subsystem Shutdown event: Not Supported 00:23:24.544 Zone Descriptor Change Notices: Not Supported 00:23:24.544 Discovery Log Change Notices: Not Supported 00:23:24.544 Controller Attributes 00:23:24.544 128-bit Host Identifier: Supported 00:23:24.544 Non-Operational Permissive Mode: Not Supported 00:23:24.544 NVM Sets: Not Supported 00:23:24.544 Read Recovery Levels: Not Supported 00:23:24.544 Endurance Groups: Not Supported 00:23:24.544 Predictable Latency Mode: Not Supported 00:23:24.544 Traffic Based Keep ALive: Not Supported 00:23:24.544 Namespace Granularity: Not Supported 00:23:24.544 SQ Associations: Not Supported 00:23:24.544 UUID List: Not Supported 00:23:24.544 Multi-Domain Subsystem: Not Supported 00:23:24.544 Fixed Capacity Management: Not Supported 00:23:24.544 Variable Capacity Management: Not Supported 00:23:24.544 Delete Endurance Group: Not Supported 00:23:24.544 Delete NVM Set: Not Supported 00:23:24.544 Extended LBA Formats Supported: Not Supported 00:23:24.544 Flexible Data Placement Supported: Not Supported 00:23:24.544 00:23:24.544 Controller Memory Buffer Support 00:23:24.544 ================================ 00:23:24.544 Supported: No 00:23:24.544 00:23:24.544 Persistent Memory Region Support 00:23:24.544 ================================ 00:23:24.544 Supported: No 00:23:24.544 00:23:24.544 Admin Command Set Attributes 00:23:24.544 ============================ 00:23:24.544 Security Send/Receive: Not Supported 00:23:24.544 Format NVM: Not Supported 00:23:24.544 Firmware Activate/Download: Not Supported 00:23:24.544 Namespace Management: Not Supported 00:23:24.544 Device Self-Test: Not Supported 00:23:24.545 Directives: Not Supported 00:23:24.545 NVMe-MI: Not Supported 00:23:24.545 Virtualization Management: Not Supported 00:23:24.545 Doorbell Buffer Config: Not Supported 00:23:24.545 Get LBA Status Capability: Not Supported 00:23:24.545 Command & Feature Lockdown Capability: Not Supported 00:23:24.545 Abort Command Limit: 4 00:23:24.545 Async Event Request Limit: 4 00:23:24.545 Number of Firmware Slots: N/A 00:23:24.545 Firmware Slot 1 Read-Only: N/A 00:23:24.545 Firmware Activation Without Reset: N/A 00:23:24.545 Multiple Update Detection Support: N/A 00:23:24.545 Firmware Update Granularity: No Information Provided 00:23:24.545 Per-Namespace SMART Log: No 00:23:24.545 Asymmetric Namespace Access Log Page: Not Supported 00:23:24.545 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:24.545 Command Effects Log Page: Supported 00:23:24.545 Get Log Page Extended Data: Supported 00:23:24.545 Telemetry Log Pages: Not Supported 00:23:24.545 Persistent Event Log Pages: Not Supported 00:23:24.545 Supported Log Pages Log Page: May Support 00:23:24.545 Commands Supported & Effects Log Page: Not Supported 00:23:24.545 Feature Identifiers & Effects Log Page:May Support 00:23:24.545 NVMe-MI Commands & Effects Log Page: May Support 00:23:24.545 Data Area 4 for Telemetry Log: Not Supported 00:23:24.545 Error Log Page Entries Supported: 128 00:23:24.545 Keep Alive: Supported 00:23:24.545 Keep Alive Granularity: 10000 ms 00:23:24.545 00:23:24.545 NVM Command Set Attributes 00:23:24.545 ========================== 00:23:24.545 Submission Queue Entry Size 00:23:24.545 Max: 64 00:23:24.545 Min: 64 00:23:24.545 Completion Queue Entry Size 00:23:24.545 Max: 16 00:23:24.545 Min: 16 00:23:24.545 Number of Namespaces: 32 00:23:24.545 Compare Command: Supported 00:23:24.545 Write Uncorrectable Command: Not Supported 00:23:24.545 Dataset Management Command: Supported 00:23:24.545 Write Zeroes Command: Supported 00:23:24.545 Set Features Save Field: Not Supported 00:23:24.545 Reservations: Supported 00:23:24.545 Timestamp: Not Supported 00:23:24.545 Copy: Supported 00:23:24.545 Volatile Write Cache: Present 00:23:24.545 Atomic Write Unit (Normal): 1 00:23:24.545 Atomic Write Unit (PFail): 1 00:23:24.545 Atomic Compare & Write Unit: 1 00:23:24.545 Fused Compare & Write: Supported 00:23:24.545 Scatter-Gather List 00:23:24.545 SGL Command Set: Supported 00:23:24.545 SGL Keyed: Supported 00:23:24.545 SGL Bit Bucket Descriptor: Not Supported 00:23:24.545 SGL Metadata Pointer: Not Supported 00:23:24.545 Oversized SGL: Not Supported 00:23:24.545 SGL Metadata Address: Not Supported 00:23:24.545 SGL Offset: Supported 00:23:24.545 Transport SGL Data Block: Not Supported 00:23:24.545 Replay Protected Memory Block: Not Supported 00:23:24.545 00:23:24.545 Firmware Slot Information 00:23:24.545 ========================= 00:23:24.545 Active slot: 1 00:23:24.545 Slot 1 Firmware Revision: 25.01 00:23:24.545 00:23:24.545 00:23:24.545 Commands Supported and Effects 00:23:24.545 ============================== 00:23:24.545 Admin Commands 00:23:24.545 -------------- 00:23:24.545 Get Log Page (02h): Supported 00:23:24.545 Identify (06h): Supported 00:23:24.545 Abort (08h): Supported 00:23:24.545 Set Features (09h): Supported 00:23:24.545 Get Features (0Ah): Supported 00:23:24.545 Asynchronous Event Request (0Ch): Supported 00:23:24.545 Keep Alive (18h): Supported 00:23:24.545 I/O Commands 00:23:24.545 ------------ 00:23:24.545 Flush (00h): Supported LBA-Change 00:23:24.545 Write (01h): Supported LBA-Change 00:23:24.545 Read (02h): Supported 00:23:24.545 Compare (05h): Supported 00:23:24.545 Write Zeroes (08h): Supported LBA-Change 00:23:24.545 Dataset Management (09h): Supported LBA-Change 00:23:24.545 Copy (19h): Supported LBA-Change 00:23:24.545 00:23:24.545 Error Log 00:23:24.545 ========= 00:23:24.545 00:23:24.545 Arbitration 00:23:24.545 =========== 00:23:24.545 Arbitration Burst: 1 00:23:24.545 00:23:24.545 Power Management 00:23:24.545 ================ 00:23:24.545 Number of Power States: 1 00:23:24.545 Current Power State: Power State #0 00:23:24.545 Power State #0: 00:23:24.545 Max Power: 0.00 W 00:23:24.545 Non-Operational State: Operational 00:23:24.545 Entry Latency: Not Reported 00:23:24.545 Exit Latency: Not Reported 00:23:24.545 Relative Read Throughput: 0 00:23:24.545 Relative Read Latency: 0 00:23:24.545 Relative Write Throughput: 0 00:23:24.545 Relative Write Latency: 0 00:23:24.545 Idle Power: Not Reported 00:23:24.545 Active Power: Not Reported 00:23:24.545 Non-Operational Permissive Mode: Not Supported 00:23:24.545 00:23:24.545 Health Information 00:23:24.545 ================== 00:23:24.545 Critical Warnings: 00:23:24.545 Available Spare Space: OK 00:23:24.545 Temperature: OK 00:23:24.545 Device Reliability: OK 00:23:24.545 Read Only: No 00:23:24.545 Volatile Memory Backup: OK 00:23:24.545 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:24.545 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:23:24.545 Available Spare: 0% 00:23:24.545 Available Spare Threshold: 0% 00:23:24.545 Life Percentage Used:[2024-10-07 13:34:20.357449] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.545 [2024-10-07 13:34:20.357460] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x16cd760) 00:23:24.545 [2024-10-07 13:34:20.357492] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.545 [2024-10-07 13:34:20.357517] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172df00, cid 7, qid 0 00:23:24.545 [2024-10-07 13:34:20.357691] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.545 [2024-10-07 13:34:20.357704] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.545 [2024-10-07 13:34:20.357710] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.545 [2024-10-07 13:34:20.357716] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172df00) on tqpair=0x16cd760 00:23:24.545 [2024-10-07 13:34:20.357758] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:24.545 [2024-10-07 13:34:20.357792] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d480) on tqpair=0x16cd760 00:23:24.545 [2024-10-07 13:34:20.357802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.545 [2024-10-07 13:34:20.357810] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d600) on tqpair=0x16cd760 00:23:24.545 [2024-10-07 13:34:20.357817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.545 [2024-10-07 13:34:20.357825] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d780) on tqpair=0x16cd760 00:23:24.545 [2024-10-07 13:34:20.357831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.545 [2024-10-07 13:34:20.357839] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d900) on tqpair=0x16cd760 00:23:24.545 [2024-10-07 13:34:20.357846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:24.545 [2024-10-07 13:34:20.357857] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.545 [2024-10-07 13:34:20.357865] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.545 [2024-10-07 13:34:20.357870] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16cd760) 00:23:24.545 [2024-10-07 13:34:20.357887] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.545 [2024-10-07 13:34:20.357910] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d900, cid 3, qid 0 00:23:24.545 [2024-10-07 13:34:20.358054] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.545 [2024-10-07 13:34:20.358067] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.545 [2024-10-07 13:34:20.358073] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.545 [2024-10-07 13:34:20.358079] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d900) on tqpair=0x16cd760 00:23:24.545 [2024-10-07 13:34:20.358090] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.545 [2024-10-07 13:34:20.358097] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.545 [2024-10-07 13:34:20.358103] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16cd760) 00:23:24.546 [2024-10-07 13:34:20.358113] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.546 [2024-10-07 13:34:20.358138] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d900, cid 3, qid 0 00:23:24.546 [2024-10-07 13:34:20.358232] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.546 [2024-10-07 13:34:20.358243] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.546 [2024-10-07 13:34:20.358250] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.546 [2024-10-07 13:34:20.358256] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d900) on tqpair=0x16cd760 00:23:24.546 [2024-10-07 13:34:20.358263] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:24.546 [2024-10-07 13:34:20.358270] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:24.546 [2024-10-07 13:34:20.358285] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.546 [2024-10-07 13:34:20.358293] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.546 [2024-10-07 13:34:20.358299] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16cd760) 00:23:24.546 [2024-10-07 13:34:20.358309] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.546 [2024-10-07 13:34:20.358328] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d900, cid 3, qid 0 00:23:24.546 [2024-10-07 13:34:20.358404] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.546 [2024-10-07 13:34:20.358417] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.546 [2024-10-07 13:34:20.358424] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.546 [2024-10-07 13:34:20.358430] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d900) on tqpair=0x16cd760 00:23:24.546 [2024-10-07 13:34:20.358445] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:24.546 [2024-10-07 13:34:20.358454] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:24.546 [2024-10-07 13:34:20.358460] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x16cd760) 00:23:24.546 [2024-10-07 13:34:20.362492] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:24.546 [2024-10-07 13:34:20.362538] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x172d900, cid 3, qid 0 00:23:24.546 [2024-10-07 13:34:20.362710] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:24.546 [2024-10-07 13:34:20.362724] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:24.546 [2024-10-07 13:34:20.362731] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:24.546 [2024-10-07 13:34:20.362737] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x172d900) on tqpair=0x16cd760 00:23:24.546 [2024-10-07 13:34:20.362750] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:23:24.546 0% 00:23:24.546 Data Units Read: 0 00:23:24.546 Data Units Written: 0 00:23:24.546 Host Read Commands: 0 00:23:24.546 Host Write Commands: 0 00:23:24.546 Controller Busy Time: 0 minutes 00:23:24.546 Power Cycles: 0 00:23:24.546 Power On Hours: 0 hours 00:23:24.546 Unsafe Shutdowns: 0 00:23:24.546 Unrecoverable Media Errors: 0 00:23:24.546 Lifetime Error Log Entries: 0 00:23:24.546 Warning Temperature Time: 0 minutes 00:23:24.546 Critical Temperature Time: 0 minutes 00:23:24.546 00:23:24.546 Number of Queues 00:23:24.546 ================ 00:23:24.546 Number of I/O Submission Queues: 127 00:23:24.546 Number of I/O Completion Queues: 127 00:23:24.546 00:23:24.546 Active Namespaces 00:23:24.546 ================= 00:23:24.546 Namespace ID:1 00:23:24.546 Error Recovery Timeout: Unlimited 00:23:24.546 Command Set Identifier: NVM (00h) 00:23:24.546 Deallocate: Supported 00:23:24.546 Deallocated/Unwritten Error: Not Supported 00:23:24.546 Deallocated Read Value: Unknown 00:23:24.546 Deallocate in Write Zeroes: Not Supported 00:23:24.546 Deallocated Guard Field: 0xFFFF 00:23:24.546 Flush: Supported 00:23:24.546 Reservation: Supported 00:23:24.546 Namespace Sharing Capabilities: Multiple Controllers 00:23:24.546 Size (in LBAs): 131072 (0GiB) 00:23:24.546 Capacity (in LBAs): 131072 (0GiB) 00:23:24.546 Utilization (in LBAs): 131072 (0GiB) 00:23:24.546 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:24.546 EUI64: ABCDEF0123456789 00:23:24.546 UUID: 5e29a02b-49e6-43c0-acf6-4c40f4fd0ec9 00:23:24.546 Thin Provisioning: Not Supported 00:23:24.546 Per-NS Atomic Units: Yes 00:23:24.546 Atomic Boundary Size (Normal): 0 00:23:24.546 Atomic Boundary Size (PFail): 0 00:23:24.546 Atomic Boundary Offset: 0 00:23:24.546 Maximum Single Source Range Length: 65535 00:23:24.546 Maximum Copy Length: 65535 00:23:24.546 Maximum Source Range Count: 1 00:23:24.546 NGUID/EUI64 Never Reused: No 00:23:24.546 Namespace Write Protected: No 00:23:24.546 Number of LBA Formats: 1 00:23:24.546 Current LBA Format: LBA Format #00 00:23:24.546 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:24.546 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@51 -- # sync 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@56 -- # nvmftestfini 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@514 -- # nvmfcleanup 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@121 -- # sync 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@124 -- # set +e 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@125 -- # for i in {1..20} 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:23:24.546 rmmod nvme_tcp 00:23:24.546 rmmod nvme_fabrics 00:23:24.546 rmmod nvme_keyring 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@128 -- # set -e 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@129 -- # return 0 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@515 -- # '[' -n 700333 ']' 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@516 -- # killprocess 700333 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@950 -- # '[' -z 700333 ']' 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@954 -- # kill -0 700333 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # uname 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:23:24.546 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 700333 00:23:24.805 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:23:24.805 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:23:24.805 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@968 -- # echo 'killing process with pid 700333' 00:23:24.805 killing process with pid 700333 00:23:24.805 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@969 -- # kill 700333 00:23:24.805 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@974 -- # wait 700333 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@297 -- # iptr 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-save 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-restore 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@302 -- # remove_spdk_ns 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:25.065 13:34:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:23:26.969 00:23:26.969 real 0m5.677s 00:23:26.969 user 0m5.000s 00:23:26.969 sys 0m1.890s 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:23:26.969 ************************************ 00:23:26.969 END TEST nvmf_identify 00:23:26.969 ************************************ 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@23 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:23:26.969 ************************************ 00:23:26.969 START TEST nvmf_perf 00:23:26.969 ************************************ 00:23:26.969 13:34:22 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:27.227 * Looking for test storage... 00:23:27.227 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:27.227 13:34:22 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:27.227 13:34:22 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lcov --version 00:23:27.227 13:34:22 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # IFS=.-: 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # read -ra ver1 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # IFS=.-: 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # read -ra ver2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@338 -- # local 'op=<' 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@340 -- # ver1_l=2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@341 -- # ver2_l=1 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@344 -- # case "$op" in 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@345 -- # : 1 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # decimal 1 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=1 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 1 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # ver1[v]=1 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # decimal 2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # ver2[v]=2 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # return 0 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:27.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.227 --rc genhtml_branch_coverage=1 00:23:27.227 --rc genhtml_function_coverage=1 00:23:27.227 --rc genhtml_legend=1 00:23:27.227 --rc geninfo_all_blocks=1 00:23:27.227 --rc geninfo_unexecuted_blocks=1 00:23:27.227 00:23:27.227 ' 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:27.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.227 --rc genhtml_branch_coverage=1 00:23:27.227 --rc genhtml_function_coverage=1 00:23:27.227 --rc genhtml_legend=1 00:23:27.227 --rc geninfo_all_blocks=1 00:23:27.227 --rc geninfo_unexecuted_blocks=1 00:23:27.227 00:23:27.227 ' 00:23:27.227 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:27.227 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.227 --rc genhtml_branch_coverage=1 00:23:27.227 --rc genhtml_function_coverage=1 00:23:27.227 --rc genhtml_legend=1 00:23:27.227 --rc geninfo_all_blocks=1 00:23:27.228 --rc geninfo_unexecuted_blocks=1 00:23:27.228 00:23:27.228 ' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:27.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:27.228 --rc genhtml_branch_coverage=1 00:23:27.228 --rc genhtml_function_coverage=1 00:23:27.228 --rc genhtml_legend=1 00:23:27.228 --rc geninfo_all_blocks=1 00:23:27.228 --rc geninfo_unexecuted_blocks=1 00:23:27.228 00:23:27.228 ' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # uname -s 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@15 -- # shopt -s extglob 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@5 -- # export PATH 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@51 -- # : 0 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:27.228 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@17 -- # nvmftestinit 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@474 -- # prepare_net_devs 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@309 -- # xtrace_disable 00:23:27.228 13:34:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@315 -- # pci_devs=() 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@315 -- # local -a pci_devs 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@316 -- # pci_net_devs=() 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@317 -- # pci_drivers=() 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@317 -- # local -A pci_drivers 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@319 -- # net_devs=() 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@319 -- # local -ga net_devs 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@320 -- # e810=() 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@320 -- # local -ga e810 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@321 -- # x722=() 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@321 -- # local -ga x722 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@322 -- # mlx=() 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@322 -- # local -ga mlx 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:23:29.758 Found 0000:84:00.0 (0x8086 - 0x159b) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:23:29.758 Found 0000:84:00.1 (0x8086 - 0x159b) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:23:29.758 Found net devices under 0000:84:00.0: cvl_0_0 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:23:29.758 Found net devices under 0000:84:00.1: cvl_0_1 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@440 -- # is_hw=yes 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:23:29.758 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:23:29.758 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:29.758 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:23:29.758 00:23:29.758 --- 10.0.0.2 ping statistics --- 00:23:29.758 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:29.759 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:29.759 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:29.759 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:23:29.759 00:23:29.759 --- 10.0.0.1 ping statistics --- 00:23:29.759 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:29.759 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@448 -- # return 0 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@724 -- # xtrace_disable 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@507 -- # nvmfpid=702441 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@508 -- # waitforlisten 702441 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@831 -- # '[' -z 702441 ']' 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@836 -- # local max_retries=100 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:29.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@840 -- # xtrace_disable 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:23:29.759 [2024-10-07 13:34:25.361242] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:29.759 [2024-10-07 13:34:25.361333] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:29.759 [2024-10-07 13:34:25.424607] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:29.759 [2024-10-07 13:34:25.523906] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:29.759 [2024-10-07 13:34:25.523971] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:29.759 [2024-10-07 13:34:25.523996] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:29.759 [2024-10-07 13:34:25.524007] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:29.759 [2024-10-07 13:34:25.524016] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:29.759 [2024-10-07 13:34:25.525785] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:23:29.759 [2024-10-07 13:34:25.525828] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:23:29.759 [2024-10-07 13:34:25.525886] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:23:29.759 [2024-10-07 13:34:25.525889] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@864 -- # return 0 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@730 -- # xtrace_disable 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:23:29.759 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:30.016 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:30.016 13:34:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:33.303 13:34:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:33.303 13:34:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:33.303 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # local_nvme_trid=0000:82:00.0 00:23:33.303 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:33.561 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:33.561 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@33 -- # '[' -n 0000:82:00.0 ']' 00:23:33.561 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:33.561 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:33.561 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:33.819 [2024-10-07 13:34:29.639679] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:33.819 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:34.077 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:34.077 13:34:29 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:34.334 13:34:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:34.334 13:34:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:34.592 13:34:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:34.850 [2024-10-07 13:34:30.739159] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:34.850 13:34:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:35.108 13:34:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@52 -- # '[' -n 0000:82:00.0 ']' 00:23:35.108 13:34:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:82:00.0' 00:23:35.108 13:34:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:35.108 13:34:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:82:00.0' 00:23:36.485 Initializing NVMe Controllers 00:23:36.485 Attached to NVMe Controller at 0000:82:00.0 [8086:0a54] 00:23:36.485 Associating PCIE (0000:82:00.0) NSID 1 with lcore 0 00:23:36.485 Initialization complete. Launching workers. 00:23:36.485 ======================================================== 00:23:36.485 Latency(us) 00:23:36.485 Device Information : IOPS MiB/s Average min max 00:23:36.485 PCIE (0000:82:00.0) NSID 1 from core 0: 85161.42 332.66 375.11 39.67 4372.15 00:23:36.485 ======================================================== 00:23:36.485 Total : 85161.42 332.66 375.11 39.67 4372.15 00:23:36.485 00:23:36.485 13:34:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:37.860 Initializing NVMe Controllers 00:23:37.860 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:37.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:37.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:37.860 Initialization complete. Launching workers. 00:23:37.860 ======================================================== 00:23:37.860 Latency(us) 00:23:37.860 Device Information : IOPS MiB/s Average min max 00:23:37.860 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 132.00 0.52 7792.34 144.78 45799.48 00:23:37.860 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 47.00 0.18 21545.85 7139.18 47899.59 00:23:37.860 ======================================================== 00:23:37.860 Total : 179.00 0.70 11403.59 144.78 47899.59 00:23:37.860 00:23:37.860 13:34:33 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.237 Initializing NVMe Controllers 00:23:39.237 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:39.237 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:39.237 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:39.237 Initialization complete. Launching workers. 00:23:39.237 ======================================================== 00:23:39.237 Latency(us) 00:23:39.237 Device Information : IOPS MiB/s Average min max 00:23:39.237 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8420.95 32.89 3799.17 680.21 7771.93 00:23:39.237 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3797.16 14.83 8452.38 6081.15 16247.86 00:23:39.237 ======================================================== 00:23:39.237 Total : 12218.11 47.73 5245.30 680.21 16247.86 00:23:39.237 00:23:39.237 13:34:34 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:39.237 13:34:34 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:39.237 13:34:34 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:41.766 Initializing NVMe Controllers 00:23:41.766 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.766 Controller IO queue size 128, less than required. 00:23:41.766 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.766 Controller IO queue size 128, less than required. 00:23:41.766 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.766 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:41.766 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:41.766 Initialization complete. Launching workers. 00:23:41.766 ======================================================== 00:23:41.766 Latency(us) 00:23:41.766 Device Information : IOPS MiB/s Average min max 00:23:41.767 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1319.48 329.87 99058.61 59574.56 171601.42 00:23:41.767 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 573.99 143.50 233906.21 76219.43 380357.69 00:23:41.767 ======================================================== 00:23:41.767 Total : 1893.47 473.37 139936.62 59574.56 380357.69 00:23:41.767 00:23:41.767 13:34:37 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:41.767 No valid NVMe controllers or AIO or URING devices found 00:23:41.767 Initializing NVMe Controllers 00:23:41.767 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.767 Controller IO queue size 128, less than required. 00:23:41.767 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.767 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:41.767 Controller IO queue size 128, less than required. 00:23:41.767 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:41.767 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:41.767 WARNING: Some requested NVMe devices were skipped 00:23:41.767 13:34:37 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:44.297 Initializing NVMe Controllers 00:23:44.297 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:44.297 Controller IO queue size 128, less than required. 00:23:44.297 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.297 Controller IO queue size 128, less than required. 00:23:44.297 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:44.297 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:44.297 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:44.297 Initialization complete. Launching workers. 00:23:44.298 00:23:44.298 ==================== 00:23:44.298 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:44.298 TCP transport: 00:23:44.298 polls: 7707 00:23:44.298 idle_polls: 5331 00:23:44.298 sock_completions: 2376 00:23:44.298 nvme_completions: 4535 00:23:44.298 submitted_requests: 6768 00:23:44.298 queued_requests: 1 00:23:44.298 00:23:44.298 ==================== 00:23:44.298 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:44.298 TCP transport: 00:23:44.298 polls: 10031 00:23:44.298 idle_polls: 7621 00:23:44.298 sock_completions: 2410 00:23:44.298 nvme_completions: 4843 00:23:44.298 submitted_requests: 7280 00:23:44.298 queued_requests: 1 00:23:44.298 ======================================================== 00:23:44.298 Latency(us) 00:23:44.298 Device Information : IOPS MiB/s Average min max 00:23:44.298 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1131.66 282.91 118412.85 79377.12 189313.06 00:23:44.298 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1208.53 302.13 106701.39 65372.22 159479.16 00:23:44.298 ======================================================== 00:23:44.298 Total : 2340.19 585.05 112364.76 65372.22 189313.06 00:23:44.298 00:23:44.298 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@66 -- # sync 00:23:44.298 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@114 -- # nvmftestfini 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@514 -- # nvmfcleanup 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@121 -- # sync 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@124 -- # set +e 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@125 -- # for i in {1..20} 00:23:44.555 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:23:44.555 rmmod nvme_tcp 00:23:44.555 rmmod nvme_fabrics 00:23:44.555 rmmod nvme_keyring 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@128 -- # set -e 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@129 -- # return 0 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@515 -- # '[' -n 702441 ']' 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@516 -- # killprocess 702441 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@950 -- # '[' -z 702441 ']' 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@954 -- # kill -0 702441 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # uname 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 702441 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 702441' 00:23:44.813 killing process with pid 702441 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@969 -- # kill 702441 00:23:44.813 13:34:40 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@974 -- # wait 702441 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@297 -- # iptr 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-save 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-restore 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@302 -- # remove_spdk_ns 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:46.716 13:34:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:23:48.633 00:23:48.633 real 0m21.406s 00:23:48.633 user 1m5.529s 00:23:48.633 sys 0m5.970s 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:23:48.633 ************************************ 00:23:48.633 END TEST nvmf_perf 00:23:48.633 ************************************ 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@24 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:23:48.633 ************************************ 00:23:48.633 START TEST nvmf_fio_host 00:23:48.633 ************************************ 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:23:48.633 * Looking for test storage... 00:23:48.633 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lcov --version 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # IFS=.-: 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # read -ra ver1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # IFS=.-: 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # read -ra ver2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@338 -- # local 'op=<' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@340 -- # ver1_l=2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@341 -- # ver2_l=1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@344 -- # case "$op" in 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@345 -- # : 1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # decimal 1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # ver1[v]=1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # decimal 2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # ver2[v]=2 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # return 0 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:23:48.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:48.633 --rc genhtml_branch_coverage=1 00:23:48.633 --rc genhtml_function_coverage=1 00:23:48.633 --rc genhtml_legend=1 00:23:48.633 --rc geninfo_all_blocks=1 00:23:48.633 --rc geninfo_unexecuted_blocks=1 00:23:48.633 00:23:48.633 ' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:23:48.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:48.633 --rc genhtml_branch_coverage=1 00:23:48.633 --rc genhtml_function_coverage=1 00:23:48.633 --rc genhtml_legend=1 00:23:48.633 --rc geninfo_all_blocks=1 00:23:48.633 --rc geninfo_unexecuted_blocks=1 00:23:48.633 00:23:48.633 ' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:23:48.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:48.633 --rc genhtml_branch_coverage=1 00:23:48.633 --rc genhtml_function_coverage=1 00:23:48.633 --rc genhtml_legend=1 00:23:48.633 --rc geninfo_all_blocks=1 00:23:48.633 --rc geninfo_unexecuted_blocks=1 00:23:48.633 00:23:48.633 ' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:23:48.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:48.633 --rc genhtml_branch_coverage=1 00:23:48.633 --rc genhtml_function_coverage=1 00:23:48.633 --rc genhtml_legend=1 00:23:48.633 --rc geninfo_all_blocks=1 00:23:48.633 --rc geninfo_unexecuted_blocks=1 00:23:48.633 00:23:48.633 ' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # uname -s 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:48.633 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@51 -- # : 0 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:23:48.634 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@14 -- # nvmftestinit 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@474 -- # prepare_net_devs 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@436 -- # local -g is_hw=no 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@438 -- # remove_spdk_ns 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@309 -- # xtrace_disable 00:23:48.634 13:34:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@315 -- # pci_devs=() 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@315 -- # local -a pci_devs 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@316 -- # pci_net_devs=() 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@317 -- # pci_drivers=() 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@317 -- # local -A pci_drivers 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@319 -- # net_devs=() 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@319 -- # local -ga net_devs 00:23:51.167 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@320 -- # e810=() 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@320 -- # local -ga e810 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@321 -- # x722=() 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@321 -- # local -ga x722 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@322 -- # mlx=() 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@322 -- # local -ga mlx 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:23:51.168 Found 0000:84:00.0 (0x8086 - 0x159b) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:23:51.168 Found 0000:84:00.1 (0x8086 - 0x159b) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:23:51.168 Found net devices under 0000:84:00.0: cvl_0_0 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@416 -- # [[ up == up ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:23:51.168 Found net devices under 0000:84:00.1: cvl_0_1 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@440 -- # is_hw=yes 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:23:51.168 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:51.168 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:23:51.168 00:23:51.168 --- 10.0.0.2 ping statistics --- 00:23:51.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:51.168 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:51.168 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:51.168 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:23:51.168 00:23:51.168 --- 10.0.0.1 ping statistics --- 00:23:51.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:51.168 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@448 -- # return 0 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@16 -- # [[ y != y ]] 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@724 -- # xtrace_disable 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@24 -- # nvmfpid=706425 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@28 -- # waitforlisten 706425 00:23:51.168 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@831 -- # '[' -z 706425 ']' 00:23:51.169 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:51.169 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@836 -- # local max_retries=100 00:23:51.169 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:51.169 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:51.169 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@840 -- # xtrace_disable 00:23:51.169 13:34:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:23:51.169 [2024-10-07 13:34:46.836635] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:23:51.169 [2024-10-07 13:34:46.836717] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:51.169 [2024-10-07 13:34:46.899850] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:51.169 [2024-10-07 13:34:46.999737] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:51.169 [2024-10-07 13:34:46.999796] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:51.169 [2024-10-07 13:34:46.999824] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:51.169 [2024-10-07 13:34:46.999835] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:51.169 [2024-10-07 13:34:46.999845] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:51.169 [2024-10-07 13:34:47.001577] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:23:51.169 [2024-10-07 13:34:47.001640] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:23:51.169 [2024-10-07 13:34:47.001705] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:23:51.169 [2024-10-07 13:34:47.001709] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:23:51.435 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:23:51.435 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@864 -- # return 0 00:23:51.435 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:23:51.694 [2024-10-07 13:34:47.440455] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:51.694 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:23:51.694 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@730 -- # xtrace_disable 00:23:51.694 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:23:51.694 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:23:51.975 Malloc1 00:23:51.975 13:34:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:52.290 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:52.549 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:52.807 [2024-10-07 13:34:48.591196] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:52.807 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:23:53.068 13:34:48 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:53.327 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:23:53.327 fio-3.35 00:23:53.327 Starting 1 thread 00:23:55.853 00:23:55.853 test: (groupid=0, jobs=1): err= 0: pid=706783: Mon Oct 7 13:34:51 2024 00:23:55.854 read: IOPS=8840, BW=34.5MiB/s (36.2MB/s)(69.3MiB/2006msec) 00:23:55.854 slat (usec): min=2, max=148, avg= 3.52, stdev= 2.61 00:23:55.854 clat (usec): min=2407, max=13781, avg=7911.27, stdev=603.46 00:23:55.854 lat (usec): min=2432, max=13784, avg=7914.79, stdev=603.35 00:23:55.854 clat percentiles (usec): 00:23:55.854 | 1.00th=[ 6587], 5.00th=[ 6980], 10.00th=[ 7177], 20.00th=[ 7439], 00:23:55.854 | 30.00th=[ 7635], 40.00th=[ 7767], 50.00th=[ 7898], 60.00th=[ 8029], 00:23:55.854 | 70.00th=[ 8225], 80.00th=[ 8356], 90.00th=[ 8586], 95.00th=[ 8848], 00:23:55.854 | 99.00th=[ 9241], 99.50th=[ 9503], 99.90th=[11338], 99.95th=[12911], 00:23:55.854 | 99.99th=[13698] 00:23:55.854 bw ( KiB/s): min=34352, max=35864, per=99.92%, avg=35334.00, stdev=684.06, samples=4 00:23:55.854 iops : min= 8588, max= 8966, avg=8833.50, stdev=171.02, samples=4 00:23:55.854 write: IOPS=8856, BW=34.6MiB/s (36.3MB/s)(69.4MiB/2006msec); 0 zone resets 00:23:55.854 slat (usec): min=2, max=126, avg= 3.65, stdev= 2.43 00:23:55.854 clat (usec): min=1332, max=12156, avg=6497.99, stdev=530.89 00:23:55.854 lat (usec): min=1340, max=12159, avg=6501.63, stdev=530.86 00:23:55.854 clat percentiles (usec): 00:23:55.854 | 1.00th=[ 5407], 5.00th=[ 5735], 10.00th=[ 5866], 20.00th=[ 6128], 00:23:55.854 | 30.00th=[ 6259], 40.00th=[ 6390], 50.00th=[ 6521], 60.00th=[ 6587], 00:23:55.854 | 70.00th=[ 6718], 80.00th=[ 6915], 90.00th=[ 7111], 95.00th=[ 7308], 00:23:55.854 | 99.00th=[ 7701], 99.50th=[ 7898], 99.90th=[10290], 99.95th=[11076], 00:23:55.854 | 99.99th=[12125] 00:23:55.854 bw ( KiB/s): min=34624, max=35904, per=99.96%, avg=35412.00, stdev=617.38, samples=4 00:23:55.854 iops : min= 8656, max= 8976, avg=8853.00, stdev=154.35, samples=4 00:23:55.854 lat (msec) : 2=0.03%, 4=0.11%, 10=99.71%, 20=0.15% 00:23:55.854 cpu : usr=69.78%, sys=28.83%, ctx=58, majf=0, minf=32 00:23:55.854 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:23:55.854 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:55.854 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:55.854 issued rwts: total=17734,17766,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:55.854 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:55.854 00:23:55.854 Run status group 0 (all jobs): 00:23:55.854 READ: bw=34.5MiB/s (36.2MB/s), 34.5MiB/s-34.5MiB/s (36.2MB/s-36.2MB/s), io=69.3MiB (72.6MB), run=2006-2006msec 00:23:55.854 WRITE: bw=34.6MiB/s (36.3MB/s), 34.6MiB/s-34.6MiB/s (36.3MB/s-36.3MB/s), io=69.4MiB (72.8MB), run=2006-2006msec 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:23:55.854 13:34:51 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:23:55.854 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:23:55.854 fio-3.35 00:23:55.854 Starting 1 thread 00:23:58.383 00:23:58.383 test: (groupid=0, jobs=1): err= 0: pid=707125: Mon Oct 7 13:34:53 2024 00:23:58.383 read: IOPS=8012, BW=125MiB/s (131MB/s)(251MiB/2006msec) 00:23:58.383 slat (usec): min=2, max=138, avg= 4.44, stdev= 2.63 00:23:58.383 clat (usec): min=2661, max=17229, avg=9031.26, stdev=2085.24 00:23:58.383 lat (usec): min=2665, max=17234, avg=9035.70, stdev=2085.24 00:23:58.383 clat percentiles (usec): 00:23:58.383 | 1.00th=[ 5014], 5.00th=[ 5866], 10.00th=[ 6390], 20.00th=[ 7242], 00:23:58.383 | 30.00th=[ 7832], 40.00th=[ 8356], 50.00th=[ 8848], 60.00th=[ 9503], 00:23:58.383 | 70.00th=[10028], 80.00th=[10552], 90.00th=[11731], 95.00th=[12911], 00:23:58.383 | 99.00th=[14746], 99.50th=[15270], 99.90th=[16581], 99.95th=[16909], 00:23:58.383 | 99.99th=[17171] 00:23:58.383 bw ( KiB/s): min=61184, max=76896, per=52.78%, avg=67668.75, stdev=7414.59, samples=4 00:23:58.383 iops : min= 3824, max= 4806, avg=4229.25, stdev=463.39, samples=4 00:23:58.383 write: IOPS=4782, BW=74.7MiB/s (78.4MB/s)(139MiB/1860msec); 0 zone resets 00:23:58.383 slat (usec): min=30, max=158, avg=37.68, stdev= 6.30 00:23:58.383 clat (usec): min=3303, max=18726, avg=11974.29, stdev=1938.57 00:23:58.383 lat (usec): min=3338, max=18760, avg=12011.98, stdev=1938.21 00:23:58.383 clat percentiles (usec): 00:23:58.383 | 1.00th=[ 8455], 5.00th=[ 9241], 10.00th=[ 9634], 20.00th=[10290], 00:23:58.383 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11731], 60.00th=[12256], 00:23:58.383 | 70.00th=[12780], 80.00th=[13566], 90.00th=[14746], 95.00th=[15533], 00:23:58.383 | 99.00th=[16909], 99.50th=[17433], 99.90th=[18220], 99.95th=[18482], 00:23:58.383 | 99.99th=[18744] 00:23:58.383 bw ( KiB/s): min=63936, max=80672, per=92.32%, avg=70643.00, stdev=8040.65, samples=4 00:23:58.383 iops : min= 3996, max= 5042, avg=4415.00, stdev=502.45, samples=4 00:23:58.383 lat (msec) : 4=0.20%, 10=49.27%, 20=50.53% 00:23:58.383 cpu : usr=81.00%, sys=18.10%, ctx=31, majf=0, minf=63 00:23:58.383 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:58.383 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:58.383 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:58.383 issued rwts: total=16074,8895,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:58.383 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:58.383 00:23:58.383 Run status group 0 (all jobs): 00:23:58.383 READ: bw=125MiB/s (131MB/s), 125MiB/s-125MiB/s (131MB/s-131MB/s), io=251MiB (263MB), run=2006-2006msec 00:23:58.383 WRITE: bw=74.7MiB/s (78.4MB/s), 74.7MiB/s-74.7MiB/s (78.4MB/s-78.4MB/s), io=139MiB (146MB), run=1860-1860msec 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@49 -- # '[' 0 -eq 1 ']' 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@86 -- # nvmftestfini 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@514 -- # nvmfcleanup 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@121 -- # sync 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@124 -- # set +e 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@125 -- # for i in {1..20} 00:23:58.383 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:23:58.383 rmmod nvme_tcp 00:23:58.644 rmmod nvme_fabrics 00:23:58.644 rmmod nvme_keyring 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@128 -- # set -e 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@129 -- # return 0 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@515 -- # '[' -n 706425 ']' 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@516 -- # killprocess 706425 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@950 -- # '[' -z 706425 ']' 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@954 -- # kill -0 706425 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # uname 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 706425 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@968 -- # echo 'killing process with pid 706425' 00:23:58.644 killing process with pid 706425 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@969 -- # kill 706425 00:23:58.644 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@974 -- # wait 706425 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@297 -- # iptr 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-save 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-restore 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@302 -- # remove_spdk_ns 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:23:58.903 13:34:54 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:00.810 13:34:56 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:24:01.069 00:24:01.069 real 0m12.400s 00:24:01.069 user 0m36.738s 00:24:01.069 sys 0m3.848s 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1126 -- # xtrace_disable 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:24:01.069 ************************************ 00:24:01.069 END TEST nvmf_fio_host 00:24:01.069 ************************************ 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@25 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:24:01.069 ************************************ 00:24:01.069 START TEST nvmf_failover 00:24:01.069 ************************************ 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:01.069 * Looking for test storage... 00:24:01.069 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lcov --version 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@333 -- # local ver1 ver1_l 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@334 -- # local ver2 ver2_l 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # IFS=.-: 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # read -ra ver1 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # IFS=.-: 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # read -ra ver2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@338 -- # local 'op=<' 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@340 -- # ver1_l=2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@341 -- # ver2_l=1 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@344 -- # case "$op" in 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@345 -- # : 1 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v = 0 )) 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # decimal 1 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=1 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 1 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # ver1[v]=1 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # decimal 2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # ver2[v]=2 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # return 0 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:24:01.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:01.069 --rc genhtml_branch_coverage=1 00:24:01.069 --rc genhtml_function_coverage=1 00:24:01.069 --rc genhtml_legend=1 00:24:01.069 --rc geninfo_all_blocks=1 00:24:01.069 --rc geninfo_unexecuted_blocks=1 00:24:01.069 00:24:01.069 ' 00:24:01.069 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:24:01.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:01.070 --rc genhtml_branch_coverage=1 00:24:01.070 --rc genhtml_function_coverage=1 00:24:01.070 --rc genhtml_legend=1 00:24:01.070 --rc geninfo_all_blocks=1 00:24:01.070 --rc geninfo_unexecuted_blocks=1 00:24:01.070 00:24:01.070 ' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:24:01.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:01.070 --rc genhtml_branch_coverage=1 00:24:01.070 --rc genhtml_function_coverage=1 00:24:01.070 --rc genhtml_legend=1 00:24:01.070 --rc geninfo_all_blocks=1 00:24:01.070 --rc geninfo_unexecuted_blocks=1 00:24:01.070 00:24:01.070 ' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:24:01.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:01.070 --rc genhtml_branch_coverage=1 00:24:01.070 --rc genhtml_function_coverage=1 00:24:01.070 --rc genhtml_legend=1 00:24:01.070 --rc geninfo_all_blocks=1 00:24:01.070 --rc geninfo_unexecuted_blocks=1 00:24:01.070 00:24:01.070 ' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # uname -s 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:cd6acfbe-4794-e311-a299-001e67a97b02 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@18 -- # NVME_HOSTID=cd6acfbe-4794-e311-a299-001e67a97b02 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@15 -- # shopt -s extglob 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@5 -- # export PATH 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@51 -- # : 0 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:24:01.070 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@55 -- # have_pci_nics=0 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@18 -- # nvmftestinit 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@474 -- # prepare_net_devs 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@436 -- # local -g is_hw=no 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@438 -- # remove_spdk_ns 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@440 -- # [[ phy != virt ]] 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@440 -- # gather_supported_nvmf_pci_devs 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@309 -- # xtrace_disable 00:24:01.070 13:34:56 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@313 -- # local intel=0x8086 mellanox=0x15b3 pci net_dev 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@315 -- # pci_devs=() 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@315 -- # local -a pci_devs 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@316 -- # pci_net_devs=() 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@316 -- # local -a pci_net_devs 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@317 -- # pci_drivers=() 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@317 -- # local -A pci_drivers 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@319 -- # net_devs=() 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@319 -- # local -ga net_devs 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@320 -- # e810=() 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@320 -- # local -ga e810 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@321 -- # x722=() 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@321 -- # local -ga x722 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@322 -- # mlx=() 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@322 -- # local -ga mlx 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@325 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@326 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@328 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@330 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@332 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@334 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@336 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@338 -- # mlx+=(${pci_bus_cache["$mellanox:0x101b"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@340 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@341 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@343 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@344 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@346 -- # pci_devs+=("${e810[@]}") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@347 -- # [[ tcp == rdma ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@353 -- # [[ e810 == mlx5 ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@355 -- # [[ e810 == e810 ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@356 -- # pci_devs=("${e810[@]}") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@361 -- # (( 2 == 0 )) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.0 (0x8086 - 0x159b)' 00:24:03.603 Found 0000:84:00.0 (0x8086 - 0x159b) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@366 -- # for pci in "${pci_devs[@]}" 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@367 -- # echo 'Found 0000:84:00.1 (0x8086 - 0x159b)' 00:24:03.603 Found 0000:84:00.1 (0x8086 - 0x159b) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@368 -- # [[ ice == unknown ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@372 -- # [[ ice == unbound ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@376 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@377 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@378 -- # [[ tcp == rdma ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@392 -- # (( 0 > 0 )) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@398 -- # [[ e810 == e810 ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@398 -- # [[ tcp == rdma ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@416 -- # [[ up == up ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.0: cvl_0_0' 00:24:03.603 Found net devices under 0000:84:00.0: cvl_0_0 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@408 -- # for pci in "${pci_devs[@]}" 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@409 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@414 -- # [[ tcp == tcp ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@415 -- # for net_dev in "${!pci_net_devs[@]}" 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@416 -- # [[ up == up ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@420 -- # (( 1 == 0 )) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@425 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@426 -- # echo 'Found net devices under 0000:84:00.1: cvl_0_1' 00:24:03.603 Found net devices under 0000:84:00.1: cvl_0_1 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@427 -- # net_devs+=("${pci_net_devs[@]}") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@430 -- # (( 2 == 0 )) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@440 -- # is_hw=yes 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@442 -- # [[ yes == yes ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@443 -- # [[ tcp == tcp ]] 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@444 -- # nvmf_tcp_init 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@250 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@251 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@252 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@253 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@256 -- # (( 2 > 1 )) 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@258 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@259 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@262 -- # NVMF_SECOND_TARGET_IP= 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@263 -- # NVMF_SECOND_INITIATOR_IP= 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@265 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@266 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@267 -- # ip -4 addr flush cvl_0_0 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@268 -- # ip -4 addr flush cvl_0_1 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@271 -- # ip netns add cvl_0_0_ns_spdk 00:24:03.603 13:34:58 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@274 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:03.603 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@277 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@278 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@281 -- # ip link set cvl_0_1 up 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@283 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@284 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@287 -- # ipts -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT' 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@290 -- # ping -c 1 10.0.0.2 00:24:03.604 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:03.604 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:24:03.604 00:24:03.604 --- 10.0.0.2 ping statistics --- 00:24:03.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:03.604 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@291 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:03.604 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:03.604 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:24:03.604 00:24:03.604 --- 10.0.0.1 ping statistics --- 00:24:03.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:03.604 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@293 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@448 -- # return 0 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@724 -- # xtrace_disable 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@507 -- # nvmfpid=709458 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@508 -- # waitforlisten 709458 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 709458 ']' 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@506 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:03.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:24:03.604 [2024-10-07 13:34:59.176174] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:24:03.604 [2024-10-07 13:34:59.176279] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:03.604 [2024-10-07 13:34:59.240966] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:03.604 [2024-10-07 13:34:59.352614] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:03.604 [2024-10-07 13:34:59.352687] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:03.604 [2024-10-07 13:34:59.352716] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:03.604 [2024-10-07 13:34:59.352728] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:03.604 [2024-10-07 13:34:59.352738] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:03.604 [2024-10-07 13:34:59.353775] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:24:03.604 [2024-10-07 13:34:59.353837] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:24:03.604 [2024-10-07 13:34:59.353840] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@730 -- # xtrace_disable 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:03.604 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:04.170 [2024-10-07 13:34:59.813720] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:04.170 13:34:59 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:24:04.427 Malloc0 00:24:04.427 13:35:00 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:04.685 13:35:00 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:04.943 13:35:00 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:05.202 [2024-10-07 13:35:00.993722] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:05.202 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:05.460 [2024-10-07 13:35:01.262443] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:05.460 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:24:05.718 [2024-10-07 13:35:01.535352] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:24:05.718 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@31 -- # bdevperf_pid=709749 00:24:05.718 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:24:05.718 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:05.718 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@34 -- # waitforlisten 709749 /var/tmp/bdevperf.sock 00:24:05.719 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 709749 ']' 00:24:05.719 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:05.719 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:24:05.719 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:05.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:05.719 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:24:05.719 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:24:05.976 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:24:05.976 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:24:05.976 13:35:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:24:06.543 NVMe0n1 00:24:06.543 13:35:02 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:24:06.801 NVMe0n1 00:24:06.801 13:35:02 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@39 -- # run_test_pid=709889 00:24:06.801 13:35:02 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:24:06.801 13:35:02 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@41 -- # sleep 1 00:24:07.735 13:35:03 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:07.994 [2024-10-07 13:35:03.919275] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919355] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919386] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919398] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919411] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919423] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919435] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919447] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919459] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919505] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919519] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919541] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919553] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919566] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919578] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919590] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919602] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919614] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919626] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919656] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919669] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919680] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919703] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919715] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919727] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919738] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919750] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919761] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919782] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919809] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919820] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919832] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919843] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919855] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.994 [2024-10-07 13:35:03.919868] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919880] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919891] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919903] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919915] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919927] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919939] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919953] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919964] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919976] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919988] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.919999] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920024] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920036] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920047] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920059] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920081] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920092] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920104] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920115] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920127] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920139] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920150] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920161] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920173] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920185] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920196] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920208] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920220] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920232] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920244] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920256] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920268] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920280] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920292] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920303] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920315] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920330] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920342] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920353] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920368] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920381] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920395] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920407] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920418] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920430] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920442] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920460] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920494] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920508] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920524] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920537] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920549] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920560] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920572] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920584] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920595] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920607] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920619] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920631] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920643] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920655] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920667] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920679] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920691] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920703] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920715] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920731] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920750] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920762] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920790] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920802] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920823] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920835] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920846] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920857] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920869] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920880] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920892] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920903] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:07.995 [2024-10-07 13:35:03.920915] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe221d0 is same with the state(6) to be set 00:24:08.252 13:35:03 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@45 -- # sleep 3 00:24:11.543 13:35:06 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:24:11.801 NVMe0n1 00:24:11.801 13:35:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:12.060 [2024-10-07 13:35:07.784081] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784136] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784167] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784191] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784203] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784216] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784227] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784239] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784250] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784269] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784281] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784293] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784305] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784316] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784327] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.060 [2024-10-07 13:35:07.784340] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784351] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784362] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784373] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784384] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784396] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784407] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784418] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784430] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784441] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784453] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784481] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 [2024-10-07 13:35:07.784504] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe226a0 is same with the state(6) to be set 00:24:12.061 13:35:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@50 -- # sleep 3 00:24:15.351 13:35:10 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:15.351 [2024-10-07 13:35:11.091831] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:15.352 13:35:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@55 -- # sleep 1 00:24:16.288 13:35:12 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:24:16.548 13:35:12 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@59 -- # wait 709889 00:24:23.163 { 00:24:23.163 "results": [ 00:24:23.163 { 00:24:23.163 "job": "NVMe0n1", 00:24:23.163 "core_mask": "0x1", 00:24:23.163 "workload": "verify", 00:24:23.163 "status": "finished", 00:24:23.163 "verify_range": { 00:24:23.163 "start": 0, 00:24:23.163 "length": 16384 00:24:23.163 }, 00:24:23.163 "queue_depth": 128, 00:24:23.163 "io_size": 4096, 00:24:23.163 "runtime": 15.01172, 00:24:23.163 "iops": 8614.5358426616, 00:24:23.163 "mibps": 33.650530635396876, 00:24:23.163 "io_failed": 0, 00:24:23.163 "io_timeout": 0, 00:24:23.163 "avg_latency_us": 14831.427280400205, 00:24:23.163 "min_latency_us": 2791.348148148148, 00:24:23.163 "max_latency_us": 31068.91851851852 00:24:23.163 } 00:24:23.163 ], 00:24:23.163 "core_count": 1 00:24:23.163 } 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@61 -- # killprocess 709749 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 709749 ']' 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 709749 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 709749 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 709749' 00:24:23.163 killing process with pid 709749 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 709749 00:24:23.163 13:35:17 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 709749 00:24:23.163 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:23.163 [2024-10-07 13:35:01.601595] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:24:23.163 [2024-10-07 13:35:01.601678] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid709749 ] 00:24:23.163 [2024-10-07 13:35:01.660439] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:23.163 [2024-10-07 13:35:01.769559] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:24:23.163 Running I/O for 15 seconds... 00:24:23.163 8672.00 IOPS, 33.88 MiB/s [2024-10-07T11:35:19.096Z] [2024-10-07 13:35:03.921642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:81344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:81352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:81360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:81368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:81376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:81384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:81392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:81400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:81408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.921976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:81416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.921990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:81424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:81432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:81440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:81448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:81456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:81464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:81472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:81480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:81488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:81496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:81504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:81512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.163 [2024-10-07 13:35:03.922361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:81520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.163 [2024-10-07 13:35:03.922375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:81528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:81536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:81544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:81552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:81560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:81568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:81576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:81584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:81592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:81600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:81608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:81616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:81624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:81632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:81640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:81648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:81656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:81664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:81672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.922984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.922999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:81680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:81688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:81696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:81704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:81712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:81720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:81728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:81736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:81744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:81752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:81760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:81768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:81776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:81784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:81792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:81800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:81808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:81816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.164 [2024-10-07 13:35:03.923571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.164 [2024-10-07 13:35:03.923587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:81824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.165 [2024-10-07 13:35:03.923601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:81832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.165 [2024-10-07 13:35:03.923635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:81840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.165 [2024-10-07 13:35:03.923665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:81848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.165 [2024-10-07 13:35:03.923694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:81856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:81864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:81872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:81880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:81888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:81896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:81904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:81912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:81920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.923980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.923995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:81928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:81936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:81944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:81952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:81960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:81968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:81976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:81984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:81992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:82000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:82008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:82016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:82024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:82032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:82040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:82048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:82056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:82064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:82072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:82080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:82088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:82096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:82104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:82112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:82120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:82128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:82136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:82144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.165 [2024-10-07 13:35:03.924852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.165 [2024-10-07 13:35:03.924873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:82152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.924887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.924902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:82160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.924915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.924931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:82168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.924944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.924959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:82176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.924972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.924987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:82184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.925001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:82192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.925030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:82200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.925059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:82208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.925087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:82216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.925116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:82224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.925146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:82232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.166 [2024-10-07 13:35:03.925175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925210] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82240 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925258] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925271] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82248 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925308] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925318] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82256 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925369] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925380] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82264 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925416] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925427] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82272 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925464] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925474] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82280 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925522] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925532] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82288 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925568] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925580] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82296 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925620] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925631] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82304 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925668] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925681] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82312 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925717] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925727] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82320 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925769] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925780] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82328 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925817] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925828] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82336 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925869] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925879] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.166 [2024-10-07 13:35:03.925891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82344 len:8 PRP1 0x0 PRP2 0x0 00:24:23.166 [2024-10-07 13:35:03.925903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.166 [2024-10-07 13:35:03.925916] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.166 [2024-10-07 13:35:03.925927] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.167 [2024-10-07 13:35:03.925937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82352 len:8 PRP1 0x0 PRP2 0x0 00:24:23.167 [2024-10-07 13:35:03.925950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.167 [2024-10-07 13:35:03.925967] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.167 [2024-10-07 13:35:03.925978] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.167 [2024-10-07 13:35:03.925992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82360 len:8 PRP1 0x0 PRP2 0x0 00:24:23.167 [2024-10-07 13:35:03.926005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.167 [2024-10-07 13:35:03.926063] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x6964d0 was disconnected and freed. reset controller. 00:24:23.167 [2024-10-07 13:35:03.926150] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.167 [2024-10-07 13:35:03.926172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.167 [2024-10-07 13:35:03.926192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.167 [2024-10-07 13:35:03.926205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.167 [2024-10-07 13:35:03.926219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.167 [2024-10-07 13:35:03.926231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.167 [2024-10-07 13:35:03.926255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.167 [2024-10-07 13:35:03.926268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.167 [2024-10-07 13:35:03.926281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.167 [2024-10-07 13:35:03.927524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.167 [2024-10-07 13:35:03.927563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.167 [2024-10-07 13:35:03.927765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.167 [2024-10-07 13:35:03.927794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.167 [2024-10-07 13:35:03.927810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.167 [2024-10-07 13:35:03.927836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.167 [2024-10-07 13:35:03.927860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.167 [2024-10-07 13:35:03.927875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.167 [2024-10-07 13:35:03.927891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.167 [2024-10-07 13:35:03.927917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.167 [2024-10-07 13:35:03.937863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.167 [2024-10-07 13:35:03.938038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.167 [2024-10-07 13:35:03.938069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.167 [2024-10-07 13:35:03.938086] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.167 [2024-10-07 13:35:03.938111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.167 [2024-10-07 13:35:03.938135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.167 [2024-10-07 13:35:03.938156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.167 [2024-10-07 13:35:03.938169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.167 [2024-10-07 13:35:03.938194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.167 [2024-10-07 13:35:03.948019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.167 [2024-10-07 13:35:03.948252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.167 [2024-10-07 13:35:03.948282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.167 [2024-10-07 13:35:03.948298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.167 [2024-10-07 13:35:03.948323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.167 [2024-10-07 13:35:03.948528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.167 [2024-10-07 13:35:03.948551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.167 [2024-10-07 13:35:03.948565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.167 [2024-10-07 13:35:03.948638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.167 [2024-10-07 13:35:03.959462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.167 [2024-10-07 13:35:03.959745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.167 [2024-10-07 13:35:03.959790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.167 [2024-10-07 13:35:03.959807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.167 [2024-10-07 13:35:03.959922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.167 [2024-10-07 13:35:03.961828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.167 [2024-10-07 13:35:03.961867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.167 [2024-10-07 13:35:03.961880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.167 [2024-10-07 13:35:03.962708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.167 [2024-10-07 13:35:03.969576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.167 [2024-10-07 13:35:03.969815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.167 [2024-10-07 13:35:03.969843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.167 [2024-10-07 13:35:03.969859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.167 [2024-10-07 13:35:03.969883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.167 [2024-10-07 13:35:03.969918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.167 [2024-10-07 13:35:03.969935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.167 [2024-10-07 13:35:03.969947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.167 [2024-10-07 13:35:03.969971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.167 [2024-10-07 13:35:03.979675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.167 [2024-10-07 13:35:03.979862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.167 [2024-10-07 13:35:03.979892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.167 [2024-10-07 13:35:03.979908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.167 [2024-10-07 13:35:03.979932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.167 [2024-10-07 13:35:03.979955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.167 [2024-10-07 13:35:03.979969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.167 [2024-10-07 13:35:03.979982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.167 [2024-10-07 13:35:03.980006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:03.993333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:03.993525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:03.993556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:03.993573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:03.993599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:03.993623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:03.993638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:03.993651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:03.993675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.004799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.005053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.005083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.005100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.005208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.005320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.005340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.005353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.008275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.014898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.015174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.015202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.015218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.015248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.015271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.015286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.015298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.015322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.024995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.025205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.025234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.025250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.025274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.025956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.025986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.026015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.026532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.036816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.038658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.038690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.038708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.039340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.039626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.039650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.039664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.039896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.046900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.047179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.047207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.047223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.047247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.047270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.047285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.047303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.047327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.057015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.057201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.057230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.057247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.057425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.057497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.057534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.057548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.057574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.070317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.070715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.070746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.070763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.070828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.070862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.070877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.070889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.070913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.085094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.085236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.085265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.085282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.085306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.085330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.085344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.085357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.085381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.095806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.168 [2024-10-07 13:35:04.099966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.168 [2024-10-07 13:35:04.100016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.168 [2024-10-07 13:35:04.100034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.168 [2024-10-07 13:35:04.100105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.168 [2024-10-07 13:35:04.100133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.168 [2024-10-07 13:35:04.100148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.168 [2024-10-07 13:35:04.100160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.168 [2024-10-07 13:35:04.100184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.168 [2024-10-07 13:35:04.106960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.107297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.107327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.107343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.107511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.107642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.107665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.107679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.107790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.117129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.117332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.117362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.117378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.117867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.118103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.118126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.118140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.118190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.129270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.129440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.129469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.129493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.129536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.129565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.129580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.129593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.129618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.142924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.145223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.145268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.145286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.146118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.146864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.146887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.146915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.147150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.153021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.153299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.153327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.153343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.153368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.153391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.153405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.153417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.153441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.163117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.163382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.163411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.163428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.163639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.163703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.163729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.163743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.163768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.176558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.176980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.177022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.177039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.177292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.177353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.177373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.177388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.177413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.191631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.191786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.191817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.191834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.191860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.191885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.191900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.191913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.191937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.202389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.205132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.205177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.205196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.206734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.206842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.206863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.206877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.206902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.214544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.214953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.214982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.169 [2024-10-07 13:35:04.215017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.169 [2024-10-07 13:35:04.215128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.169 [2024-10-07 13:35:04.215238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.169 [2024-10-07 13:35:04.215259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.169 [2024-10-07 13:35:04.215272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.169 [2024-10-07 13:35:04.215379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.169 [2024-10-07 13:35:04.224806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.169 [2024-10-07 13:35:04.224963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.169 [2024-10-07 13:35:04.224997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.225014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.225038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.225062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.225076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.225089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.225113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.235740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.235999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.236030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.236046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.236260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.236319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.236339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.236353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.236377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.248094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.248425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.248456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.248494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.248609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.248800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.248828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.248843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.248908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.258553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.258884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.258914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.258932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.259039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.259150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.259170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.259183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.262727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.268661] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.268927] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.268955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.268972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.268996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.269019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.269033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.269046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.269069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.279093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.279248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.279277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.279294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.279318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.279340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.279354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.279367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.279390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.290866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.291111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.291141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.291158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.291267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.291391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.291413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.291429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.291562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.301446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.301651] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.301681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.301698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.301723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.301747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.301761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.301789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.301814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.311677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.311859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.311889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.311905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.312083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.312151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.312171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.312184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.312208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.324562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.324978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.325007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.325037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.325240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.170 [2024-10-07 13:35:04.325296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.170 [2024-10-07 13:35:04.325315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.170 [2024-10-07 13:35:04.325328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.170 [2024-10-07 13:35:04.325353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.170 [2024-10-07 13:35:04.336705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.170 [2024-10-07 13:35:04.338763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.170 [2024-10-07 13:35:04.338811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.170 [2024-10-07 13:35:04.338828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.170 [2024-10-07 13:35:04.339529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.339987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.340018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.340047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.340261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.346824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.347046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.347075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.347091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.347114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.347138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.347159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.347172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.347196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.356914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.357108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.357137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.357155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.357179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.357202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.357217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.357235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.357261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.368619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.368985] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.369029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.369045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.369108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.369135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.369150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.369163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.369350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.380870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.381172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.381202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.381218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.384087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.384640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.384665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.384694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.384913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.392724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.392928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.392957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.392973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.393721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.393927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.393949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.393963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.398084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.402823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.403045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.403079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.403095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.403120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.403143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.403157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.403170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.403193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.413536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.413731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.413761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.413794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.413971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.414026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.414046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.414059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.414083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.425635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.425808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.425853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.425870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.425894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.425917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.425931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.425944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.425967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.438420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.438688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.438719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.438737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.438859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.438994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.439015] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.439028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.442711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.448826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.449121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.449151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.171 [2024-10-07 13:35:04.449168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.171 [2024-10-07 13:35:04.449504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.171 [2024-10-07 13:35:04.449654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.171 [2024-10-07 13:35:04.449676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.171 [2024-10-07 13:35:04.449690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.171 [2024-10-07 13:35:04.449728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.171 [2024-10-07 13:35:04.459014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.171 [2024-10-07 13:35:04.459223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.171 [2024-10-07 13:35:04.459252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.459268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.459292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.459493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.459516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.459532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.459584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.472655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.473086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.473115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.473131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.473196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.473223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.473237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.473249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.473283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.486719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.487404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.487447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.487465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.487708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.487765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.487786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.487800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.488001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.501348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.501562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.501594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.501611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.501636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.501660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.501675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.501688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.501713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.512567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.512871] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.512901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.512918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.513060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.513204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.513226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.513240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.513351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.523266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.524186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.524230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.524253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.524279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.524303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.524317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.524330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.524354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.533370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.533571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.533602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.533620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.533818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.533875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.533894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.533908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.533933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.545636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.545824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.545853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.545870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.545894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.545918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.545933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.545946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.545970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.556860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.557223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.557253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.557270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.172 [2024-10-07 13:35:04.557410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.172 [2024-10-07 13:35:04.557566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.172 [2024-10-07 13:35:04.557595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.172 [2024-10-07 13:35:04.557610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.172 [2024-10-07 13:35:04.557740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.172 [2024-10-07 13:35:04.566958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.172 [2024-10-07 13:35:04.567207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.172 [2024-10-07 13:35:04.567235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.172 [2024-10-07 13:35:04.567252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.567437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.567684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.567719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.567733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.567874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.577077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.577318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.577347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.577364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.577388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.577411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.577426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.577439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.577477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.587408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.587820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.587850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.587867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.587977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.588093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.588114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.588127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.591351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.597967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.598237] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.598266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.598283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.598390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.598526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.598549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.598563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.598674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.608071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.608292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.608321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.608338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.608548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.608607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.608628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.608642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.608666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.620732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.620890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.620919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.620936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.620960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.620984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.620999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.621012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.621035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.630817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.631061] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.631091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.631109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.632115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.632308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.632331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.632345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.632456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.640914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.641172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.641200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.641217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.641241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.641264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.641279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.641292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.641316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.651927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.652103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.652132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.652149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.652173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.652196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.652211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.652225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.652249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.666377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.666728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.666759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.666791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.666816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.666839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.666854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.666872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.666896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.173 [2024-10-07 13:35:04.680808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.173 [2024-10-07 13:35:04.681026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.173 [2024-10-07 13:35:04.681055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.173 [2024-10-07 13:35:04.681072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.173 [2024-10-07 13:35:04.681096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.173 [2024-10-07 13:35:04.681119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.173 [2024-10-07 13:35:04.681133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.173 [2024-10-07 13:35:04.681145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.173 [2024-10-07 13:35:04.681169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.692887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.694832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.694868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.694887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.697028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.697757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.697786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.697801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.698229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.703208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.703383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.703411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.703428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.703898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.703962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.703982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.703995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.704020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.713305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.713443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.713500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.713521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.713714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.713771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.713807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.713820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.713845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.726427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.726786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.726828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.726871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.727086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.727142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.727162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.727176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.727201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.736876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.740754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.740800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.740816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.741718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.742002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.742026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.742039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.742091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.747103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.747369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.747398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.747414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.747438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 8594.50 IOPS, 33.57 MiB/s [2024-10-07T11:35:19.107Z] [2024-10-07 13:35:04.751107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.751128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.751166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.752092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.757296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.757574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.757604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.757621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.757819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.757879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.757899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.757912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.757937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.767608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.767856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.767887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.767903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.771721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.772062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.772086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.772101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.772347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.777695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.777898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.777927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.777944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.777969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.777992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.778007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.778021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.778052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.787807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.787984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.788013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.788030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.788054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.174 [2024-10-07 13:35:04.788077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.174 [2024-10-07 13:35:04.788092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.174 [2024-10-07 13:35:04.788105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.174 [2024-10-07 13:35:04.788129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.174 [2024-10-07 13:35:04.801146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.174 [2024-10-07 13:35:04.801417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.174 [2024-10-07 13:35:04.801446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.174 [2024-10-07 13:35:04.801463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.174 [2024-10-07 13:35:04.801512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.801543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.801558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.801571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.801596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.811619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.811943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.811978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.811995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.812103] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.812215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.812235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.812248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.812357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.821705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.822372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.822414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.822437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.823101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.823147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.823164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.823177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.823200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.831817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.832062] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.832090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.832106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.832130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.832153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.832167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.832180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.832204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.846412] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.846672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.846701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.846718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.846742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.846766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.846781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.846794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.846834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.860322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.860543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.860574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.860592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.860618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.860656] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.860680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.860694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.860720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.873848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.874288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.874331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.874349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.874576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.874634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.874654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.874668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.874693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.888676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.888877] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.888906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.888922] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.888946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.888969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.888983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.888996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.889019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.898775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.899061] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.899090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.899106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.900099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.900293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.900315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.900329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.900449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.908873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.909147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.909177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.175 [2024-10-07 13:35:04.909193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.175 [2024-10-07 13:35:04.909217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.175 [2024-10-07 13:35:04.909240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.175 [2024-10-07 13:35:04.909254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.175 [2024-10-07 13:35:04.909267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.175 [2024-10-07 13:35:04.909290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.175 [2024-10-07 13:35:04.920425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.175 [2024-10-07 13:35:04.920648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.175 [2024-10-07 13:35:04.920678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:04.920695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:04.920721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:04.920744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:04.920759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:04.920772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:04.920796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:04.934309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:04.934538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:04.934568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:04.934585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:04.934610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:04.934635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:04.934651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:04.934664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:04.934688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:04.944599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:04.944860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:04.944890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:04.944907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:04.945197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:04.948025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:04.948051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:04.948082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:04.951641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:04.954686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:04.955110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:04.955155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:04.955171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:04.955237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:04.955421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:04.955444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:04.955459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:04.955519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:04.967853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:04.968120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:04.968149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:04.968166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:04.968190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:04.968213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:04.968228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:04.968241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:04.968264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:04.977951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:04.978229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:04.978259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:04.978285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:04.978310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:04.978334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:04.978349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:04.978368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:04.978409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:04.988048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:04.988265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:04.988295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:04.988312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:04.988515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:04.988573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:04.988594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:04.988608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:04.988633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:05.000329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:05.000821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:05.000865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:05.000882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:05.001200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:05.001264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:05.001284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:05.001297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:05.001322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:05.011899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:05.012171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:05.012200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:05.012217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:05.012333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:05.015876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:05.015901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.176 [2024-10-07 13:35:05.015931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.176 [2024-10-07 13:35:05.016569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.176 [2024-10-07 13:35:05.021997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.176 [2024-10-07 13:35:05.022244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.176 [2024-10-07 13:35:05.022277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.176 [2024-10-07 13:35:05.022294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.176 [2024-10-07 13:35:05.022437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.176 [2024-10-07 13:35:05.022603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.176 [2024-10-07 13:35:05.022627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.022642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.022756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.032093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.032320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.032350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.032366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.032390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.032413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.032428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.032440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.032480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.044751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.045172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.045202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.045234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.045434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.045671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.045695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.045709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.045763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.059834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.060085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.060114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.060131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.060155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.060189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.060204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.060217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.060256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.069932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.070204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.070232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.070248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.072807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.076151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.076177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.076206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.076739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.080026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.080249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.080277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.080294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.080318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.080341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.080355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.080367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.080391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.091594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.091872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.091901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.091918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.091942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.091965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.091979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.091992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.092021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.101695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.101934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.101963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.101980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.102004] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.102027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.102041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.102053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.102076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.111798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.112214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.112242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.112258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.112322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.112348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.112362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.112374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.112398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.124419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.124871] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.124901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.124918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.125137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.125195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.177 [2024-10-07 13:35:05.125215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.177 [2024-10-07 13:35:05.125229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.177 [2024-10-07 13:35:05.125424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.177 [2024-10-07 13:35:05.140076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.177 [2024-10-07 13:35:05.140260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.177 [2024-10-07 13:35:05.140289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.177 [2024-10-07 13:35:05.140310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.177 [2024-10-07 13:35:05.140336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.177 [2024-10-07 13:35:05.140359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.140373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.140386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.140409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.155057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.155280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.155310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.155326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.155350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.155374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.155388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.155401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.155425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.170762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.171791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.171820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.171851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.172430] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.172904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.172941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.172955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.173190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.182606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.182914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.182944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.182961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.183071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.185459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.185509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.185524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.186625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.192691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.192951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.192980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.192996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.193021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.193044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.193059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.193071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.193094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.202808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.203077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.203107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.203124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.203436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.203607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.203630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.203644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.203684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.216478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.216934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.216980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.216998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.217229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.217287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.217308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.217322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.217347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.232011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.232270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.232300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.232317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.232341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.232364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.232379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.232391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.232415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.242961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.243321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.243351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.243368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.243509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.243629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.243649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.243664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.243791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.253058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.253328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.253357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.253374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.253398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.253421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.253436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.253448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.253495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.263155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.263388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.263417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.263433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.178 [2024-10-07 13:35:05.263463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.178 [2024-10-07 13:35:05.263516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.178 [2024-10-07 13:35:05.263532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.178 [2024-10-07 13:35:05.263545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.178 [2024-10-07 13:35:05.263570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.178 [2024-10-07 13:35:05.274341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.178 [2024-10-07 13:35:05.274679] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.178 [2024-10-07 13:35:05.274709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.178 [2024-10-07 13:35:05.274727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.274859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.274976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.274997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.275010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.275121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.284835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.285137] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.285166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.285183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.285293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.285406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.285427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.285440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.285576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.295100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.295362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.295392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.295408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.295616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.295674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.295695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.295714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.295740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.308120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.308319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.308349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.308365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.308389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.308412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.308427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.308439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.308479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.319229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.319573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.319605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.319622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.319736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.319867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.319888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.319901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.324156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.329326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.329608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.329638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.329655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.329680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.329704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.329718] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.329732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.329756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.339423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.339709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.339740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.339757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.339796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.339820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.339835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.339847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.339870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.354194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.354447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.354500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.354519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.354545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.354569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.354584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.354597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.354622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.367221] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.369261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.369304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.369321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.369399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.369441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.369460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.369498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.369527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.377320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.377519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.377549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.179 [2024-10-07 13:35:05.377566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.179 [2024-10-07 13:35:05.377591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.179 [2024-10-07 13:35:05.377620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.179 [2024-10-07 13:35:05.377637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.179 [2024-10-07 13:35:05.377650] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.179 [2024-10-07 13:35:05.377675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.179 [2024-10-07 13:35:05.387446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.179 [2024-10-07 13:35:05.387625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.179 [2024-10-07 13:35:05.387655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.387673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.387698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.387722] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.387737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.387750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.387775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.399711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.400120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.400150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.400167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.400380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.400450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.400495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.400513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.400539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.411620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.413933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.413977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.413994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.414822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.415085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.415108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.415122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.415344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.421721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.421901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.421930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.421947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.421971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.421995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.422009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.422022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.422046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.432146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.432292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.432321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.432338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.432374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.432400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.432415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.432428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.432452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.444333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.444526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.444556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.444573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.444599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.444623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.444638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.444652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.444677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.458005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.458195] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.458225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.458248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.458274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.458299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.458314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.458328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.458352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.469159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.469389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.469419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.469436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.469580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.469704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.469725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.469739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.469865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.479256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.479480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.479518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.479536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.479561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.479585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.479600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.479613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.479637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.490608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.490846] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.490876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.490893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.491070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.491126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.491151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.491166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.491191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.180 [2024-10-07 13:35:05.504493] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.180 [2024-10-07 13:35:05.504629] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.180 [2024-10-07 13:35:05.504658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.180 [2024-10-07 13:35:05.504675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.180 [2024-10-07 13:35:05.504700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.180 [2024-10-07 13:35:05.504725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.180 [2024-10-07 13:35:05.504740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.180 [2024-10-07 13:35:05.504754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.180 [2024-10-07 13:35:05.504810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.516998] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.517255] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.517285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.517302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.517413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.517554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.517577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.517592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.517702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.527353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.527613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.527644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.527662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.528145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.528215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.528234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.528247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.528272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.537454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.537622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.537653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.537671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.537867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.537924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.537944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.537958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.537982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.550393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.551066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.551095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.551127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.551348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.551580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.551604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.551618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.551685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.565023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.565198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.565244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.565262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.565287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.565311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.565326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.565339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.565363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.575119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.575293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.575322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.575338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.576401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.576604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.576628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.576643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.576756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.585218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.585421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.585451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.585468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.585503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.585542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.585560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.585574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.585599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.596957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.597320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.597350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.597367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.597417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.597627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.597651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.181 [2024-10-07 13:35:05.597665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.181 [2024-10-07 13:35:05.597717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.181 [2024-10-07 13:35:05.611716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.181 [2024-10-07 13:35:05.611914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.181 [2024-10-07 13:35:05.611944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.181 [2024-10-07 13:35:05.611961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.181 [2024-10-07 13:35:05.611986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.181 [2024-10-07 13:35:05.612009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.181 [2024-10-07 13:35:05.612024] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.612042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.612067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.623194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.625480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.625534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.625551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.627087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.627501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.627525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.627540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.628030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.633550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.634182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.634225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.634242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.634357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.634387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.634402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.634415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.634439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.643648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.643833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.643862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.643879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.643903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.643926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.643941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.643954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.643978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.656064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.656416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.656446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.656463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.656538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.656566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.656581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.656595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.656778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.670278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.670427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.670456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.670472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.670520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.670546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.670561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.670574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.670598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.686153] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.686550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.686596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.686613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.686846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.686902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.686922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.686935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.687112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.701240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.701452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.701504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.701523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.701548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.701578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.701594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.701606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.701632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.715297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.715503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.715534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.715551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.715577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.715601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.715616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.715630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.715656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.726090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.726346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.726376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.726393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.726528] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.726688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.726712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.726727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.726866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.736253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.736419] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.182 [2024-10-07 13:35:05.736447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.182 [2024-10-07 13:35:05.736464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.182 [2024-10-07 13:35:05.736513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.182 [2024-10-07 13:35:05.736538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.182 [2024-10-07 13:35:05.736553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.182 [2024-10-07 13:35:05.736566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.182 [2024-10-07 13:35:05.736596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.182 [2024-10-07 13:35:05.748174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.182 [2024-10-07 13:35:05.748344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.748373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.748389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.748414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.748437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.748452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.748480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.748516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 8573.00 IOPS, 33.49 MiB/s [2024-10-07T11:35:19.116Z] [2024-10-07 13:35:05.762163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.762360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.762390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.762406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.762431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.762455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.762494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.762511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.762536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.777744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.778119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.778163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.778180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.778391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.778632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.778658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.778672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.778725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.792199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.792376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.792409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.792426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.792450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.792498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.792515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.792529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.792554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.806798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.807013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.807043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.807060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.807084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.807107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.807122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.807135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.807158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.819540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.819837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.819866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.819884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.819991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.820100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.820120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.820134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.822900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.829641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.829839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.829867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.829884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.830017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.830147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.830169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.830183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.830291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.839725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.840037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.840067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.840084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.840133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.840160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.840175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.840187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.840364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.852915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.853077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.853105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.853122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.853147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.853171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.853186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.853199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.853223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.863387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.866112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.866157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.866175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.867711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.867801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.867835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.867849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.867874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.875356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.183 [2024-10-07 13:35:05.875611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.183 [2024-10-07 13:35:05.875651] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.183 [2024-10-07 13:35:05.875668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.183 [2024-10-07 13:35:05.875780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.183 [2024-10-07 13:35:05.875906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.183 [2024-10-07 13:35:05.875927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.183 [2024-10-07 13:35:05.875941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.183 [2024-10-07 13:35:05.876049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.183 [2024-10-07 13:35:05.885580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.885772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.885814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.885830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.885854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.885877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.885892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.885905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.885928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.897016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.897366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.897396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.897412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.897643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.897715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.897738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.897752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.897792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.908882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.909022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.909050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.909072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.909098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.909122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.909137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.909149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.909174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.921101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.921354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.921384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.921401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.922382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.922839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.922878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.922897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.922975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.931200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.931481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.931533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.931551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.931577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.931602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.931617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.931630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.931655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.941298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.941478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.941528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.941546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.941731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.941813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.941832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.941851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.941876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.953551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.953792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.953837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.953854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.954217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.954361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.954384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.954398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.954615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.968910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.969238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.969269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.969286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.969312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.969685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.969724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.969738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.970045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.982687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.983364] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.983408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.983425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.983826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.984051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.984074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.984088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.984152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:05.998051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:05.998389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:05.998419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:05.998436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:05.998461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:05.998510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:05.998527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:05.998540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.184 [2024-10-07 13:35:05.998564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.184 [2024-10-07 13:35:06.012665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.184 [2024-10-07 13:35:06.013342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.184 [2024-10-07 13:35:06.013387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.184 [2024-10-07 13:35:06.013404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.184 [2024-10-07 13:35:06.013718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.184 [2024-10-07 13:35:06.013777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.184 [2024-10-07 13:35:06.013812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.184 [2024-10-07 13:35:06.013827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.014004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.028268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.028542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.028574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.028593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.028619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.028643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.028658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.028671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.029048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.042577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.042820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.042850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.042868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.042897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.042922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.042937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.042950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.042974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.054424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.054882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.054927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.054943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.055066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.055189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.055211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.055225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.058532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.064727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.065467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.065519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.065538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.065598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.065626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.065642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.065655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.065686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.074887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.075114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.075143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.075160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.075338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.075394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.075414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.075432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.075467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.088962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.089322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.089352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.089369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.089635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.089708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.089729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.089743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.089768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.103632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.103827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.103871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.103888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.103914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.103937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.103951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.103964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.103988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.114663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.114991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.115020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.115036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.115154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.115263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.115293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.115305] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.115412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.125211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.125421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.125454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.125495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.185 [2024-10-07 13:35:06.125523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.185 [2024-10-07 13:35:06.125560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.185 [2024-10-07 13:35:06.125578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.185 [2024-10-07 13:35:06.125591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.185 [2024-10-07 13:35:06.125616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.185 [2024-10-07 13:35:06.135750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.185 [2024-10-07 13:35:06.136256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.185 [2024-10-07 13:35:06.136299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.185 [2024-10-07 13:35:06.136315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.136360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.136387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.136402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.136415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.136438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.146979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.147198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.147227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.147244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.147269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.147304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.147321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.147334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.147359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.161099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.161559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.161589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.161621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.162103] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.162347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.162370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.162384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.162444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.176872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.177999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.178029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.178060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.178158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.178199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.178223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.178236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.178261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.192312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.192560] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.192591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.192608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.192634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.192658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.192673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.192686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.192710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.207898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.208136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.208164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.208181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.208205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.208249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.208267] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.208279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.208304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.222193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.223312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.223356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.223373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.223808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.224025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.224048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.224063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.224114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.237704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.237942] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.237972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.237989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.238016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.238039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.238054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.238066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.238090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.249000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.249322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.249350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.249367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.249508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.249627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.249648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.249662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.249834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.259101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.259375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.259403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.259425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.259641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.259873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.259896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.259910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.260053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.269654] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.269930] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.269960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.186 [2024-10-07 13:35:06.269977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.186 [2024-10-07 13:35:06.270192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.186 [2024-10-07 13:35:06.270266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.186 [2024-10-07 13:35:06.270288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.186 [2024-10-07 13:35:06.270301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.186 [2024-10-07 13:35:06.270326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.186 [2024-10-07 13:35:06.280022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.186 [2024-10-07 13:35:06.280348] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.186 [2024-10-07 13:35:06.280378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.280395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.280544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.280677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.280699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.280713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.282576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.290120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.290395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.290423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.290439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.290463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.290511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.290538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.290552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.290741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.300216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.300506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.300536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.300553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.301636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.302110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.302133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.302163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.302209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.313970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.314257] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.314286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.314303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.314327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.314350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.314365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.314377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.314401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.328159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.328372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.328401] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.328418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.328443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.328480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.328506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.328519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.328544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.338624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.338954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.338984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.339001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.339109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.339230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.339250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.339263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.339380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.348717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.349004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.349033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.349049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.349074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.349098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.349112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.349125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.349149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.359615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.359837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.359866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.359883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.359907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.359930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.359945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.359958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.359982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.373285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.373594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.373625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.373643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.373845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.373903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.373923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.373936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.373960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.386352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.387313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.387358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.387375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.387788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.388034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.388057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.388071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.388121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.396494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.187 [2024-10-07 13:35:06.396758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.187 [2024-10-07 13:35:06.396802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.187 [2024-10-07 13:35:06.396819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.187 [2024-10-07 13:35:06.396843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.187 [2024-10-07 13:35:06.396866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.187 [2024-10-07 13:35:06.396880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.187 [2024-10-07 13:35:06.396892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.187 [2024-10-07 13:35:06.396916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.187 [2024-10-07 13:35:06.406879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.407183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.407212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.407229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.407253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.407277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.407291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.407309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.407334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.416979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.417258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.417288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.417304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.417507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.417565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.417585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.417599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.417624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.429823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.430297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.430340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.430357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.430584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.430810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.430833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.430846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.430897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.443422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.443908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.443938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.443969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.444519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.444766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.444804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.444818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.445018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.453523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.453820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.453854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.453872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.453896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.453919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.453933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.453946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.456449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.463623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.463879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.463907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.463923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.464071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.464201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.464223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.464237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.464349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.473763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.473969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.473998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.474014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.474039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.474063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.474077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.474091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.474115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.489407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.489590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.489621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.489638] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.489663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.489692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.489709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.489722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.489747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.499962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.500321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.500351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.500382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.500539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.500657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.500678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.500692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.500882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.510061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.510279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.510307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.510323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.510348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.510370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.510384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.188 [2024-10-07 13:35:06.510397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.188 [2024-10-07 13:35:06.510420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.188 [2024-10-07 13:35:06.520388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.188 [2024-10-07 13:35:06.520613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.188 [2024-10-07 13:35:06.520644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.188 [2024-10-07 13:35:06.520661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.188 [2024-10-07 13:35:06.520686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.188 [2024-10-07 13:35:06.520710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.188 [2024-10-07 13:35:06.520724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.520738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.520762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.531613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.534700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.534745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.534763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.535892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.536366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.536388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.536418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.536659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.541698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.541952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.541980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.541996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.542020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.542043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.542058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.542070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.542094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.551807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.552040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.552069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.552085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.552109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.552132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.552146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.552158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.552182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.564742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.564976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.565005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.565027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.565052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.565075] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.565089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.565102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.565125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.579502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.579677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.579717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.579734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.579928] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.579983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.580003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.580017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.580042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.592649] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.593852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.593896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.593913] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.594255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.594460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.594507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.594523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.595004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.605377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.605654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.605685] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.605703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.605829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.605944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.605974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.605988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.608434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.616015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.616201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.616230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.616247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.616587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.616630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.616646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.616659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.616683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.626112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.626262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.626291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.189 [2024-10-07 13:35:06.626308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.189 [2024-10-07 13:35:06.626509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.189 [2024-10-07 13:35:06.626569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.189 [2024-10-07 13:35:06.626590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.189 [2024-10-07 13:35:06.626604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.189 [2024-10-07 13:35:06.626629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.189 [2024-10-07 13:35:06.638367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.189 [2024-10-07 13:35:06.638566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.189 [2024-10-07 13:35:06.638596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.638613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.638638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.638662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.638677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.638691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.638716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.653861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.654663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.654708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.654726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.654829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.654857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.654872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.654885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.654910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.668707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.668875] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.668903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.668920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.668945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.668968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.668982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.668995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.669019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.679482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.681310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.681354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.681372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.683514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.684225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.684248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.684277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.684709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.689576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.689733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.689763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.689794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.689824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.689848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.689862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.689876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.689900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.699703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.699882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.699910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.699926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.699951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.699974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.699989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.700002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.700215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.713161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.713722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.713767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.713784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.714061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.714121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.714141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.714155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.714179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.727230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.727439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.727469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.727495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.727523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.727548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.727563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.727581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.727607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.740002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.740350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.740380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.740397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.740554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.740673] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.740694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.740708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.743174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 [2024-10-07 13:35:06.750408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.750669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.750700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.750717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.750850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.750963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.750984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.190 [2024-10-07 13:35:06.750997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.190 [2024-10-07 13:35:06.751109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.190 8605.25 IOPS, 33.61 MiB/s [2024-10-07T11:35:19.123Z] [2024-10-07 13:35:06.760559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.190 [2024-10-07 13:35:06.760791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.190 [2024-10-07 13:35:06.760821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.190 [2024-10-07 13:35:06.760853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.190 [2024-10-07 13:35:06.761069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.190 [2024-10-07 13:35:06.761129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.190 [2024-10-07 13:35:06.761149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.761164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.761189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.773111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.773524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.773574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.773592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.773825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.773883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.773903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.773917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.774093] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.783212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.783456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.783510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.783529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.787824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.788035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.788060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.788074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.788781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.793310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.793576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.793606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.793623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.793806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.793877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.793897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.793911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.793936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.806232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.806467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.806521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.806539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.806564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.806594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.806610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.806622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.806648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.821884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.822264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.822309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.822326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.822365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.822389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.822404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.822417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.822441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.837818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.838086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.838116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.838133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.838158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.838182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.838197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.838210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.838234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.848894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.852095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.852139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.852157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.852976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.853378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.853415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.853429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.853685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.858995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.859246] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.859274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.859290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.859314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.859337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.859351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.859364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.859388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.869090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.869310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.869339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.869356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.869380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.869404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.869418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.869430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.869454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.879482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.879794] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.879825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.879842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.879981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.191 [2024-10-07 13:35:06.880108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.191 [2024-10-07 13:35:06.880129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.191 [2024-10-07 13:35:06.880143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.191 [2024-10-07 13:35:06.883329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.191 [2024-10-07 13:35:06.889575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.191 [2024-10-07 13:35:06.889840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.191 [2024-10-07 13:35:06.889869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.191 [2024-10-07 13:35:06.889894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.191 [2024-10-07 13:35:06.889920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.889943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.889958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.889970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.889994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.900454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.901266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.901311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.901328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.901584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.901810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.901833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.901847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.901899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.914953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.915431] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.915475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.915501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.915723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.915781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.915801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.915816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.915856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.930783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.931722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.931767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.931786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.931886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.931914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.931934] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.931948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.931973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.944704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.945119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.945151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.945169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.945367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.945423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.945443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.945457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.945508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.956685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.956990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.957021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.957038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.957146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.957257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.957278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.957291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.960306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.966800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.966994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.967023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.967040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.967064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.967088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.967102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.967115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.967139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.976967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.977160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.977191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.977208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.977234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.977429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.977452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.977481] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.977545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:06.991274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:06.991467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:06.991520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:06.991538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:06.991564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:06.991588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:06.991603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:06.991616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:06.991641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:07.003995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:07.004220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:07.004250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:07.004268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:07.004376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:07.004575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:07.004600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:07.004614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:07.004668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:07.014095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:07.014314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.192 [2024-10-07 13:35:07.014343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.192 [2024-10-07 13:35:07.014360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.192 [2024-10-07 13:35:07.014390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.192 [2024-10-07 13:35:07.014413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.192 [2024-10-07 13:35:07.014428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.192 [2024-10-07 13:35:07.014440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.192 [2024-10-07 13:35:07.014464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.192 [2024-10-07 13:35:07.024192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.192 [2024-10-07 13:35:07.024324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.024353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.024370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.024394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.024418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.024432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.024445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.024469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.036252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.036394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.036423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.036440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.036464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.036525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.036545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.036559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.036583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.048615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.049017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.049061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.049077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.049293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.049362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.049384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.049403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.049429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.059997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.060374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.060404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.060421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.060586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.060731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.060754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.060768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.060896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.071013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.071243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.071272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.071289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.071315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.071339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.071354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.071368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.071403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.081111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.081389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.081418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.081435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.081459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.081509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.081527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.081540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.081748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.091207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.091427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.091461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.091479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.091713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.091884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.091908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.091923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.092046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.103175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.103527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.103560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.103577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.103640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.103839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.103862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.103876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.103927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.115038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.115573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.115618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.115635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.115830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.115895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.115915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.115929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.115960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.128687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.128998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.129043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.129060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.129169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.129298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.129318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.129332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.193 [2024-10-07 13:35:07.131317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.193 [2024-10-07 13:35:07.138801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.193 [2024-10-07 13:35:07.139014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.193 [2024-10-07 13:35:07.139043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.193 [2024-10-07 13:35:07.139060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.193 [2024-10-07 13:35:07.139084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.193 [2024-10-07 13:35:07.139107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.193 [2024-10-07 13:35:07.139123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.193 [2024-10-07 13:35:07.139135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.139286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.148898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.149098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.149128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.149144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.149359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.149429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.149450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.149478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.149684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.162451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.162918] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.162948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.162979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.163178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.163227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.163246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.163259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.163451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.172568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.172822] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.172867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.172884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.172909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.172945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.172962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.172975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.172999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.182948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.183131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.183159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.183176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.183716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.183909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.183931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.183947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.183973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.193707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.193867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.193897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.193914] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.193939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.193963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.193977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.193990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.194014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.204075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.204307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.204336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.204359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.204384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.204407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.204422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.204434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.204458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.214174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.214390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.214419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.214437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.214461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.214522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.214537] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.214550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.214575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.225924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.226143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.226173] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.226190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.226406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.226477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.226530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.226546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.226730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.240314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.240637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.240670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.240688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.241142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.194 [2024-10-07 13:35:07.241432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.194 [2024-10-07 13:35:07.241473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.194 [2024-10-07 13:35:07.241499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.194 [2024-10-07 13:35:07.241735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.194 [2024-10-07 13:35:07.252171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.194 [2024-10-07 13:35:07.252605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.194 [2024-10-07 13:35:07.252637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.194 [2024-10-07 13:35:07.252656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.194 [2024-10-07 13:35:07.256344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.257051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.257076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.257106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.257330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.262303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.262532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.262562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.262580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.262605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.262736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.262753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.262768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.262793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.272399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.272762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.272794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.272811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.272876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.273055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.273077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.273091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.273141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.287921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.288400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.288444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.288461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.288693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.288764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.288794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.288809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.288849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.302912] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.303114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.303143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.303161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.303185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.303209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.303223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.303236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.303260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.313223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.313401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.313431] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.313447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.313496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.313523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.313538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.313552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.313577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.323833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.323997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.324026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.324044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.324074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.324097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.324112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.324124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.324149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.335373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.335754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.335804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.335821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.335870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.336072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.336096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.336110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.336160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.351207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.351838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.351884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.351901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.352128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.352184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.352205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.352218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.352395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.365818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.365989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.366018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.366034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.366059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.366091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.366105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.366124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.366149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.381936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.382604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.382650] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.195 [2024-10-07 13:35:07.382669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.195 [2024-10-07 13:35:07.382922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.195 [2024-10-07 13:35:07.383126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.195 [2024-10-07 13:35:07.383149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.195 [2024-10-07 13:35:07.383163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.195 [2024-10-07 13:35:07.383220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.195 [2024-10-07 13:35:07.392572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.195 [2024-10-07 13:35:07.392879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.195 [2024-10-07 13:35:07.392909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.392927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.396591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.397458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.397482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.397522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.397974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.402876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.403203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.403231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.403248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.403355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.403435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.403462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.403502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.403541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.412973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.413174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.413209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.413226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.413251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.413274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.413289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.413302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.413326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.425656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.425856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.425885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.425902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.425926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.425949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.425964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.425977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.426001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.440910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.441100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.441130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.441147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.441172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.441195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.441209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.441222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.441246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.454910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.455077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.455107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.455124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.455148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.455177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.455192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.455205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.455229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.468659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.470441] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.470493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.470512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.470635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.470674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.470692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.470706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.470732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.479070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.479342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.479374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.479392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.479529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.479661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.479683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.479697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.479808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.489271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.489465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.489504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.489524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.489709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.489776] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.489797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.489822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.489853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.502758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.503171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.503203] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.503222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.503452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.503521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.503544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.503559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.503741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.196 [2024-10-07 13:35:07.518428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.196 [2024-10-07 13:35:07.518864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.196 [2024-10-07 13:35:07.518909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.196 [2024-10-07 13:35:07.518926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.196 [2024-10-07 13:35:07.519138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.196 [2024-10-07 13:35:07.519194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.196 [2024-10-07 13:35:07.519221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.196 [2024-10-07 13:35:07.519234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.196 [2024-10-07 13:35:07.519259] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.533956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.534107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.534136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.534153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.534178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.534216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.534234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.534247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.534271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.544078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.544324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.544353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.544376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.544401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.544439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.544457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.544470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.544519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.554494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.554702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.554732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.554748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.554774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.554813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.554827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.554840] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.554864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.564580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.564907] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.564936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.564953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.565894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.566550] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.566575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.566590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.566833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.578676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.578878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.578908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.578925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.578950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.578974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.578995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.579008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.579033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.590282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.590621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.590652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.590670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.593007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.594017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.594041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.594069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.594652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.600382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.600603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.600633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.600650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.600676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.600700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.600715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.600728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.600752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.610824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.610983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.611011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.611028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.611053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.611230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.611253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.611267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.611317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.621175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.621409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.621440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.621456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.623730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.624741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.624765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.624796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.625087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.631523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.631699] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.631735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.631752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.631791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.631815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.631830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.197 [2024-10-07 13:35:07.631842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.197 [2024-10-07 13:35:07.631866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.197 [2024-10-07 13:35:07.641622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.197 [2024-10-07 13:35:07.641791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.197 [2024-10-07 13:35:07.641837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.197 [2024-10-07 13:35:07.641854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.197 [2024-10-07 13:35:07.641880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.197 [2024-10-07 13:35:07.642057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.197 [2024-10-07 13:35:07.642080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.642093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.642144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.656079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.656435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.656465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.656509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.656578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.656764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.656802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.656817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.656868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.670290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.670430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.670460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.670503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.670530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.670554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.670569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.670583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.670609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.685196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.686156] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.686201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.686219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.686452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.686950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.686974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.687002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.687272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.696231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.696496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.696527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.696545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.696658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.696790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.696811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.696830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.697644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.710044] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.711447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.711501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.711520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.713055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.713738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.713763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.713793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.714061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.720144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.720300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.720339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.720355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.720379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.720403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.720419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.720432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.720456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.730505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.730655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.730686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.730704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.730901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.730958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.730978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.730992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.731018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.742965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.743167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.743202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.743219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.743244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 [2024-10-07 13:35:07.743268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.743282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.743296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.743522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.198 [2024-10-07 13:35:07.754343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.198 [2024-10-07 13:35:07.754588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.198 [2024-10-07 13:35:07.754620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.198 [2024-10-07 13:35:07.754638] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.198 [2024-10-07 13:35:07.756853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.198 8595.20 IOPS, 33.58 MiB/s [2024-10-07T11:35:19.131Z] [2024-10-07 13:35:07.759765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.198 [2024-10-07 13:35:07.759789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.198 [2024-10-07 13:35:07.759809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.198 [2024-10-07 13:35:07.760830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.199 [2024-10-07 13:35:07.764636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.199 [2024-10-07 13:35:07.764789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.199 [2024-10-07 13:35:07.764818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.199 [2024-10-07 13:35:07.764835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.199 [2024-10-07 13:35:07.764859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.199 [2024-10-07 13:35:07.764882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.199 [2024-10-07 13:35:07.764897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.199 [2024-10-07 13:35:07.764911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.199 [2024-10-07 13:35:07.764935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.199 [2024-10-07 13:35:07.774725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.199 [2024-10-07 13:35:07.775057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.199 [2024-10-07 13:35:07.775087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.199 [2024-10-07 13:35:07.775104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.199 [2024-10-07 13:35:07.775154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.199 [2024-10-07 13:35:07.775186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.199 [2024-10-07 13:35:07.775202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.199 [2024-10-07 13:35:07.775215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.199 [2024-10-07 13:35:07.775393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.199 [2024-10-07 13:35:07.786361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:83928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:83936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:83944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:83952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:83960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:83968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:83976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:83984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:83992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:84000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:84008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:84016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:84024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:84032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:84040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:84048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:84056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.786984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:84064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.786999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:84072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:84080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:84088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:84096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:84104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:84112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:84120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:84128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:84136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:84144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:84152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:84160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:84168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.199 [2024-10-07 13:35:07.787399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:84176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.199 [2024-10-07 13:35:07.787413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:84184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:84192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:84200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:84208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:84216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:84224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:84232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:84248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:84256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:84264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:84272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:84280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:84288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:84296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:84304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.787979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.787995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:84312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:84320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:84328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:84336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:84344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:84352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:84360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:84368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:84376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:84384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:84392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:84400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:84408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:84416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:84424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.200 [2024-10-07 13:35:07.788445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:83720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:83728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:83736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:83744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:83752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:83760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:83768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:83776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:83784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.200 [2024-10-07 13:35:07.788747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:83792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.200 [2024-10-07 13:35:07.788762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.788777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:84432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.788800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.788819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:84440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.788833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.788860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:84448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.788874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.788890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:84456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.788904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.788919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:84464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.788933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.788949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:84472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.788963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.788979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:84480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.788993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:84488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:84496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:84504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:84512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:84520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:84528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:84536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:84544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:84552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:84560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:84568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:84576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:83800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.201 [2024-10-07 13:35:07.789417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:83808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.201 [2024-10-07 13:35:07.789457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:83816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.201 [2024-10-07 13:35:07.789497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:83824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.201 [2024-10-07 13:35:07.789541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:83832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.201 [2024-10-07 13:35:07.789572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:83840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.201 [2024-10-07 13:35:07.789603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:83848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.201 [2024-10-07 13:35:07.789633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:84584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:84592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:84600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:84608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:84616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:84624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.201 [2024-10-07 13:35:07.789823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789854] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.201 [2024-10-07 13:35:07.789872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84632 len:8 PRP1 0x0 PRP2 0x0 00:24:23.201 [2024-10-07 13:35:07.789886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.789954] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.201 [2024-10-07 13:35:07.789976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.790002] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.201 [2024-10-07 13:35:07.790016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.790031] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.201 [2024-10-07 13:35:07.790045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.790060] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.201 [2024-10-07 13:35:07.790074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.790087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.201 [2024-10-07 13:35:07.790338] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.201 [2024-10-07 13:35:07.790359] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.201 [2024-10-07 13:35:07.790372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84640 len:8 PRP1 0x0 PRP2 0x0 00:24:23.201 [2024-10-07 13:35:07.790400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.201 [2024-10-07 13:35:07.790418] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.201 [2024-10-07 13:35:07.790430] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84648 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790477] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790496] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84656 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790543] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790554] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84664 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790592] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790603] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84672 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790641] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790652] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84680 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790691] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790702] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84688 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790739] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790750] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84696 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790787] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790798] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84704 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790848] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790859] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84712 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790895] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790914] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84720 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.790950] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.790961] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.790976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84728 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.790989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791002] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791013] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84736 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791048] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791059] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83856 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791094] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791105] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83864 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791142] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791153] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83872 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791196] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791208] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83880 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791244] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791255] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83888 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791291] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791302] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83896 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791339] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791350] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83904 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791386] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791397] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83912 len:8 PRP1 0x0 PRP2 0x0 00:24:23.202 [2024-10-07 13:35:07.791420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.202 [2024-10-07 13:35:07.791434] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.202 [2024-10-07 13:35:07.791444] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.202 [2024-10-07 13:35:07.791455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83920 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791500] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791513] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83928 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791551] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791562] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83936 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791603] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791616] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83944 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791654] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791666] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83952 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791703] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791715] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83960 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791752] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791764] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83968 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791805] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791817] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83976 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791858] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791869] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83984 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791906] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791918] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83992 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.791955] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.791966] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.791981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84000 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.791995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792008] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792020] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84008 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792057] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792068] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84016 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792123] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792134] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84024 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792171] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792182] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84032 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792219] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792230] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84040 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792267] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792278] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84048 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792314] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792326] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84056 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792362] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792376] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84064 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792413] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792425] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84072 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792461] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792475] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84080 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792528] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792539] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84088 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792576] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792587] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84096 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792624] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792635] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84104 len:8 PRP1 0x0 PRP2 0x0 00:24:23.203 [2024-10-07 13:35:07.792658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.203 [2024-10-07 13:35:07.792671] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.203 [2024-10-07 13:35:07.792683] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.203 [2024-10-07 13:35:07.792694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84112 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.792706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.792719] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.792730] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.792741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84120 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.792753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.792777] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.792788] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.792800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84128 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.792812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.792825] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.792836] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.792847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84136 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.792860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.792873] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.792884] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.792895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84144 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.792908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.792921] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.792932] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.792943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84152 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.792955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.792968] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.792978] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.792990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84160 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793015] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793026] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84168 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793062] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793072] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84176 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793109] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793119] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84184 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793159] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793170] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84192 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793206] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793222] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84200 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793260] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793273] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84208 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793309] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793320] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84216 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793364] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793375] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84224 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793412] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793423] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84232 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793460] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793480] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84240 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793527] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793538] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84248 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793578] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793589] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84256 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793626] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793646] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84264 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793684] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793695] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84272 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793732] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793743] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84280 len:8 PRP1 0x0 PRP2 0x0 00:24:23.204 [2024-10-07 13:35:07.793767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.204 [2024-10-07 13:35:07.793789] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.204 [2024-10-07 13:35:07.793800] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.204 [2024-10-07 13:35:07.793811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84288 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.793823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.793837] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.793847] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.793858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84296 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.793870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.793883] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.793894] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.793905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84304 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.793917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.793934] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.793945] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.793957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84312 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.793978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.793991] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794002] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84320 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794038] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794058] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84328 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794103] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794114] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84336 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794151] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794162] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84344 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794198] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794209] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84352 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794245] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794256] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84360 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794292] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794303] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84368 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794344] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794355] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.794366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84376 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.794378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.794391] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.794402] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.800740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84384 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.800771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.800791] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.800805] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.800816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84392 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.800829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.800842] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.800853] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.800864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84400 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.800876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.800889] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.800900] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.800911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84408 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.800923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.800936] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.800946] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.800957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84416 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.800969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.800982] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.800993] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.801004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84424 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.801016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.205 [2024-10-07 13:35:07.801029] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.205 [2024-10-07 13:35:07.801039] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.205 [2024-10-07 13:35:07.801057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83720 len:8 PRP1 0x0 PRP2 0x0 00:24:23.205 [2024-10-07 13:35:07.801071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801085] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801096] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83728 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801131] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801142] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83736 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801178] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801189] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83744 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801224] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801235] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83752 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801271] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801281] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83760 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801316] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801327] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83768 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801363] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801373] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83776 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801409] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801424] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83784 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801461] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801472] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83792 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801521] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801532] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84432 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801569] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801579] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84440 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801616] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801626] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84448 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801662] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801673] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84456 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801709] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801720] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84464 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801755] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801766] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84472 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801806] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801817] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84480 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801853] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801864] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84488 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801900] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801911] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84496 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801947] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.801958] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.801968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84504 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.801981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.801993] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.802005] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.802015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84512 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.802028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.802041] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.802053] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.802064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84520 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.802077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.802090] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.802101] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.802112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84528 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.802124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.802137] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.802148] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.802159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84536 len:8 PRP1 0x0 PRP2 0x0 00:24:23.206 [2024-10-07 13:35:07.802175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.206 [2024-10-07 13:35:07.802189] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.206 [2024-10-07 13:35:07.802200] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.206 [2024-10-07 13:35:07.802211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84544 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802236] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802247] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84552 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802284] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802294] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84560 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802330] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802341] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84568 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802378] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802389] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84576 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802426] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802437] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83800 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802474] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802494] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83808 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802534] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802545] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83816 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802586] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802597] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83824 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802634] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802645] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83832 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802681] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802692] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83840 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802729] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802745] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83848 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802783] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802795] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84584 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802835] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802846] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84592 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802888] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802899] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84600 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802935] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802949] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.802961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84608 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.802974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.802987] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.802998] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.803009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84616 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.803022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.803035] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.803046] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.803057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84624 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.803069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.803082] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.207 [2024-10-07 13:35:07.803093] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.207 [2024-10-07 13:35:07.803104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84632 len:8 PRP1 0x0 PRP2 0x0 00:24:23.207 [2024-10-07 13:35:07.803116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.207 [2024-10-07 13:35:07.803185] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x68a340 was disconnected and freed. reset controller. 00:24:23.207 [2024-10-07 13:35:07.803266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.207 [2024-10-07 13:35:07.803296] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:23.207 [2024-10-07 13:35:07.804758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.207 [2024-10-07 13:35:07.804795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.207 [2024-10-07 13:35:07.805013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.207 [2024-10-07 13:35:07.805043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.208 [2024-10-07 13:35:07.805062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.805187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.805212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.208 [2024-10-07 13:35:07.805227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.805253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.805274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.805564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.805587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.805610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.805629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.805644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.805657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.805897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.805921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.814879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.814952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.815159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.815188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.208 [2024-10-07 13:35:07.815205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.815341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.815368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.208 [2024-10-07 13:35:07.815384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.815402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.815427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.815445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.815457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.815495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.815541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.815561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.815574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.815588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.815610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.824987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.825318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.825347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.208 [2024-10-07 13:35:07.825364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.825401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.825448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.825521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.825539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.825552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.825577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.825682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.825709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.208 [2024-10-07 13:35:07.825725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.825750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.825789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.825803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.825816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.825839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.836094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.836140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.836341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.836370] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.208 [2024-10-07 13:35:07.836386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.836528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.836556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.208 [2024-10-07 13:35:07.836572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.836845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.836874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.837111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.837134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.837148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.837165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.837179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.837191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.837241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.837261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.847121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.847157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.847506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.847537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.208 [2024-10-07 13:35:07.847555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.847650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.847677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.208 [2024-10-07 13:35:07.847693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.847821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.847847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.208 [2024-10-07 13:35:07.847969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.847990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.848004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.848020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.208 [2024-10-07 13:35:07.848035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.208 [2024-10-07 13:35:07.848047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.208 [2024-10-07 13:35:07.848155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.848185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.208 [2024-10-07 13:35:07.857253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.857315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.208 [2024-10-07 13:35:07.857513] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.857543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.208 [2024-10-07 13:35:07.857560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.208 [2024-10-07 13:35:07.857677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.208 [2024-10-07 13:35:07.857705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.208 [2024-10-07 13:35:07.857721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.857739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.857765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.857801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.857814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.857826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.857860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.857878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.857890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.857902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.857924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.869346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.869401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.869670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.869701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.209 [2024-10-07 13:35:07.869718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.869840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.869866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.209 [2024-10-07 13:35:07.869881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.869906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.869926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.869947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.869961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.869974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.869990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.870004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.870017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.870047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.870063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.879503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.879552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.879812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.879840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.209 [2024-10-07 13:35:07.879856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.879976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.880002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.209 [2024-10-07 13:35:07.880018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.880041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.882630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.882659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.882695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.882708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.885328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.885355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.885385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.885399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.886235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.889589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.889866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.889895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.209 [2024-10-07 13:35:07.889912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.890057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.890247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.890283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.890300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.890313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.890361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.890517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.890546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.209 [2024-10-07 13:35:07.890562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.890587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.890611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.890627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.890640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.890664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.901559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.901591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.901786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.901830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.209 [2024-10-07 13:35:07.901846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.902003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.902029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.209 [2024-10-07 13:35:07.902045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.902069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.902089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.902109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.902123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.902136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.902153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.902167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.902179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.902202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.902218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.209 [2024-10-07 13:35:07.916876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.916923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.209 [2024-10-07 13:35:07.917646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.917678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.209 [2024-10-07 13:35:07.917696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.917828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.209 [2024-10-07 13:35:07.917855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.209 [2024-10-07 13:35:07.917885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.209 [2024-10-07 13:35:07.918313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.918341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.209 [2024-10-07 13:35:07.918596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.209 [2024-10-07 13:35:07.918621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.209 [2024-10-07 13:35:07.918635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.209 [2024-10-07 13:35:07.918653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.918674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.918687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.918744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.918779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.928724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.928757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.929075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.929104] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.210 [2024-10-07 13:35:07.929121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.929225] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.929251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.210 [2024-10-07 13:35:07.929267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.929375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.929402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.929532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.929555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.929569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.929586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.929601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.929614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.929729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.929752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.938836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.938898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.939108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.939136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.210 [2024-10-07 13:35:07.939153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.939261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.939288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.210 [2024-10-07 13:35:07.939304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.939326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.939352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.939370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.939382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.939395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.939427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.939443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.939456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.939483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.939518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.949093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.949131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.949302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.949330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.210 [2024-10-07 13:35:07.949346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.949494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.949520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.210 [2024-10-07 13:35:07.949535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.949719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.949746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.949809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.949829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.949843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.949861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.949875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.949887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.950062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.950085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.959580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.959614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.959868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.959911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.210 [2024-10-07 13:35:07.959928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.960060] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.960086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.210 [2024-10-07 13:35:07.960101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.962637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.962683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.963528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.963553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.963567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.963585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.963600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.963613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.964076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.964102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.969694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.969769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.970035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.970064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.210 [2024-10-07 13:35:07.970080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.970254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.970283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.210 [2024-10-07 13:35:07.970298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.210 [2024-10-07 13:35:07.970316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.970341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.210 [2024-10-07 13:35:07.970358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.970372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.970384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.970408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.970425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.210 [2024-10-07 13:35:07.970442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.210 [2024-10-07 13:35:07.970456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.210 [2024-10-07 13:35:07.970506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.210 [2024-10-07 13:35:07.979815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.210 [2024-10-07 13:35:07.980101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.210 [2024-10-07 13:35:07.980130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.211 [2024-10-07 13:35:07.980146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:07.980183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:07.980214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:07.980242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:07.980257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:07.980270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:07.980292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:07.980532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:07.980560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.211 [2024-10-07 13:35:07.980577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:07.980601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:07.980624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:07.980639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:07.980652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:07.980676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:07.992705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:07.992995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:07.993180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:07.993209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.211 [2024-10-07 13:35:07.993226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:07.993451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:07.993501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.211 [2024-10-07 13:35:07.993520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:07.993538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:07.993570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:07.993589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:07.993602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:07.993614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:07.993639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:07.993657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:07.993670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:07.993682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:07.993704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:08.006277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.006322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.006533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.006563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.211 [2024-10-07 13:35:08.006581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:08.006724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.006751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.211 [2024-10-07 13:35:08.006768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:08.006793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:08.006826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:08.006847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:08.006863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:08.006876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:08.006894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:08.006909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:08.006921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:08.006946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:08.006962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:08.016403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.016470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.016708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.016739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.211 [2024-10-07 13:35:08.016764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:08.019616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.019648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.211 [2024-10-07 13:35:08.019665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:08.019684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:08.021979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:08.022011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:08.022028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:08.022042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:08.022919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:08.022948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:08.022979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:08.022996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:08.023395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:08.026522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.026788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.026818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.211 [2024-10-07 13:35:08.026834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:08.026876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:08.026913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.026942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:08.026958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:08.026971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:08.026995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:08.027254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.027281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.211 [2024-10-07 13:35:08.027297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:08.027322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.211 [2024-10-07 13:35:08.027345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.211 [2024-10-07 13:35:08.027361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.211 [2024-10-07 13:35:08.027380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.211 [2024-10-07 13:35:08.027405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.211 [2024-10-07 13:35:08.038479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.038535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.211 [2024-10-07 13:35:08.038702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.038733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.211 [2024-10-07 13:35:08.038750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.211 [2024-10-07 13:35:08.038943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.211 [2024-10-07 13:35:08.038970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.212 [2024-10-07 13:35:08.038986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.039011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.039032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.039052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.039067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.039081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.039099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.039113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.039126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.039150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.039166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.048620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.048669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.048895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.048924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.212 [2024-10-07 13:35:08.048941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.049080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.049107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.212 [2024-10-07 13:35:08.049123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.049156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.049181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.049220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.049233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.049246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.049271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.049293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.049306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.049319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.049343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.058706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.059023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.059052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.212 [2024-10-07 13:35:08.059069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.059107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.059140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.059169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.059184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.059197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.059222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.059448] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.059477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.212 [2024-10-07 13:35:08.059507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.059533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.059556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.059571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.059584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.059607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.068798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.069049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.069079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.212 [2024-10-07 13:35:08.069096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.069122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.069152] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.069168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.069181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.071468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.073764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.074410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.074441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.212 [2024-10-07 13:35:08.074458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.074686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.074745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.074768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.074784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.074810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.079761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.080014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.080043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.212 [2024-10-07 13:35:08.080061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.080086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.080110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.080125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.080138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.080164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.086212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.086691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.086730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.212 [2024-10-07 13:35:08.086751] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.087000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.087216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.087241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.212 [2024-10-07 13:35:08.087255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.212 [2024-10-07 13:35:08.087318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.212 [2024-10-07 13:35:08.089851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.212 [2024-10-07 13:35:08.090093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.212 [2024-10-07 13:35:08.090123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.212 [2024-10-07 13:35:08.090141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.212 [2024-10-07 13:35:08.090166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.212 [2024-10-07 13:35:08.090189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.212 [2024-10-07 13:35:08.090204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.090218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.090242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.096312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.096618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.096648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.213 [2024-10-07 13:35:08.096665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.096691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.099253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.099277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.099307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.101761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.102392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.102649] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.102678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.213 [2024-10-07 13:35:08.102695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.102890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.102946] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.102966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.102980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.103004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.106407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.106637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.106666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.213 [2024-10-07 13:35:08.106688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.106841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.106967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.106988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.107001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.107112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.117151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.117213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.117394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.117422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.213 [2024-10-07 13:35:08.117438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.117564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.117592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.213 [2024-10-07 13:35:08.117608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.117626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.117660] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.117678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.117691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.117703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.117728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.117745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.117758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.117770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.117792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.132079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.132116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.132312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.132340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.213 [2024-10-07 13:35:08.132356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.132506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.132538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.213 [2024-10-07 13:35:08.132555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.132580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.132601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.132622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.132636] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.132649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.132666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.132680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.132693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.132717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.132734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.147832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.147879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.148776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.148832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.213 [2024-10-07 13:35:08.148848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.148993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.149017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.213 [2024-10-07 13:35:08.149032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.149683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.149727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.150169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.150192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.150220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.150237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.150251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.150263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.150497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.150535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.213 [2024-10-07 13:35:08.158202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.158234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.213 [2024-10-07 13:35:08.158536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.158567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.213 [2024-10-07 13:35:08.158585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.158728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.213 [2024-10-07 13:35:08.158755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.213 [2024-10-07 13:35:08.158771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.213 [2024-10-07 13:35:08.158898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.158925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.213 [2024-10-07 13:35:08.159032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.213 [2024-10-07 13:35:08.159052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.213 [2024-10-07 13:35:08.159065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.213 [2024-10-07 13:35:08.159082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.159096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.159109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.162648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.162675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.168681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.168727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.168912] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.168941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.214 [2024-10-07 13:35:08.168957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.169074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.169100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.214 [2024-10-07 13:35:08.169116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.169140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.169160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.169181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.169196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.169209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.169231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.169246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.169259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.169282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.169298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.178978] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.179009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.179168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.179197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.214 [2024-10-07 13:35:08.179214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.179326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.179353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.214 [2024-10-07 13:35:08.179368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.179579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.179609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.179658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.179677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.179691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.179708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.179723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.179736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.179928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.179952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.191529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.191573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.192805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.192835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.214 [2024-10-07 13:35:08.192852] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.192974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.193000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.214 [2024-10-07 13:35:08.193020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.193440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.193484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.193741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.193765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.193780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.193798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.193813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.193826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.194111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.194134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.203896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.203927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.204205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.204234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.214 [2024-10-07 13:35:08.204254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.204382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.204407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.214 [2024-10-07 13:35:08.204423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.204559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.204587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.204702] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.204724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.204738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.204756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.204770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.204783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.208022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.208047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.214022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.214082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.214311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.214339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.214 [2024-10-07 13:35:08.214356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.214501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.214 [2024-10-07 13:35:08.214528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.214 [2024-10-07 13:35:08.214544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.214 [2024-10-07 13:35:08.214562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.214588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.214 [2024-10-07 13:35:08.214606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.214619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.214632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.214657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.214674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.214 [2024-10-07 13:35:08.214687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.214 [2024-10-07 13:35:08.214700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.214 [2024-10-07 13:35:08.214722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.214 [2024-10-07 13:35:08.224513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.224558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.214 [2024-10-07 13:35:08.224732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.224762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.215 [2024-10-07 13:35:08.224779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.224908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.224934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.215 [2024-10-07 13:35:08.224949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.225128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.225156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.225350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.225372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.225386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.225403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.225423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.225436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.225509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.225531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.238819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.238866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.239031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.239060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.215 [2024-10-07 13:35:08.239076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.239225] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.239252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.215 [2024-10-07 13:35:08.239268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.239292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.239313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.239334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.239348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.239361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.239378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.239392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.239405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.239428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.239445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.249171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.249203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.249469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.249524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.215 [2024-10-07 13:35:08.249543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.249660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.249687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.215 [2024-10-07 13:35:08.249703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.252245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.252291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.254058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.254083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.254113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.254131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.254145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.254174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.254241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.254262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.259299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.259360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.259530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.259560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.215 [2024-10-07 13:35:08.259577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.259707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.259735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.215 [2024-10-07 13:35:08.259752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.259771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.259797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.259830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.259843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.259855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.259880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.259896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.259908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.259920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.259942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.269397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.269587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.269619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.215 [2024-10-07 13:35:08.269642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.269680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.269713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.269743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.269759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.269773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.269796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.269965] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.270003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.215 [2024-10-07 13:35:08.270019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.271105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.271830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.215 [2024-10-07 13:35:08.271855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.215 [2024-10-07 13:35:08.271871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.215 [2024-10-07 13:35:08.272123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.215 [2024-10-07 13:35:08.284847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.284879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.215 [2024-10-07 13:35:08.285148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.285178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.215 [2024-10-07 13:35:08.285194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.285317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.215 [2024-10-07 13:35:08.285343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.215 [2024-10-07 13:35:08.285358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.215 [2024-10-07 13:35:08.285712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.215 [2024-10-07 13:35:08.285741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.285815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.285835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.285848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.285865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.285879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.285896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.286074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.286115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.299641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.299672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.299840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.299868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.216 [2024-10-07 13:35:08.299884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.300017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.300043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.216 [2024-10-07 13:35:08.300058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.300082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.300102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.300122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.300137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.300149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.300165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.300179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.300191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.300214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.300230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.315285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.315318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.315634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.315664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.216 [2024-10-07 13:35:08.315681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.315812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.315838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.216 [2024-10-07 13:35:08.315853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.315885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.315911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.315933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.315947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.315960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.315977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.315991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.316003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.316026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.316042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.326156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.326202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.328526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.328557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.216 [2024-10-07 13:35:08.328590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.328755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.328781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.216 [2024-10-07 13:35:08.328811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.330669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.330699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.331347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.331369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.331398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.331416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.331430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.331442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.331703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.331728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.336279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.336338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.336588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.336622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.216 [2024-10-07 13:35:08.336644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.336747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.336774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.216 [2024-10-07 13:35:08.336790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.336822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.336847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.336865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.336877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.336889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.336912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.336928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.336940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.216 [2024-10-07 13:35:08.336953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.216 [2024-10-07 13:35:08.336974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.216 [2024-10-07 13:35:08.346375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.346625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.216 [2024-10-07 13:35:08.346655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.216 [2024-10-07 13:35:08.346673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.216 [2024-10-07 13:35:08.346711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.216 [2024-10-07 13:35:08.346744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.216 [2024-10-07 13:35:08.346773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.216 [2024-10-07 13:35:08.346789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.346817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.346841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.347076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.347102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.217 [2024-10-07 13:35:08.347118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.347143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.347166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.347180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.347199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.347222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.356764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.357152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.357181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.217 [2024-10-07 13:35:08.357198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.357321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.357438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.357497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.357516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.357529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.357642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.357838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.357864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.217 [2024-10-07 13:35:08.357880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.360635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.362210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.362234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.362263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.363139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.366866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.367086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.367114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.217 [2024-10-07 13:35:08.367130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.367559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.367740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.367763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.367777] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.367910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.367936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.368265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.368311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.217 [2024-10-07 13:35:08.368327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.368452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.368590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.368611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.368625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.368737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.377295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.377722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.377752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.217 [2024-10-07 13:35:08.377784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.377850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.377881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.377897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.377910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.377934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.378673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.378893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.378920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.217 [2024-10-07 13:35:08.378936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.379113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.379179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.379198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.379212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.379236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.391986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.392031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.392239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.392267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.217 [2024-10-07 13:35:08.392283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.392388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.392413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.217 [2024-10-07 13:35:08.392429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.392453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.392501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.392526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.392541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.392554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.392572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.392587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.392600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.393124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.393147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.217 [2024-10-07 13:35:08.406337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.406383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.217 [2024-10-07 13:35:08.406587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.406618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.217 [2024-10-07 13:35:08.406636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.406818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.217 [2024-10-07 13:35:08.406844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.217 [2024-10-07 13:35:08.406859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.217 [2024-10-07 13:35:08.406884] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.406905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.217 [2024-10-07 13:35:08.406940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.406959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.217 [2024-10-07 13:35:08.406972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.217 [2024-10-07 13:35:08.406989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.217 [2024-10-07 13:35:08.407003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.407015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.407039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.407060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.416463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.416550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.416800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.416828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.218 [2024-10-07 13:35:08.416845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.421463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.421517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.218 [2024-10-07 13:35:08.421535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.421554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.421874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.421902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.421915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.421928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.422623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.422649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.422663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.422676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.423104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.426572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.426845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.426874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.218 [2024-10-07 13:35:08.426890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.427082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.427292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.427327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.427344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.427356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.427407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.427603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.427632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.218 [2024-10-07 13:35:08.427654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.427851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.427907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.427927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.427940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.427964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.440795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.440842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.441097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.441126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.218 [2024-10-07 13:35:08.441142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.441359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.441385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.218 [2024-10-07 13:35:08.441400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.441424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.441444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.441502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.441523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.441537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.441554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.441568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.441580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.441605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.441622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.451882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.451913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.452179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.452208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.218 [2024-10-07 13:35:08.452224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.452384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.452423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.218 [2024-10-07 13:35:08.452439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.454244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.454288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.454413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.454434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.454447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.454465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.454479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.454521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.454549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.454566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.462007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.462068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.462319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.462348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.218 [2024-10-07 13:35:08.462365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.462572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.462600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.218 [2024-10-07 13:35:08.462616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.462634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.463337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.218 [2024-10-07 13:35:08.463362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.463391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.463404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.463612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.463637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.218 [2024-10-07 13:35:08.463651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.218 [2024-10-07 13:35:08.463664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.218 [2024-10-07 13:35:08.463818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.218 [2024-10-07 13:35:08.472103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.218 [2024-10-07 13:35:08.472390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.218 [2024-10-07 13:35:08.472419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.218 [2024-10-07 13:35:08.472435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.218 [2024-10-07 13:35:08.472472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.472528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.472557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.472573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.472587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.472610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.472855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.472882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.219 [2024-10-07 13:35:08.472897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.472921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.472944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.472958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.472971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.472994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.483852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.483916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.484123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.484151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.219 [2024-10-07 13:35:08.484167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.484325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.484355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.219 [2024-10-07 13:35:08.484370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.484388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.484413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.484430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.484442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.484460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.484509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.484528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.484541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.484554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.484577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.498288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.498319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.498548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.498579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.219 [2024-10-07 13:35:08.498596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.498749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.498789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.219 [2024-10-07 13:35:08.498805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.498829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.498849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.498870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.498884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.498897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.498914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.498928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.498940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.498964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.498980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.508855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.508900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.511006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.511051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.219 [2024-10-07 13:35:08.511068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.511187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.511213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.219 [2024-10-07 13:35:08.511234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.513226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.513258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.513964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.513989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.514018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.514036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.514051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.514064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.514446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.514473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.518979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.519041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.519307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.519338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.219 [2024-10-07 13:35:08.519355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.519504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.519532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.219 [2024-10-07 13:35:08.519548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.519567] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.519594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.519612] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.519625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.519638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.519663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.519682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.519694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.519707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.519730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.529079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.529349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.529380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.219 [2024-10-07 13:35:08.529398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.219 [2024-10-07 13:35:08.529610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.219 [2024-10-07 13:35:08.529682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.219 [2024-10-07 13:35:08.529718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.219 [2024-10-07 13:35:08.529735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.219 [2024-10-07 13:35:08.529748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.219 [2024-10-07 13:35:08.529931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.219 [2024-10-07 13:35:08.530105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.219 [2024-10-07 13:35:08.530134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.219 [2024-10-07 13:35:08.530150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.530202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.530229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.530249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.530263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.530450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.539446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.543503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.543537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.220 [2024-10-07 13:35:08.543554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.544427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.544575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.544610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.544627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.544641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.544666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.544894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.544921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.220 [2024-10-07 13:35:08.544937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.545150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.545291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.545314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.545328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.545515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.549853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.550213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.550242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.220 [2024-10-07 13:35:08.550259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.550398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.550562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.550585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.550600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.550705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.557115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.557357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.557386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.220 [2024-10-07 13:35:08.557402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.557427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.557456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.557495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.557511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.557536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.559936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.560161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.560189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.220 [2024-10-07 13:35:08.560205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.560230] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.560253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.560268] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.560282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.560310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.569163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.571449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.571502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.220 [2024-10-07 13:35:08.571522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.573670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.573813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.573848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.573864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.573877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.573900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.574119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.574146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.220 [2024-10-07 13:35:08.574163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.574187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.574210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.574225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.574237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.574260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.579264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.579519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.579550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.220 [2024-10-07 13:35:08.579567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.579607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.579634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.579649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.579662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.579687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.586121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.588456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.588510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.220 [2024-10-07 13:35:08.588547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.220 [2024-10-07 13:35:08.589372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.220 [2024-10-07 13:35:08.589708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.220 [2024-10-07 13:35:08.589733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.220 [2024-10-07 13:35:08.589748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.220 [2024-10-07 13:35:08.589995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.220 [2024-10-07 13:35:08.590023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.220 [2024-10-07 13:35:08.590277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.220 [2024-10-07 13:35:08.590305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.221 [2024-10-07 13:35:08.590321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.590988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.591269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.591292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.591306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.591532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.597023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.597291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.597321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.221 [2024-10-07 13:35:08.597337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.597562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.599813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.599838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.599867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.600094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.600328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.602286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.602330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.221 [2024-10-07 13:35:08.602347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.603354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.603801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.603830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.603859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.604083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.607118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.607354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.607382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.221 [2024-10-07 13:35:08.607399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.607423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.607446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.607461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.607499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.607526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.610962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.611181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.611209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.221 [2024-10-07 13:35:08.611226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.611250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.611273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.611288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.611300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.611324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.617916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.618192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.618221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.221 [2024-10-07 13:35:08.618238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.618262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.618300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.618318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.618331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.618356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.621060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.621280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.621309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.221 [2024-10-07 13:35:08.621326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.621350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.621372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.621387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.621400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.621424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.631781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.631812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.632068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.632097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.221 [2024-10-07 13:35:08.632113] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.632297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.632323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.221 [2024-10-07 13:35:08.632338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.632363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.632384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.632404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.632418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.632431] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.632448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.632461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.632474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.632522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.632541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.647838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.647871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.221 [2024-10-07 13:35:08.648516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.648560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.221 [2024-10-07 13:35:08.648583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.648802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.221 [2024-10-07 13:35:08.648828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.221 [2024-10-07 13:35:08.648844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.221 [2024-10-07 13:35:08.649236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.649278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.221 [2024-10-07 13:35:08.649511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.649535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.649549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.649567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.221 [2024-10-07 13:35:08.649582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.221 [2024-10-07 13:35:08.649594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.221 [2024-10-07 13:35:08.649813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.649836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.221 [2024-10-07 13:35:08.658239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.658270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.658581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.658613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.222 [2024-10-07 13:35:08.658631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.658806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.658833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.222 [2024-10-07 13:35:08.658848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.658958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.658984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.659105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.659128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.659142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.659159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.659177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.659191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.659309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.659332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.668622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.668660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.668946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.668974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.222 [2024-10-07 13:35:08.668990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.669212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.669238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.222 [2024-10-07 13:35:08.669254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.669278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.669299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.669319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.669333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.669347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.669364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.669379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.669391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.669415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.669431] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.678755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.678820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.679066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.679094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.222 [2024-10-07 13:35:08.679111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.679458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.679509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.222 [2024-10-07 13:35:08.679529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.679548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.679755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.679796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.679826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.679839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.679889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.679910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.679923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.679936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.680111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.693885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.693919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.694117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.694145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.222 [2024-10-07 13:35:08.694162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.694362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.694388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.222 [2024-10-07 13:35:08.694403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.694427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.694448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.694484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.694510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.694523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.694540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.694555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.694568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.694592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.694609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.704414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.704446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.708735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.708783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.222 [2024-10-07 13:35:08.708800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.708974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.708999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.222 [2024-10-07 13:35:08.709014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.709089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.709115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.222 [2024-10-07 13:35:08.709137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.709151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.709164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.709191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.222 [2024-10-07 13:35:08.709206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.222 [2024-10-07 13:35:08.709218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.222 [2024-10-07 13:35:08.709242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.709258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.222 [2024-10-07 13:35:08.714808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.714839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.222 [2024-10-07 13:35:08.715179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.715208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.222 [2024-10-07 13:35:08.715224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.222 [2024-10-07 13:35:08.715383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.222 [2024-10-07 13:35:08.715408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.222 [2024-10-07 13:35:08.715424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.716414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.716457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.716703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.716728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.716742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.716760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.716774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.716787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.716943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.716971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.725378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.725810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.726034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.726062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.223 [2024-10-07 13:35:08.726079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.726517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.726546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.223 [2024-10-07 13:35:08.726563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.726582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.726635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.726657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.726670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.726683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.726709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.726727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.726740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.726752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.726774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.738087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.738119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.738521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.738553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.223 [2024-10-07 13:35:08.738570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.738744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.738771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.223 [2024-10-07 13:35:08.738802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.739003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.739031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.739225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.739253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.739268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.739285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.739299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.739312] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.739361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.739381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.753205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.753250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.753547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.753578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.223 [2024-10-07 13:35:08.753596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.753750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.753777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.223 [2024-10-07 13:35:08.753806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.753831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.753851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.753872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.753898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.753911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.753927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.753941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.753953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.753978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.753995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 8543.00 IOPS, 33.37 MiB/s [2024-10-07T11:35:19.156Z] [2024-10-07 13:35:08.763762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.763808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.764108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.764138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.223 [2024-10-07 13:35:08.764155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.764353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.764392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.223 [2024-10-07 13:35:08.764408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.764546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.764574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.764683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.764704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.764718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.764736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.764751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.223 [2024-10-07 13:35:08.764764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.223 [2024-10-07 13:35:08.764894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.764914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.223 [2024-10-07 13:35:08.774730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.774764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.223 [2024-10-07 13:35:08.775086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.775118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.223 [2024-10-07 13:35:08.775135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.775284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.223 [2024-10-07 13:35:08.775311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.223 [2024-10-07 13:35:08.775337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.223 [2024-10-07 13:35:08.775450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.775477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.223 [2024-10-07 13:35:08.775604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.223 [2024-10-07 13:35:08.775626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.775640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.775657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.775672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.775692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.775809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.775830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.784853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.784903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.785116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.785146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.224 [2024-10-07 13:35:08.785164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.785335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.785374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.224 [2024-10-07 13:35:08.785390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.785408] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.785434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.785453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.785467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.785479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.785516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.785536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.785549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.785561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.785583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.797670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.797704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.798076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.798107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.224 [2024-10-07 13:35:08.798124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.798214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.798240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.224 [2024-10-07 13:35:08.798255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.798452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.798507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.798710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.798744] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.798764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.798797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.798812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.798824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.798875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.798894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.812673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.812721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.813161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.813206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.224 [2024-10-07 13:35:08.813223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.813395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.813421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.224 [2024-10-07 13:35:08.813436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.813801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.813845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.814052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.814075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.814089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.814105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.814119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.814132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.814182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.814202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.828022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.828053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.828262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.828292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.224 [2024-10-07 13:35:08.828308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.828521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.828550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.224 [2024-10-07 13:35:08.828571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.828597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.828618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.224 [2024-10-07 13:35:08.828639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.828654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.828667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.828685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.224 [2024-10-07 13:35:08.828704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.224 [2024-10-07 13:35:08.828717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.224 [2024-10-07 13:35:08.828741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.828758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.224 [2024-10-07 13:35:08.840969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.841012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.224 [2024-10-07 13:35:08.841280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.841310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.224 [2024-10-07 13:35:08.841327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.841453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.224 [2024-10-07 13:35:08.841502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.224 [2024-10-07 13:35:08.841520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.224 [2024-10-07 13:35:08.841634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.841660] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.841769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.841806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.841821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.841837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.841851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.841863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.842101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.842126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.851312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.851348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.851502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.851532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.225 [2024-10-07 13:35:08.851549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.851684] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.851711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.225 [2024-10-07 13:35:08.851728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.851753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.851789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.851810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.851825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.851837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.851855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.851869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.851881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.851905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.851921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.861440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.861683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.861874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.861903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.225 [2024-10-07 13:35:08.861919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.862259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.862302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.225 [2024-10-07 13:35:08.862319] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.862351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.862402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.862422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.862435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.862448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.862504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.862525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.862538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.862550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.862574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.874767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.874817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.875155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.875185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.225 [2024-10-07 13:35:08.875202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.875328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.875353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.225 [2024-10-07 13:35:08.875368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.875633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.875663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.875880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.875904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.875918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.875935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.875949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.875961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.876160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.876183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.889606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.889654] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.889938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.889968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.225 [2024-10-07 13:35:08.889985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.890146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.890171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.225 [2024-10-07 13:35:08.890187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.890216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.890237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.890272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.890290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.890304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.890321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.890335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.890347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.890370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.890386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.225 [2024-10-07 13:35:08.903325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.903372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.225 [2024-10-07 13:35:08.903759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.903805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.225 [2024-10-07 13:35:08.903822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.903960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.225 [2024-10-07 13:35:08.903986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.225 [2024-10-07 13:35:08.904001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.225 [2024-10-07 13:35:08.904198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.904226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.225 [2024-10-07 13:35:08.904446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.904494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.904521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.225 [2024-10-07 13:35:08.904542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.225 [2024-10-07 13:35:08.904556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.225 [2024-10-07 13:35:08.904570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.904622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.904642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.917838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.917869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.918053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.918081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.226 [2024-10-07 13:35:08.918098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.918231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.918256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.226 [2024-10-07 13:35:08.918272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.918297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.918317] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.918337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.918352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.918364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.918381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.918395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.918407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.918430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.918446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.928241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.928287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.928515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.928546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.226 [2024-10-07 13:35:08.928564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.928693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.928719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.226 [2024-10-07 13:35:08.928735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.932120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.932149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.933010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.933052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.933067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.933084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.933103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.933117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.933215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.933235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.939293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.939323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.939534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.939564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.226 [2024-10-07 13:35:08.939581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.939692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.939719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.226 [2024-10-07 13:35:08.939735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.939760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.939781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.939818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.939833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.939845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.939861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.939875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.939888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.939911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.939927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.949419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.949481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.949662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.949690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.226 [2024-10-07 13:35:08.949707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.950036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.950064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.226 [2024-10-07 13:35:08.950081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.950099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.950169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.950191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.950204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.950216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.950240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.950257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.950269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.950282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.950304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.963521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.963570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.963705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.963735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.226 [2024-10-07 13:35:08.963752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.963894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.963920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.226 [2024-10-07 13:35:08.963936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.226 [2024-10-07 13:35:08.963960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.963981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.226 [2024-10-07 13:35:08.964001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.964016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.964029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.964046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.226 [2024-10-07 13:35:08.964060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.226 [2024-10-07 13:35:08.964073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.226 [2024-10-07 13:35:08.964096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.964113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.226 [2024-10-07 13:35:08.978850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.978882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.226 [2024-10-07 13:35:08.979316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.226 [2024-10-07 13:35:08.979346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.226 [2024-10-07 13:35:08.979382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:08.979535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:08.979562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.227 [2024-10-07 13:35:08.979578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:08.979836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:08.979872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:08.980070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:08.980092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:08.980106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:08.980123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:08.980137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:08.980150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:08.980199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:08.980219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:08.989240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:08.989287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:08.989556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:08.989589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.227 [2024-10-07 13:35:08.989606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:08.989704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:08.989730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.227 [2024-10-07 13:35:08.989746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:08.992685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:08.992732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:08.993645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:08.993670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:08.993699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:08.993717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:08.993732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:08.993764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:08.994171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:08.994195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:08.999368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:08.999429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:08.999613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:08.999642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.227 [2024-10-07 13:35:08.999659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:08.999777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:08.999818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.227 [2024-10-07 13:35:08.999834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:08.999852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:08.999876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:08.999893] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:08.999905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:08.999918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:08.999942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:08.999958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:08.999970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:08.999982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:09.000003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:09.009480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:09.009652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:09.009682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.227 [2024-10-07 13:35:09.009699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:09.009909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:09.009970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:09.010003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:09.010020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:09.010033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:09.010057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:09.010193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:09.010219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.227 [2024-10-07 13:35:09.010235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:09.010412] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:09.010482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:09.010514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:09.010529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:09.010555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:09.023905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:09.023952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:09.024121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:09.024151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.227 [2024-10-07 13:35:09.024168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:09.024297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:09.024322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.227 [2024-10-07 13:35:09.024338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:09.024363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:09.024383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:09.024404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:09.024420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:09.024433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:09.024450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:09.024465] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.227 [2024-10-07 13:35:09.024478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.227 [2024-10-07 13:35:09.024516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:09.024534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.227 [2024-10-07 13:35:09.034916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:09.034950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.227 [2024-10-07 13:35:09.039395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:09.039427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.227 [2024-10-07 13:35:09.039445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:09.039552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.227 [2024-10-07 13:35:09.039577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.227 [2024-10-07 13:35:09.039593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.227 [2024-10-07 13:35:09.039671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:09.039698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.227 [2024-10-07 13:35:09.039720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.227 [2024-10-07 13:35:09.039735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.039748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.039766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.039781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.039794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.039827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.039843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.045480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.045520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.045727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.045757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.228 [2024-10-07 13:35:09.045774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.045950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.045975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.228 [2024-10-07 13:35:09.045991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.046015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.046035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.046055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.046070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.046083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.046099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.046113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.046126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.047090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.047115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.055606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.055656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.055836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.055864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.228 [2024-10-07 13:35:09.055881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.056177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.056205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.228 [2024-10-07 13:35:09.056221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.056239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.056290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.056311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.056324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.056336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.056544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.056570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.056584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.056598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.056648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.068597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.068628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.068811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.068838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.228 [2024-10-07 13:35:09.068855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.069002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.069027] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.228 [2024-10-07 13:35:09.069042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.069067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.069087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.069108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.069127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.069140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.069157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.069171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.069184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.069207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.069223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.081437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.081483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.082636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.082682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.228 [2024-10-07 13:35:09.082700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.082828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.082855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.228 [2024-10-07 13:35:09.082870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.084311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.084354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.085076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.085100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.085128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.085145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.085160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.085172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.085562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.085587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.091574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.091621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.228 [2024-10-07 13:35:09.091762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.091805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.228 [2024-10-07 13:35:09.091822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.094144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.228 [2024-10-07 13:35:09.094188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.228 [2024-10-07 13:35:09.094206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.228 [2024-10-07 13:35:09.094224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.098227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.228 [2024-10-07 13:35:09.098269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.098283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.098297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.099016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.228 [2024-10-07 13:35:09.099041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.228 [2024-10-07 13:35:09.099071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.228 [2024-10-07 13:35:09.099085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.228 [2024-10-07 13:35:09.099509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.101660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.101869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.101897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.229 [2024-10-07 13:35:09.101914] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.101950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.101982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.102009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.102025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.102037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.102060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.102187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.102213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.229 [2024-10-07 13:35:09.102229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.102253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.102291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.102309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.102322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.102346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.114224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.114271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.114484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.114521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.229 [2024-10-07 13:35:09.114538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.114694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.114721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.229 [2024-10-07 13:35:09.114737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.114946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.114974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.115162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.115186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.115200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.115217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.115232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.115244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.115287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.115307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.128004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.128036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.128441] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.128494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.229 [2024-10-07 13:35:09.128512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.128612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.128637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.229 [2024-10-07 13:35:09.128653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.128933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.128961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.129155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.129178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.129197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.129215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.129230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.129242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.129291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.129311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.141702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.141734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.142126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.142170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.229 [2024-10-07 13:35:09.142186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.142320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.142345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.229 [2024-10-07 13:35:09.142360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.142586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.142616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.142870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.142894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.142907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.142924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.142939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.142951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.143004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.143024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.229 [2024-10-07 13:35:09.153208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.153253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.229 [2024-10-07 13:35:09.153513] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.153545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.229 [2024-10-07 13:35:09.153562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.153655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.229 [2024-10-07 13:35:09.153680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.229 [2024-10-07 13:35:09.153702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.229 [2024-10-07 13:35:09.153843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.153870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.229 [2024-10-07 13:35:09.156644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.229 [2024-10-07 13:35:09.156669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.229 [2024-10-07 13:35:09.156699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.229 [2024-10-07 13:35:09.156717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.156732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.156745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.157577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.157601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.163333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.163394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.163561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.163591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.230 [2024-10-07 13:35:09.163608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.163735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.163762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.230 [2024-10-07 13:35:09.163778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.163796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.163851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.163871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.163884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.163896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.163920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.163937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.163949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.163961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.163983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.173430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.173640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.173670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.230 [2024-10-07 13:35:09.173687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.173723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.173783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.173814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.173829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.173842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.173865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.174014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.174040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.230 [2024-10-07 13:35:09.174056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.174080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.174102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.174117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.174130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.174153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.186067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.186113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.186429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.186459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.230 [2024-10-07 13:35:09.186501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.186595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.186621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.230 [2024-10-07 13:35:09.186637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.186687] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.186712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.186733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.186749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.186762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.186799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.186815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.186828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.186852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.186868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.197345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.197392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.197626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.197656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.230 [2024-10-07 13:35:09.197673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.197834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.197858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.230 [2024-10-07 13:35:09.197873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.197984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.198010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.200155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.200180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.200209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.200226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.200241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.200253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.201088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.201112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.207470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.207652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.207772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.207815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.230 [2024-10-07 13:35:09.207832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.208030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.208057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.230 [2024-10-07 13:35:09.208073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.230 [2024-10-07 13:35:09.208096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.208214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.230 [2024-10-07 13:35:09.208237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.208250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.208263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.208371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.208393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.230 [2024-10-07 13:35:09.208406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.230 [2024-10-07 13:35:09.208418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.230 [2024-10-07 13:35:09.208555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.230 [2024-10-07 13:35:09.217575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.230 [2024-10-07 13:35:09.217788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.230 [2024-10-07 13:35:09.217817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.231 [2024-10-07 13:35:09.217833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.217857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.217894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.217913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.217926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.217951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.217970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.218105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.218132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.231 [2024-10-07 13:35:09.218148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.218171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.218194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.218209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.218221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.218245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.229873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.229905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.230121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.230150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.231 [2024-10-07 13:35:09.230167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.230297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.230322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.231 [2024-10-07 13:35:09.230337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.230361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.230382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.230403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.230417] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.230430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.230447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.230461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.230500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.230528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.230545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.242090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.242121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.243900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.243945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.231 [2024-10-07 13:35:09.243963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.244052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.244076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.231 [2024-10-07 13:35:09.244091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.244775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.244820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.245065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.245089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.245103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.245120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.245140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.245154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.245352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.245375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.252953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.252999] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.253259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.253289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.231 [2024-10-07 13:35:09.253306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.253446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.253495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.231 [2024-10-07 13:35:09.253514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.253625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.253652] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.253774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.253797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.253826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.253843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.253857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.253869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.253979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.254001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.263349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.263379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.263570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.263601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.231 [2024-10-07 13:35:09.263618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.263715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.263741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.231 [2024-10-07 13:35:09.263758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.263797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.263824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.231 [2024-10-07 13:35:09.263846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.263861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.263873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.263890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.231 [2024-10-07 13:35:09.263903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.231 [2024-10-07 13:35:09.263915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.231 [2024-10-07 13:35:09.263939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.263955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.231 [2024-10-07 13:35:09.273610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.273642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.231 [2024-10-07 13:35:09.274094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.274123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.231 [2024-10-07 13:35:09.274155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.274256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.231 [2024-10-07 13:35:09.274282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.231 [2024-10-07 13:35:09.274298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.231 [2024-10-07 13:35:09.274512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.274541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.274605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.274628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.274643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.274660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.274675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.274688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.275141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.275166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.289103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.289149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.289647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.289687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.232 [2024-10-07 13:35:09.289705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.289865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.289892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.232 [2024-10-07 13:35:09.289907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.290406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.290435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.290712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.290737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.290751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.290769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.290784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.290797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.291010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.291033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.299817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.299864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.300138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.300167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.232 [2024-10-07 13:35:09.300182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.300302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.300327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.232 [2024-10-07 13:35:09.300342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.300481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.300523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.300644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.300666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.300680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.300698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.300712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.300731] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.300857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.300880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.309943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.310005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.310116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.310144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.232 [2024-10-07 13:35:09.310160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.310503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.310549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.232 [2024-10-07 13:35:09.310566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.310584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.310736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.310760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.310790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.310804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.310927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.310950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.310963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.310976] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.311084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.320041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.320365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.320396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.232 [2024-10-07 13:35:09.320413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.320503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.320538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.320568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.320584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.320598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.320833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.320973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.321001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.232 [2024-10-07 13:35:09.321017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.321234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.321290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.321311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.321324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.321348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.330320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.333683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.333728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.232 [2024-10-07 13:35:09.333747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.334702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.232 [2024-10-07 13:35:09.335145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.232 [2024-10-07 13:35:09.335202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.232 [2024-10-07 13:35:09.335219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.232 [2024-10-07 13:35:09.335233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.232 [2024-10-07 13:35:09.335504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.232 [2024-10-07 13:35:09.335620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.232 [2024-10-07 13:35:09.335648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.232 [2024-10-07 13:35:09.335665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.232 [2024-10-07 13:35:09.335886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.336097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.336124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.336138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.336188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.340418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.340660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.340689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.233 [2024-10-07 13:35:09.340706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.340736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.340761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.340776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.340789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.340813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.349989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.350189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.350218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.233 [2024-10-07 13:35:09.350235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.350259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.350283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.350297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.350310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.350334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.350531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.350668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.350695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.233 [2024-10-07 13:35:09.350711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.350736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.350760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.350774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.350788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.350827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.360088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.360301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.360330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.233 [2024-10-07 13:35:09.360346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.362874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.365706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.365733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.365768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.366652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.366682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.367315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.367357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.233 [2024-10-07 13:35:09.367374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.367453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.367481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.367532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.367547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.367810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.370195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.370372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.370399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.233 [2024-10-07 13:35:09.370415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.370439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.370463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.370514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.370529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.370554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.382923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.383203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.383352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.383380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.233 [2024-10-07 13:35:09.383397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.383799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.383828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.233 [2024-10-07 13:35:09.383844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.383877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.384077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.384103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.384130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.384143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.384360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.384385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.233 [2024-10-07 13:35:09.384399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.233 [2024-10-07 13:35:09.384412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.233 [2024-10-07 13:35:09.384463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.233 [2024-10-07 13:35:09.398066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.398099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.233 [2024-10-07 13:35:09.398446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.398498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.233 [2024-10-07 13:35:09.398518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.398613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.233 [2024-10-07 13:35:09.398639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.233 [2024-10-07 13:35:09.398654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.233 [2024-10-07 13:35:09.398995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.399023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.233 [2024-10-07 13:35:09.399080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.399099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.399112] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.399129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.399143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.399155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.399325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.399347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.412333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.412364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.412539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.412568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.234 [2024-10-07 13:35:09.412585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.412713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.412739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.234 [2024-10-07 13:35:09.412756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.412795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.412815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.412836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.412851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.412864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.412881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.412895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.412907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.412930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.412946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.427547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.427582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.428643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.428685] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.234 [2024-10-07 13:35:09.428702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.428833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.428858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.234 [2024-10-07 13:35:09.428873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.429406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.429434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.429546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.429567] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.429581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.429599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.429614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.429627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.429651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.429668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.442925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.442956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.443152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.443181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.234 [2024-10-07 13:35:09.443197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.443314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.443339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.234 [2024-10-07 13:35:09.443354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.443378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.443399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.443429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.443443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.443456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.443498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.443516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.443530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.443556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.443573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.456744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.456777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.457031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.457059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.234 [2024-10-07 13:35:09.457076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.457189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.457215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.234 [2024-10-07 13:35:09.457231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.457256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.457276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.457297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.457311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.457330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.457348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.457362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.457374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.457398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.457414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.234 [2024-10-07 13:35:09.470452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.470513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.234 [2024-10-07 13:35:09.472693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.472725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.234 [2024-10-07 13:35:09.472743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.472884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.234 [2024-10-07 13:35:09.472920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.234 [2024-10-07 13:35:09.472935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.234 [2024-10-07 13:35:09.473607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.473644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.234 [2024-10-07 13:35:09.474048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.474075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.474088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.474105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.234 [2024-10-07 13:35:09.474120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.234 [2024-10-07 13:35:09.474133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.234 [2024-10-07 13:35:09.474195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.474215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.482573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.482606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.483019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.483049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.235 [2024-10-07 13:35:09.483073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.483168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.483193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.235 [2024-10-07 13:35:09.483213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.487065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.487102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.487922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.487947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.487962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.487980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.487994] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.488006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.488468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.488520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.492920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.492951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.493208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.493237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.235 [2024-10-07 13:35:09.493253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.493387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.493413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.235 [2024-10-07 13:35:09.493428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.493452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.493500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.493525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.493541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.493554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.493570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.493585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.493599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.493623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.493640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.503077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.503119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.503322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.503359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.235 [2024-10-07 13:35:09.503375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.503533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.503561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.235 [2024-10-07 13:35:09.503577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.503770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.503814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.504011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.504034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.504048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.504065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.504080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.504093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.504156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.504177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.518466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.518530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.518868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.518899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.235 [2024-10-07 13:35:09.518916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.519042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.519066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.235 [2024-10-07 13:35:09.519082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.519274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.519302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.519526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.519566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.519581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.519606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.519622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.519636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.519876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.519900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.533597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.533631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.533936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.533968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.235 [2024-10-07 13:35:09.533985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.534107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.534133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.235 [2024-10-07 13:35:09.534150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.235 [2024-10-07 13:35:09.534176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.534197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.235 [2024-10-07 13:35:09.534234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.534253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.534267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.534285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.235 [2024-10-07 13:35:09.534311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.235 [2024-10-07 13:35:09.534324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.235 [2024-10-07 13:35:09.534348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.534365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.235 [2024-10-07 13:35:09.544243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.544284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.235 [2024-10-07 13:35:09.544576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.235 [2024-10-07 13:35:09.544608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.235 [2024-10-07 13:35:09.544627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.544740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.544768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.236 [2024-10-07 13:35:09.544785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.544904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.544937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.547166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.547192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.547206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.547224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.547238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.547251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.548126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.548151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.554381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.554427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.554611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.554641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.236 [2024-10-07 13:35:09.554657] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.554755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.554782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.236 [2024-10-07 13:35:09.554798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.554832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.554857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.554875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.554895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.554908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.554931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.554948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.554960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.554973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.555001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.564914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.564945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.565294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.565324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.236 [2024-10-07 13:35:09.565341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.565425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.565451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.236 [2024-10-07 13:35:09.565467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.565700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.565730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.565777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.565803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.565832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.565849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.565863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.565876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.565900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.565916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.576316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.576350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.576813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.576843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.236 [2024-10-07 13:35:09.576865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.576968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.576992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.236 [2024-10-07 13:35:09.577008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.577203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.577238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.577748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.577790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.577805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.577822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.577843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.577856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.578072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.578094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.592304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.592341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.592768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.592813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.236 [2024-10-07 13:35:09.592830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.592949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.592975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.236 [2024-10-07 13:35:09.592991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.593335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.593368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.593597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.593622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.593636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.593654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.236 [2024-10-07 13:35:09.593676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.236 [2024-10-07 13:35:09.593689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.236 [2024-10-07 13:35:09.593739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.593760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.236 [2024-10-07 13:35:09.607350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.607383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.236 [2024-10-07 13:35:09.608024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.608054] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.236 [2024-10-07 13:35:09.608070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.608220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.236 [2024-10-07 13:35:09.608246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.236 [2024-10-07 13:35:09.608261] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.236 [2024-10-07 13:35:09.608502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.608553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.236 [2024-10-07 13:35:09.608749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.608787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.608802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.608819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.608834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.608846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.609037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.609060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.622551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.622584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.622734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.622762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.237 [2024-10-07 13:35:09.622794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.622888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.622914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.237 [2024-10-07 13:35:09.622930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.622954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.622975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.622995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.623018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.623032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.623048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.623062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.623075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.623098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.623115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.633143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.633183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.637505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.637543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.237 [2024-10-07 13:35:09.637561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.637682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.637707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.237 [2024-10-07 13:35:09.637723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.637823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.637851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.637873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.637888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.637901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.637928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.637942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.637955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.637984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.638000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.643410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.643441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.643670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.643701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.237 [2024-10-07 13:35:09.643718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.643877] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.643903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.237 [2024-10-07 13:35:09.643918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.643954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.643974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.643995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.644009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.644023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.644039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.644058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.644075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.645080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.645105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.653647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.653680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.653910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.653938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.237 [2024-10-07 13:35:09.653955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.654045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.654070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.237 [2024-10-07 13:35:09.654085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.654257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.654285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.237 [2024-10-07 13:35:09.654510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.654534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.654549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.654566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.237 [2024-10-07 13:35:09.654580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.237 [2024-10-07 13:35:09.654594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.237 [2024-10-07 13:35:09.654644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.654664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.237 [2024-10-07 13:35:09.666827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.666860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.237 [2024-10-07 13:35:09.667260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.667290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.237 [2024-10-07 13:35:09.667307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.237 [2024-10-07 13:35:09.667429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.237 [2024-10-07 13:35:09.667455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.237 [2024-10-07 13:35:09.667494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.667548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.667575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.667859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.667894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.667908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.667925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.667939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.667952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.668024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.668045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.677995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.678028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.678221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.678250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.238 [2024-10-07 13:35:09.678267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.678378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.678404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.238 [2024-10-07 13:35:09.678419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.681244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.681276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.682228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.682270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.682293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.682311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.682326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.682340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.682917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.682943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.688105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.688150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.688325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.688354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.238 [2024-10-07 13:35:09.688375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.688516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.688544] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.238 [2024-10-07 13:35:09.688560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.688579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.688605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.688623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.688636] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.688649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.688673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.688691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.688704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.688717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.688739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.698459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.698524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.698735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.698764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.238 [2024-10-07 13:35:09.698781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.699006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.699031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.238 [2024-10-07 13:35:09.699058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.699082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.699102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.699127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.699142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.699155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.699172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.699186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.699199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.699228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.699249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.710938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.710974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.711337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.711366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.238 [2024-10-07 13:35:09.711384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.711495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.711524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.238 [2024-10-07 13:35:09.711540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.711918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.711947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.712158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.712181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.712195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.712212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.712226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.712239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.238 [2024-10-07 13:35:09.712288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.712307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.238 [2024-10-07 13:35:09.725682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.725715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.238 [2024-10-07 13:35:09.725925] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.725953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.238 [2024-10-07 13:35:09.725970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.726051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.238 [2024-10-07 13:35:09.726075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.238 [2024-10-07 13:35:09.726090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.238 [2024-10-07 13:35:09.726547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.726576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.238 [2024-10-07 13:35:09.726807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.238 [2024-10-07 13:35:09.726846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.238 [2024-10-07 13:35:09.726861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.726878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.726893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.726905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.727096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.727120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.740264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.740296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.740446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.740498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.239 [2024-10-07 13:35:09.740518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.740688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.740716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.239 [2024-10-07 13:35:09.740733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.740758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.740797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.740819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.740834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.740867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.740884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.740898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.740911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.740944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.740960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.756023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.756056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.756305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.756335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.239 [2024-10-07 13:35:09.756352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.756549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.756577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.239 [2024-10-07 13:35:09.756593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.757044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.757072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.757294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.757316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.757330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.757347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.757361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.757374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.757422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.757441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 8558.57 IOPS, 33.43 MiB/s [2024-10-07T11:35:19.172Z] [2024-10-07 13:35:09.771081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.771113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.771358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.771387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.239 [2024-10-07 13:35:09.771403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.771552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.771580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.239 [2024-10-07 13:35:09.771597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.771789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.771818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.772014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.772037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.772051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.772068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.772082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.772095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.772162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.772188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.787468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.787524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.787905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.787936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.239 [2024-10-07 13:35:09.787954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.788125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.788151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.239 [2024-10-07 13:35:09.788168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.788372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.788402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.788640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.788666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.788682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.788700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.788715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.788729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.788785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.788806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.802748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.802797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.802959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.802989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.239 [2024-10-07 13:35:09.803006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.803092] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.239 [2024-10-07 13:35:09.803118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.239 [2024-10-07 13:35:09.803134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.239 [2024-10-07 13:35:09.803158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.803179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.239 [2024-10-07 13:35:09.803199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.803219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.803244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.803260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.239 [2024-10-07 13:35:09.803275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.239 [2024-10-07 13:35:09.803287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.239 [2024-10-07 13:35:09.803311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.803332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.239 [2024-10-07 13:35:09.813255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.239 [2024-10-07 13:35:09.813288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.816080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.816112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.240 [2024-10-07 13:35:09.816130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.816306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.816332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.240 [2024-10-07 13:35:09.816347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.817911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.817942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.817999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.818018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.818031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.818049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.818064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.818078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.818101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.818117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.823367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.823414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.823590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.823618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.240 [2024-10-07 13:35:09.823636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.823773] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.823819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.240 [2024-10-07 13:35:09.823836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.823854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.823894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.823914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.823927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.823940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.823965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.823983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.823997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.824009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.824047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.833452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.833676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.833707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.240 [2024-10-07 13:35:09.833724] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.833927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.833990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.834023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.834039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.834052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.834075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.834303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.834328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.240 [2024-10-07 13:35:09.834344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.834544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.834607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.834627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.834641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.834666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.846954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.846988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.847210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.847238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.240 [2024-10-07 13:35:09.847254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.847373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.847410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.240 [2024-10-07 13:35:09.847426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.847450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.847500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.847525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.847540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.847553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.847571] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.847586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.847599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.847623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.847640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.860721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.860764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.861039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.861068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.240 [2024-10-07 13:35:09.861085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.861216] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.861242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.240 [2024-10-07 13:35:09.861258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.861283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.861304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.240 [2024-10-07 13:35:09.861324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.861339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.861358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.861375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.240 [2024-10-07 13:35:09.861391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.240 [2024-10-07 13:35:09.861403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.240 [2024-10-07 13:35:09.861426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.861443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.240 [2024-10-07 13:35:09.871856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.871889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.240 [2024-10-07 13:35:09.872181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.872212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.240 [2024-10-07 13:35:09.872230] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.240 [2024-10-07 13:35:09.872413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.240 [2024-10-07 13:35:09.872439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.240 [2024-10-07 13:35:09.872454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.874267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.874298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.874382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.874402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.874417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.874434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.874448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.874476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.874511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.874529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.881966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.882013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.882211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.882238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.241 [2024-10-07 13:35:09.882254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.884422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.884453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.241 [2024-10-07 13:35:09.884500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.884523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.888127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.888157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.888172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.888185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.889334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.889361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.889375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.889388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.890075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.892167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.892196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.892439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.892481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.241 [2024-10-07 13:35:09.892507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.892737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.892765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.241 [2024-10-07 13:35:09.892797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.892823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.892844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.892892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.892907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.892920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.892937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.892951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.892963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.892987] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.893003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.904329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.904368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.904906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.904954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.241 [2024-10-07 13:35:09.904973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.905110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.905136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.241 [2024-10-07 13:35:09.905154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.905389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.905417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.905643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.905667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.905682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.905699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.905715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.905728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.905778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.905814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.914448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.914521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.914708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.914737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.241 [2024-10-07 13:35:09.914755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.917416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.917446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.241 [2024-10-07 13:35:09.917478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.917506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.920832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.920861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.920876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.920889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.921390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.921426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.921441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.921455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.921744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.241 [2024-10-07 13:35:09.924536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.924732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.241 [2024-10-07 13:35:09.924761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.241 [2024-10-07 13:35:09.924778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.241 [2024-10-07 13:35:09.924830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.241 [2024-10-07 13:35:09.924860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.241 [2024-10-07 13:35:09.924888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.241 [2024-10-07 13:35:09.924905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.241 [2024-10-07 13:35:09.924918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.241 [2024-10-07 13:35:09.924940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.925160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.925186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.242 [2024-10-07 13:35:09.925201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.925226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.925249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.925264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.925277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.925300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.936324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.936358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.936521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.936552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.242 [2024-10-07 13:35:09.936569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.936657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.936683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.242 [2024-10-07 13:35:09.936699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.936729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.936751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.936772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.936801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.936815] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.936832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.936846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.936860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.936883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.936899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.947005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.947038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.951149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.951182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.242 [2024-10-07 13:35:09.951199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.951391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.951416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.242 [2024-10-07 13:35:09.951432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.952197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.952229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.952319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.952339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.952353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.952370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.952385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.952398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.952422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.952438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.957761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.957807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.958079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.958113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.242 [2024-10-07 13:35:09.958131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.958263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.958301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.242 [2024-10-07 13:35:09.958317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.958341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.958362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.958382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.958397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.958410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.958426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.958441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.958454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.958477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.958531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.967886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.967934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.968178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.968206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.242 [2024-10-07 13:35:09.968223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.968387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.968413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.242 [2024-10-07 13:35:09.968429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.968447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.968473] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.242 [2024-10-07 13:35:09.968515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.968531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.968545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.968570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.968588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.242 [2024-10-07 13:35:09.968606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.242 [2024-10-07 13:35:09.968620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.242 [2024-10-07 13:35:09.968655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.242 [2024-10-07 13:35:09.979846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.979879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.242 [2024-10-07 13:35:09.980228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.980260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.242 [2024-10-07 13:35:09.980277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.242 [2024-10-07 13:35:09.980411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.242 [2024-10-07 13:35:09.980437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.242 [2024-10-07 13:35:09.980453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:09.980676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:09.980705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:09.980753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:09.980772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:09.980786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:09.980819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:09.980834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:09.980846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:09.981018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:09.981040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:09.994147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:09.994180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:09.994336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:09.994365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.243 [2024-10-07 13:35:09.994382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:09.994509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:09.994535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.243 [2024-10-07 13:35:09.994552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:09.994577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:09.994604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:09.994626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:09.994641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:09.994654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:09.994671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:09.994686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:09.994700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:09.994724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:09.994741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:10.004260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.004314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.004565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.004595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.243 [2024-10-07 13:35:10.004613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.004727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.004756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.243 [2024-10-07 13:35:10.004773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.004793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.004820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.004839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:10.004853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:10.004867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:10.004892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:10.004911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:10.004925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:10.004940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:10.007415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:10.014664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.014699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.014897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.014927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.243 [2024-10-07 13:35:10.014951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.015093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.015121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.243 [2024-10-07 13:35:10.015152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.015180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.015203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.015225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:10.015241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:10.015255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:10.015273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:10.015289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:10.015303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:10.015328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:10.015346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:10.028126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.028173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.028361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.028392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.243 [2024-10-07 13:35:10.028411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.028560] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.028589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.243 [2024-10-07 13:35:10.028623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.028668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.028696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.028846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:10.028873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:10.028891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:10.028910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:10.028928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:10.028944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.243 [2024-10-07 13:35:10.029139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:10.029170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.243 [2024-10-07 13:35:10.038461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.038519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.243 [2024-10-07 13:35:10.038824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.038870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.243 [2024-10-07 13:35:10.038889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.039002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.243 [2024-10-07 13:35:10.039045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.243 [2024-10-07 13:35:10.039073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.243 [2024-10-07 13:35:10.043107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.043143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.243 [2024-10-07 13:35:10.044156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.243 [2024-10-07 13:35:10.044183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.243 [2024-10-07 13:35:10.044197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.044230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.044249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.044264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.044723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.044764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.048603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.048652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.048810] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.048841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.244 [2024-10-07 13:35:10.048859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.048980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.049008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.244 [2024-10-07 13:35:10.049038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.049072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.049098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.049122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.049137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.049150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.049180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.049200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.049217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.049231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.049255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.060889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.060926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.061111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.061140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.244 [2024-10-07 13:35:10.061166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.061270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.061306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.244 [2024-10-07 13:35:10.061323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.061349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.061387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.061409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.061424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.061438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.061455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.061497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.061514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.061541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.061559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.071795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.071846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.074797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.074829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.244 [2024-10-07 13:35:10.074847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.074980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.075005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.244 [2024-10-07 13:35:10.075021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.076552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.076585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.076644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.076665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.076679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.076698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.076713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.076727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.076753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.076784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.081927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.081973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.082134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.082162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.244 [2024-10-07 13:35:10.082179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.082313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.082340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.244 [2024-10-07 13:35:10.082356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.082374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.082399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.082416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.082430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.082443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.083145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.083171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.083185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.083198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.083653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.092134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.092166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.244 [2024-10-07 13:35:10.092292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.092319] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.244 [2024-10-07 13:35:10.092335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.092469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.244 [2024-10-07 13:35:10.092515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.244 [2024-10-07 13:35:10.092534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.244 [2024-10-07 13:35:10.092713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.092741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.244 [2024-10-07 13:35:10.092789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.092822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.092835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.092853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.244 [2024-10-07 13:35:10.092867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.244 [2024-10-07 13:35:10.092879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.244 [2024-10-07 13:35:10.093071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.244 [2024-10-07 13:35:10.093094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.105282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.105313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.105482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.105520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.245 [2024-10-07 13:35:10.105537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.105633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.105658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.245 [2024-10-07 13:35:10.105673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.105699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.105720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.105742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.105763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.105792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.105809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.105827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.105840] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.105864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.105880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.116032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.116064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.116355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.116386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.245 [2024-10-07 13:35:10.116404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.116600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.116628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.245 [2024-10-07 13:35:10.116645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.116757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.116807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.116919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.116940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.116954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.116971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.116992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.117005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.119872] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.119899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.126307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.126434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.126588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.126618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.245 [2024-10-07 13:35:10.126636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.126850] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.126883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.245 [2024-10-07 13:35:10.126900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.126918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.129889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.129918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.129932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.129945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.130098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.130121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.130135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.130148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.130254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.136519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.136680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.136711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.245 [2024-10-07 13:35:10.136729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.136932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.136995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.137027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.137046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.137059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.137081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.137329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.137355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.245 [2024-10-07 13:35:10.137371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.137837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.137922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.137941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.137954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.138203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.148664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.148696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.148872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.148901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.245 [2024-10-07 13:35:10.148918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.149010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.149037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.245 [2024-10-07 13:35:10.149052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.149077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.149097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.149118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.149132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.149145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.149162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.245 [2024-10-07 13:35:10.149176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.245 [2024-10-07 13:35:10.149189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.245 [2024-10-07 13:35:10.149212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.149228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.245 [2024-10-07 13:35:10.163391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.163424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.245 [2024-10-07 13:35:10.164409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.164440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.245 [2024-10-07 13:35:10.164457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.164645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.245 [2024-10-07 13:35:10.164672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.245 [2024-10-07 13:35:10.164689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.245 [2024-10-07 13:35:10.164946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.164974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.245 [2024-10-07 13:35:10.165227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.165250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.165270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.165290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.165305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.165318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.165551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.165574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.175448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.175503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.175840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.175871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.246 [2024-10-07 13:35:10.175888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.175993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.176018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.246 [2024-10-07 13:35:10.176033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.176150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.176175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.179090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.179116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.179131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.179149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.179163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.179175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.180019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.180045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.185587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.185636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.185892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.185919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.246 [2024-10-07 13:35:10.185935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.186063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.186096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.246 [2024-10-07 13:35:10.186116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.186135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.186160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.186178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.186191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.186204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.186227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.186244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.186257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.186270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.186292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.195708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.195757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.196008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.196038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.246 [2024-10-07 13:35:10.196055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.196437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.196467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.246 [2024-10-07 13:35:10.196483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.196529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.196730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.196756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.196771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.196784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.196864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.196887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.196901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.196913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.196937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.210483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.210534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.210724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.210752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.246 [2024-10-07 13:35:10.210768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.210880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.210914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.246 [2024-10-07 13:35:10.210930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.210955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.210976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.210996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.211011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.211024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.211041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.211056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.211068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.211092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.211108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.246 [2024-10-07 13:35:10.225524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.225559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.246 [2024-10-07 13:35:10.226005] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.226034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.246 [2024-10-07 13:35:10.226051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.226201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.246 [2024-10-07 13:35:10.226227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.246 [2024-10-07 13:35:10.226243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.246 [2024-10-07 13:35:10.226497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.226531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.246 [2024-10-07 13:35:10.226731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.226754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.246 [2024-10-07 13:35:10.226782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.246 [2024-10-07 13:35:10.226806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.246 [2024-10-07 13:35:10.226821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.247 [2024-10-07 13:35:10.226834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.247 [2024-10-07 13:35:10.226885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.247 [2024-10-07 13:35:10.226905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.247 [2024-10-07 13:35:10.239725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.247 [2024-10-07 13:35:10.239759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.247 [2024-10-07 13:35:10.240204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.247 [2024-10-07 13:35:10.240235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.247 [2024-10-07 13:35:10.240252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.247 [2024-10-07 13:35:10.240410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.247 [2024-10-07 13:35:10.240437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.247 [2024-10-07 13:35:10.240453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.247 [2024-10-07 13:35:10.240712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.247 [2024-10-07 13:35:10.240754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.247 [2024-10-07 13:35:10.240963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.240986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.241000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.241018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.241033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.241046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.241096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.241116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.254268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.254300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.255025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.255056] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.249 [2024-10-07 13:35:10.255073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.255202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.255227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.249 [2024-10-07 13:35:10.255242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.255622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.255654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.255874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.255899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.255913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.255930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.255945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.255958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.256007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.256026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.264380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.264426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.264678] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.264705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.249 [2024-10-07 13:35:10.264722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.264883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.264909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.249 [2024-10-07 13:35:10.264924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.264942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.267424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.267453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.267468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.267480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.270554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.270583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.270598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.270611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.271115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.274665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.274696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.274949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.274978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.249 [2024-10-07 13:35:10.274995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.275120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.275144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.249 [2024-10-07 13:35:10.275159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.275183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.275204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.275224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.275238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.275251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.275267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.275281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.275294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.275316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.275332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.285790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.285823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.286066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.286096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.249 [2024-10-07 13:35:10.286112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.286282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.286307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.249 [2024-10-07 13:35:10.286323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.286346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.286368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.249 [2024-10-07 13:35:10.286389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.286404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.286417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.286434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.249 [2024-10-07 13:35:10.286449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.249 [2024-10-07 13:35:10.286483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.249 [2024-10-07 13:35:10.286522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.286540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.249 [2024-10-07 13:35:10.301296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.301328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.249 [2024-10-07 13:35:10.302459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.302515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.249 [2024-10-07 13:35:10.302533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.302639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.249 [2024-10-07 13:35:10.302665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.249 [2024-10-07 13:35:10.302680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.249 [2024-10-07 13:35:10.303363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.303396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.303640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.303665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.303681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.303699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.303715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.303727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.304008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.304034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.313794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.313829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.315248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.315280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.250 [2024-10-07 13:35:10.315297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.315497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.315525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.250 [2024-10-07 13:35:10.315545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.317116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.317154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.318296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.318324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.318339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.318357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.318375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.318389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.319087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.319114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.324319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.324352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.324596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.324626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.250 [2024-10-07 13:35:10.324643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.324859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.324884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.250 [2024-10-07 13:35:10.324901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.324926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.324947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.324969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.324984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.324998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.325016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.325030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.325043] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.325068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.325085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.334455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.334511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.334758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.334802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.250 [2024-10-07 13:35:10.334825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.335006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.335032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.250 [2024-10-07 13:35:10.335047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.335219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.335248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.335295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.335314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.335327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.335343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.335358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.335371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.335395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.335411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.346816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.346863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.347099] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.347127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.250 [2024-10-07 13:35:10.347144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.347353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.347378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.250 [2024-10-07 13:35:10.347393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.347418] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.347439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.250 [2024-10-07 13:35:10.347459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.347500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.347516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.347534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.250 [2024-10-07 13:35:10.347549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.250 [2024-10-07 13:35:10.347568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.250 [2024-10-07 13:35:10.347595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.347611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.250 [2024-10-07 13:35:10.357005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.357036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.250 [2024-10-07 13:35:10.357349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.357378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.250 [2024-10-07 13:35:10.357395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.357523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.250 [2024-10-07 13:35:10.357549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.250 [2024-10-07 13:35:10.357565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.250 [2024-10-07 13:35:10.358046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.358073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.358095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.358110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.358123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.358139] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.358153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.358166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.358190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.358206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.367113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.367159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.367368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.367394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.251 [2024-10-07 13:35:10.367410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.367989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.368018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.251 [2024-10-07 13:35:10.368034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.368053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.368946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.368978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.368992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.369005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.369724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.369750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.369765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.369778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.369958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.379896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.379928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.380204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.380231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.251 [2024-10-07 13:35:10.380248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.380457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.380507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.251 [2024-10-07 13:35:10.380526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.380564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.380588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.380609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.380629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.380642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.380659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.380673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.380687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.380711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.380727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.393635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.393669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.393936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.393965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.251 [2024-10-07 13:35:10.393981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.394211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.394238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.251 [2024-10-07 13:35:10.394253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.394278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.394299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.394320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.394335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.394348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.394365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.394379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.394391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.394414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.394429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.404094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.404127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.404436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.404482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.251 [2024-10-07 13:35:10.404511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.404669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.404696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.251 [2024-10-07 13:35:10.404712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.404835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.404861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.251 [2024-10-07 13:35:10.408604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.408632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.408647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.408666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.251 [2024-10-07 13:35:10.408681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.251 [2024-10-07 13:35:10.408695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.251 [2024-10-07 13:35:10.409372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.409403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.251 [2024-10-07 13:35:10.414523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.414556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.251 [2024-10-07 13:35:10.414811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.414838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.251 [2024-10-07 13:35:10.414854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.415028] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.251 [2024-10-07 13:35:10.415053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.251 [2024-10-07 13:35:10.415068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.251 [2024-10-07 13:35:10.415093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.415114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.415135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.415149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.415163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.415179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.415194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.415206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.415229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.415246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.425432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.425478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.425712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.252 [2024-10-07 13:35:10.425742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.252 [2024-10-07 13:35:10.425759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.252 [2024-10-07 13:35:10.425904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.252 [2024-10-07 13:35:10.425930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.252 [2024-10-07 13:35:10.425945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.252 [2024-10-07 13:35:10.425969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.425989] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.426009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.426030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.426044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.426061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.426075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.426087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.426110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.426132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.441425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.441458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.442240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.252 [2024-10-07 13:35:10.442271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.252 [2024-10-07 13:35:10.442288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.252 [2024-10-07 13:35:10.442385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.252 [2024-10-07 13:35:10.442410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.252 [2024-10-07 13:35:10.442425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.252 [2024-10-07 13:35:10.442851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.442883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.443087] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.443111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.443126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.443143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.443158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.443171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.443221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.443240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.455696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.455730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.456133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.252 [2024-10-07 13:35:10.456163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.252 [2024-10-07 13:35:10.456179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.252 [2024-10-07 13:35:10.456305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.252 [2024-10-07 13:35:10.456334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.252 [2024-10-07 13:35:10.456350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.252 [2024-10-07 13:35:10.456719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.456749] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.252 [2024-10-07 13:35:10.456970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.456993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.457007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.457025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.252 [2024-10-07 13:35:10.457039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.252 [2024-10-07 13:35:10.457052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.252 [2024-10-07 13:35:10.457100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.457120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.252 [2024-10-07 13:35:10.471918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.471950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.252 [2024-10-07 13:35:10.472277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.252 [2024-10-07 13:35:10.472307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.253 [2024-10-07 13:35:10.472324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.472430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.472456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.253 [2024-10-07 13:35:10.472495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.472842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.472869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.472927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.472945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.472958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.472974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.472988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.473001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.473171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.473193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.486551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.486583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.486710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.486750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.253 [2024-10-07 13:35:10.486767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.486923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.486948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.253 [2024-10-07 13:35:10.486963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.486987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.487007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.487028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.487043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.487055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.487072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.487086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.487098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.487121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.487148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.497031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.497063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.499705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.499737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.253 [2024-10-07 13:35:10.499755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.499904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.499930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.253 [2024-10-07 13:35:10.499946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.501440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.501470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.501558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.501578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.501597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.501615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.501630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.501643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.501668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.501685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.507143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.507188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.507422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.507450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.253 [2024-10-07 13:35:10.507481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.507610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.507637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.253 [2024-10-07 13:35:10.507654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.507672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.507698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.507717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.507730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.507743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.507797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.507817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.507829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.507841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.507863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.517226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.517566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.517597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.253 [2024-10-07 13:35:10.517614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.517738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.517950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.517986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.518011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.518027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.518085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.518180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.253 [2024-10-07 13:35:10.518206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.253 [2024-10-07 13:35:10.518222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.253 [2024-10-07 13:35:10.518246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.253 [2024-10-07 13:35:10.518269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.253 [2024-10-07 13:35:10.518285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.253 [2024-10-07 13:35:10.518298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.253 [2024-10-07 13:35:10.518321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.253 [2024-10-07 13:35:10.530045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.253 [2024-10-07 13:35:10.530078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.530428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.530458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.254 [2024-10-07 13:35:10.530499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.530584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.530626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.254 [2024-10-07 13:35:10.530643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.530868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.530898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.531127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.531151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.531182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.531200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.531216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.531228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.531294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.531314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.544918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.544956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.545436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.545466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.254 [2024-10-07 13:35:10.545483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.545607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.545633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.254 [2024-10-07 13:35:10.545649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.545874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.545902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.546110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.546134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.546149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.546166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.546181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.546193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.546254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.546274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.559617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.559651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.559932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.559961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.254 [2024-10-07 13:35:10.559979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.560111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.560137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.254 [2024-10-07 13:35:10.560153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.560501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.560534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.560597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.560617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.560631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.560655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.560671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.560686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.560711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.560728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.575663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.575699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.576325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.576356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.254 [2024-10-07 13:35:10.576374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.576527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.576557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.254 [2024-10-07 13:35:10.576574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.577037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.577068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.577291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.577317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.577332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.577351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.577367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.577380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.254 [2024-10-07 13:35:10.577433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.577454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.254 [2024-10-07 13:35:10.590095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.590127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.254 [2024-10-07 13:35:10.590300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.590329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.254 [2024-10-07 13:35:10.590346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.590461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.254 [2024-10-07 13:35:10.590510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.254 [2024-10-07 13:35:10.590528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.254 [2024-10-07 13:35:10.590559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.590581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.254 [2024-10-07 13:35:10.590603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.254 [2024-10-07 13:35:10.590618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.254 [2024-10-07 13:35:10.590632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.590649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.590665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.590678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.590703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.590719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.601445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.601504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.601897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.601926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.255 [2024-10-07 13:35:10.601944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.602037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.602063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.255 [2024-10-07 13:35:10.602078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.602190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.602216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.602339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.602362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.602377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.602395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.602410] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.602423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.602592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.602617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.611613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.611663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.611914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.611941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.255 [2024-10-07 13:35:10.611957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.612164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.612191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.255 [2024-10-07 13:35:10.612207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.612224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.612249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.612266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.612280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.612293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.612316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.612333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.612357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.612370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.612391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.621872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.621905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.622390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.622420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.255 [2024-10-07 13:35:10.622437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.622647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.622673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.255 [2024-10-07 13:35:10.622698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.622912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.622940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.623131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.623156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.623170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.623187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.623207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.623221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.623413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.623436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.637014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.637047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.637242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.637270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.255 [2024-10-07 13:35:10.637286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.637418] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.637445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.255 [2024-10-07 13:35:10.637460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.637520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.637543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.637564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.637579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.637593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.637610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.637633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.637646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.637669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.637687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.255 [2024-10-07 13:35:10.647786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.647819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.255 [2024-10-07 13:35:10.648100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.648128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.255 [2024-10-07 13:35:10.648145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.648341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.255 [2024-10-07 13:35:10.648366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.255 [2024-10-07 13:35:10.648381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.255 [2024-10-07 13:35:10.651958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.651994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.255 [2024-10-07 13:35:10.653074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.653100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.653115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.255 [2024-10-07 13:35:10.653133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.255 [2024-10-07 13:35:10.653148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.255 [2024-10-07 13:35:10.653161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.653260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.653281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.658417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.658448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.658675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.658706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.256 [2024-10-07 13:35:10.658723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.658893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.658918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.256 [2024-10-07 13:35:10.658934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.658959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.658979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.658999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.659014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.659027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.659043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.659058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.659071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.659094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.659116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.669553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.669587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.669813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.669854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.256 [2024-10-07 13:35:10.669876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.670102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.670127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.256 [2024-10-07 13:35:10.670143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.670640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.670673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.670930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.670955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.670970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.670988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.671003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.671016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.671210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.671233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.685195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.685228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.685492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.685528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.256 [2024-10-07 13:35:10.685545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.685670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.685695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.256 [2024-10-07 13:35:10.685711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.686170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.686199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.686410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.686434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.686448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.686480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.686509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.686533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.686821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.686848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.699883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.699917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.700272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.700304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.256 [2024-10-07 13:35:10.700321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.700501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.700527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.256 [2024-10-07 13:35:10.700543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.700886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.700916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.701117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.701141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.701156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.701174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.256 [2024-10-07 13:35:10.701188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.256 [2024-10-07 13:35:10.701202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.256 [2024-10-07 13:35:10.701250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.701269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.256 [2024-10-07 13:35:10.714447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.714502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.256 [2024-10-07 13:35:10.714926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.714957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.256 [2024-10-07 13:35:10.714974] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.715169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.256 [2024-10-07 13:35:10.715193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.256 [2024-10-07 13:35:10.715209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.256 [2024-10-07 13:35:10.715555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.715585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.256 [2024-10-07 13:35:10.715812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.715836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.715850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.715868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.715882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.715895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.715958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.715980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.729721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.729755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.729927] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.729954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.257 [2024-10-07 13:35:10.729970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.730149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.730174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.257 [2024-10-07 13:35:10.730190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.730214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.730234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.730254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.730269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.730282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.730298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.730312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.730325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.730354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.730370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.739936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.739968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.740223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.740250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.257 [2024-10-07 13:35:10.740266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.740414] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.740445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.257 [2024-10-07 13:35:10.740460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.740510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.740532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.743041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.743068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.743083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.743100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.743115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.743128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.745214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.745240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.750046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.750092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.750288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.750315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.257 [2024-10-07 13:35:10.750331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.750501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.750537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.257 [2024-10-07 13:35:10.750552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.750571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.750597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.750615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.750629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.750642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.750666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.750684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.750697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.750720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.750749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.760942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.760974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.761173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.761202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.257 [2024-10-07 13:35:10.761218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.761417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.761443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.257 [2024-10-07 13:35:10.761459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.257 [2024-10-07 13:35:10.761506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.761529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.257 [2024-10-07 13:35:10.761551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.761565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.761589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.761607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.257 [2024-10-07 13:35:10.761621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.257 [2024-10-07 13:35:10.761633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.257 [2024-10-07 13:35:10.761667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 [2024-10-07 13:35:10.761683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.257 8554.00 IOPS, 33.41 MiB/s [2024-10-07T11:35:19.190Z] [2024-10-07 13:35:10.771050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.771097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.257 [2024-10-07 13:35:10.771326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.257 [2024-10-07 13:35:10.771353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.257 [2024-10-07 13:35:10.771369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.771587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.771613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.258 [2024-10-07 13:35:10.771629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.771647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.771673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.771691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.771709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.771723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.771747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.771765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.771793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.771806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.771841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.781167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.781232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.781492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.781521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.258 [2024-10-07 13:35:10.781539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.781931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.781960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.258 [2024-10-07 13:35:10.781976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.781994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.782188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.782215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.782230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.782243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.782292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.782313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.782326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.782340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.782363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.794308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.794341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.794811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.794843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.258 [2024-10-07 13:35:10.794860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.795051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.795076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.258 [2024-10-07 13:35:10.795092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.795287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.795316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.795535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.795561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.795575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.795594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.795609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.795622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.795673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.795693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.808543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.808579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.808961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.808992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.258 [2024-10-07 13:35:10.809009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.809111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.809136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.258 [2024-10-07 13:35:10.809151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.809343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.809372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.809590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.809615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.809630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.809648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.809663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.809677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.809728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.809748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.825123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.825158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.825346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.825376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.258 [2024-10-07 13:35:10.825394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.825507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.825548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.258 [2024-10-07 13:35:10.825565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.258 [2024-10-07 13:35:10.825591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.825615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.258 [2024-10-07 13:35:10.825637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.825653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.825668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.825688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.258 [2024-10-07 13:35:10.825705] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.258 [2024-10-07 13:35:10.825719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.258 [2024-10-07 13:35:10.825756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.825793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.258 [2024-10-07 13:35:10.839446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.839504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.258 [2024-10-07 13:35:10.839627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.258 [2024-10-07 13:35:10.839658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.258 [2024-10-07 13:35:10.839675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.839787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.839814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.259 [2024-10-07 13:35:10.839843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.839868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.839889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.839909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.839925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.839947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.839965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.839980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.839992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.840015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.840032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.854346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.854377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.854565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.854595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.259 [2024-10-07 13:35:10.854612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.854756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.854798] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.259 [2024-10-07 13:35:10.854814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.854838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.854858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.854879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.854894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.854907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.854924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.854939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.854951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.854974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.855001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.867053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.867086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.867286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.867326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.259 [2024-10-07 13:35:10.867343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.867494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.867522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.259 [2024-10-07 13:35:10.867543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.867653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.867680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.867799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.867820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.867834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.867851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.867865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.867878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.870769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.870823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.877165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.877211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.877321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.877352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.259 [2024-10-07 13:35:10.877368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.877565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.877592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.259 [2024-10-07 13:35:10.877609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.877627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.877764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.877790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.877819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.877841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.877973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.877997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.878010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.878022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.878128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.887249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.887390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.887420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.259 [2024-10-07 13:35:10.887437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.887653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.887721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.887755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.887786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.887799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.887823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.887959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.887986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.259 [2024-10-07 13:35:10.888003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.888175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.888230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.259 [2024-10-07 13:35:10.888250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.259 [2024-10-07 13:35:10.888263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.259 [2024-10-07 13:35:10.888287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.259 [2024-10-07 13:35:10.900723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.900756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.259 [2024-10-07 13:35:10.900921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.900949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.259 [2024-10-07 13:35:10.900966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.901079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.259 [2024-10-07 13:35:10.901105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.259 [2024-10-07 13:35:10.901121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.259 [2024-10-07 13:35:10.901146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.901167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.259 [2024-10-07 13:35:10.901188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.901202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.901216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.901237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.901252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.901266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.901289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.901306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.916807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.916840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.917453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.917509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.260 [2024-10-07 13:35:10.917529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.917647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.917674] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.260 [2024-10-07 13:35:10.917690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.917973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.918003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.918201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.918225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.918239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.918256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.918282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.918295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.918343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.918374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.929103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.929145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.929376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.929405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.260 [2024-10-07 13:35:10.929421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.929576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.929604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.260 [2024-10-07 13:35:10.929621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.929737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.929764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.931886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.931912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.931926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.931943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.931957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.931970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.932764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.932796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.939225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.939271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.939501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.939530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.260 [2024-10-07 13:35:10.939547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.939670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.939698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.260 [2024-10-07 13:35:10.939714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.939732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.939758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.939776] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.939790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.939803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.939827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.939844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.939858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.939881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.939903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.949310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.949460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.949532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.260 [2024-10-07 13:35:10.949551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.949589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.949621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.949649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.949665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.949679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.949703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.949860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.949887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.260 [2024-10-07 13:35:10.949903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.949926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.949949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.949964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.949977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.950000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.260 [2024-10-07 13:35:10.961367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.961400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.260 [2024-10-07 13:35:10.961751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.961795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.260 [2024-10-07 13:35:10.961813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.961953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.260 [2024-10-07 13:35:10.961979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.260 [2024-10-07 13:35:10.961994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.260 [2024-10-07 13:35:10.962187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.962215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.260 [2024-10-07 13:35:10.962261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.962279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.260 [2024-10-07 13:35:10.962293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.260 [2024-10-07 13:35:10.962310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.260 [2024-10-07 13:35:10.962331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:10.962344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:10.962543] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:10.962567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:10.975158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:10.975190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:10.975321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:10.975350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.261 [2024-10-07 13:35:10.975368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:10.975482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:10.975533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.261 [2024-10-07 13:35:10.975549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:10.975574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:10.975595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:10.975616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:10.975632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:10.975645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:10.975662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:10.975676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:10.975689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:10.975714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:10.975731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:10.985268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:10.985324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:10.985478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:10.985526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.261 [2024-10-07 13:35:10.985544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:10.986652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:10.986682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.261 [2024-10-07 13:35:10.986699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:10.986718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:10.986908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:10.986934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:10.986948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:10.986960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:10.987068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:10.987103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:10.987116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:10.987128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:10.987244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:10.995360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:10.995579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:10.995609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.261 [2024-10-07 13:35:10.995627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:10.996872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:10.997424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:10.997460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:10.997500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:10.997516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:10.997673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:10.997839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:10.997866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.261 [2024-10-07 13:35:10.997882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:10.997990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:10.998137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:10.998159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:10.998173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:10.999693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:11.006373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:11.006552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:11.006583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.261 [2024-10-07 13:35:11.006606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:11.006632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:11.006657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:11.006672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:11.006685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:11.006709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:11.007514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:11.007680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:11.007708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.261 [2024-10-07 13:35:11.007726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:11.007751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.261 [2024-10-07 13:35:11.007775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.261 [2024-10-07 13:35:11.007791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.261 [2024-10-07 13:35:11.007819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.261 [2024-10-07 13:35:11.008688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.261 [2024-10-07 13:35:11.020437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:11.021134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.261 [2024-10-07 13:35:11.021308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:11.021337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.261 [2024-10-07 13:35:11.021359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.261 [2024-10-07 13:35:11.021892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.261 [2024-10-07 13:35:11.021921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.262 [2024-10-07 13:35:11.021938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.021956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.022162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.022188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.022202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.022222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.022271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.022302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.022321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.022335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.022358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.035505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.035556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.035705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.035734] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.262 [2024-10-07 13:35:11.035752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.035858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.035884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.262 [2024-10-07 13:35:11.035901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.035919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.035944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.035963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.035982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.035995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.036020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.036037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.036050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.036063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.036085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.050952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.050985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.051395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.051424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.262 [2024-10-07 13:35:11.051441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.051572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.051599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.262 [2024-10-07 13:35:11.051616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.051827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.051858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.051904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.051925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.051938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.051956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.051982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.051995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.052166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.052190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.065598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.065632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.065759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.065803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.262 [2024-10-07 13:35:11.065820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.065936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.065963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.262 [2024-10-07 13:35:11.065980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.066005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.066027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.066048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.066064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.066079] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.066096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.262 [2024-10-07 13:35:11.066111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.262 [2024-10-07 13:35:11.066124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.262 [2024-10-07 13:35:11.066148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.066176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.262 [2024-10-07 13:35:11.075713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.075765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.262 [2024-10-07 13:35:11.075949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.075981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.262 [2024-10-07 13:35:11.076004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.078832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.262 [2024-10-07 13:35:11.078863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.262 [2024-10-07 13:35:11.078881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.262 [2024-10-07 13:35:11.078900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.262 [2024-10-07 13:35:11.081557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.081588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.081603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.081617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.082115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.082140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.082159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.082171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.082386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.086117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.086147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.086340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.086368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.263 [2024-10-07 13:35:11.086385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.086515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.086543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.086560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.086585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.086606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.086628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.086643] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.086656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.086674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.086689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.086701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.086730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.086758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.097589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.097624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.097815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.097845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.097874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.098178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.098253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.098275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.098289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.098473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.112341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.112511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.112544] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.112562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.112596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.112629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.112648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.112662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.112697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.122437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.122651] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.122682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.122701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.122734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.122782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.122799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.122813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.122844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.132559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.132714] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.132746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.132764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.132811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.132842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.132859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.132872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.132903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.144286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.144626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.144657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.144675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.144739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.144774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.144792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.144823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.144855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.152038] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:23.263 [2024-10-07 13:35:11.157032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.160432] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.160464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.160540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.160996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.263 [2024-10-07 13:35:11.161239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.263 [2024-10-07 13:35:11.161264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.263 [2024-10-07 13:35:11.161295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.263 [2024-10-07 13:35:11.161346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.263 [2024-10-07 13:35:11.167119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.263 [2024-10-07 13:35:11.167318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.263 [2024-10-07 13:35:11.167347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.263 [2024-10-07 13:35:11.167369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.263 [2024-10-07 13:35:11.167395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.167419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.167434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.167447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.167497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.177205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.177350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.177379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.177397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.177599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.177657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.177679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.177694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.177719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.190214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.190549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.190581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.190598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.190811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.190874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.190897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.190912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.191153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.204142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.204321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.204350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.204367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.204392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.204416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.204431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.204450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.204501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.216394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.216655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.216688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.216706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.216847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.216968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.216989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.217003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.219728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.226502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.226634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.226664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.226681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.226707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.226731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.226747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.226760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.226798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.236712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.236954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.236983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.237000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.237174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.237235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.237256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.237270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.237295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.249983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.250300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.250330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.250347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.250396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.250423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.250439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.250452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.250654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.263879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.264037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.264066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.264083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.264 [2024-10-07 13:35:11.264108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.264 [2024-10-07 13:35:11.264132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.264 [2024-10-07 13:35:11.264147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.264 [2024-10-07 13:35:11.264159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.264 [2024-10-07 13:35:11.264183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.264 [2024-10-07 13:35:11.279368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.264 [2024-10-07 13:35:11.279613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.264 [2024-10-07 13:35:11.279644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.264 [2024-10-07 13:35:11.279661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.279687] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.279712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.279727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.279741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.279766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.291333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.291606] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.291638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.291656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.294387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.295333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.295359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.295373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.295941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.301433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.301658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.301688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.301705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.301730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.301754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.301784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.301797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.301820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.311534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.311752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.311781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.311813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.311992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.312126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.312148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.312162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.312272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.323966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.324148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.324177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.324194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.324562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.324810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.324834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.324870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.325069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.336732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.338746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.338794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.338812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.339429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.339713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.339739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.339754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.339962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.346820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.347110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.347139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.347155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.347180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.347204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.347219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.347232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.347255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.356918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.357074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.357103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.357120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.357144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.357168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.357184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.357209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.357233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.370727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.370923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.370957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.370975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.371149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.371209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.371241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.371255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.265 [2024-10-07 13:35:11.371279] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.265 [2024-10-07 13:35:11.384768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.265 [2024-10-07 13:35:11.384932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.265 [2024-10-07 13:35:11.384961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.265 [2024-10-07 13:35:11.384978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.265 [2024-10-07 13:35:11.385003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.265 [2024-10-07 13:35:11.385027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.265 [2024-10-07 13:35:11.385042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.265 [2024-10-07 13:35:11.385056] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.385079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.399536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.400665] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.400699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.400727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.401306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.401567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.401593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.401616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.401829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.410260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.410496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.410525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.410543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.410568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.410631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.410651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.410665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.410689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.423192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.423412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.423442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.423459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.423507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.423533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.423549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.423562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.423698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.433600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.433776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.433820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.433837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.434011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.434065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.434097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.434111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.434281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.447130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.447442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.447496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.447517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.447715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.447784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.447820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.447846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.447871] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.460890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.461433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.461477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.461506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.461766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.461984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.462007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.462021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.462070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.471272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.471522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.471553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.471572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.471681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.471805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.471841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.471855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.471960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.481356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.481570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.481601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.481618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.266 [2024-10-07 13:35:11.481644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.266 [2024-10-07 13:35:11.481668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.266 [2024-10-07 13:35:11.481684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.266 [2024-10-07 13:35:11.481697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.266 [2024-10-07 13:35:11.481721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.266 [2024-10-07 13:35:11.491440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.266 [2024-10-07 13:35:11.491734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.266 [2024-10-07 13:35:11.491765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.266 [2024-10-07 13:35:11.491787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.491828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.491852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.491867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.491880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.491903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.504724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.504884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.504913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.504930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.504954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.505398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.505421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.505441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.506225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.519731] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.520264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.520294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.520311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.520760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.521033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.521056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.521070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.521266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.530078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.531973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.532004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.532021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.534448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.535534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.535564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.535589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.535986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.540164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.540351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.540380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.540397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.540422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.540446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.540477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.540503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.540530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.550247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.550459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.550511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.550532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.550557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.550582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.550598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.550611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.550636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.561256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.561443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.561494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.561515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.561541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.561565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.561580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.561594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.561618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.572388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.572530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.572561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.572578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.572603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.572674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.572697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.572712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.572960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.583204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.583389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.583419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.583437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.583497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.583525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.583542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.583555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.583581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.593368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.593506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.267 [2024-10-07 13:35:11.593538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.267 [2024-10-07 13:35:11.593556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.267 [2024-10-07 13:35:11.593582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.267 [2024-10-07 13:35:11.593608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.267 [2024-10-07 13:35:11.593623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.267 [2024-10-07 13:35:11.593638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.267 [2024-10-07 13:35:11.593836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.267 [2024-10-07 13:35:11.607212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.267 [2024-10-07 13:35:11.607428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.607456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.607498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.607532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.607557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.607572] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.607586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.607610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.620902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.621065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.621094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.621111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.621136] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.621159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.621175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.621188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.621222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.635365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.635517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.635547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.635564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.635590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.635614] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.635629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.635643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.635667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.650820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.651030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.651057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.651073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.651098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.651121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.651137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.651155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.651179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.665237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.665410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.665440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.665458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.665505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.665544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.665559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.665574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.665598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.680762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.681653] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.681686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.681704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.682298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.682586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.682612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.682627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.682843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.695881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.696090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.696120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.696138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.696310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.696370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.696390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.696413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.696438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.710602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.710998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.711035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.711053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.711249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.711321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.711353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.711367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.711572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.725418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.725622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.725652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.725670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.725696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.725720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.725736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.725749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.725773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.735509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.736608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.736639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.736656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.740533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.741271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.741297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.268 [2024-10-07 13:35:11.741311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.268 [2024-10-07 13:35:11.741427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.268 [2024-10-07 13:35:11.747348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.268 [2024-10-07 13:35:11.747630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.268 [2024-10-07 13:35:11.747661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.268 [2024-10-07 13:35:11.747678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.268 [2024-10-07 13:35:11.747787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.268 [2024-10-07 13:35:11.747859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.268 [2024-10-07 13:35:11.747878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.747894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.747919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.757433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.757691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.757721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.757739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.757930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.757987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.758007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.758021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.758045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 8563.56 IOPS, 33.45 MiB/s [2024-10-07T11:35:19.202Z] [2024-10-07 13:35:11.771957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.772110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.772139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.772156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.772180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.772204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.772219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.772232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.772256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.786910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.787141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.787170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.787187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.787212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.787236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.787250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.787263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.787292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.800604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.800828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.800858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.800875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.800900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.800923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.800938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.800951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.800975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.816680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.816976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.817007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.817024] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.817371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.817613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.817639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.817655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.817707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.831678] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.831934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.831964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.831981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.832008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.832031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.832046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.832060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.832481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.846342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.846561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.846592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.846615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.846643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.846691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.846711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.846726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.846752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.861417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.861645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.861676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.861694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.861720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.861745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.861761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.861789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.861814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.871826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.872038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.872079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.872096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.872202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.872311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.872333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.872347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.872456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.881917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.882166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.269 [2024-10-07 13:35:11.882196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.269 [2024-10-07 13:35:11.882212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.269 [2024-10-07 13:35:11.882237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.269 [2024-10-07 13:35:11.882260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.269 [2024-10-07 13:35:11.882280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.269 [2024-10-07 13:35:11.882294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.269 [2024-10-07 13:35:11.882317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.269 [2024-10-07 13:35:11.892070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.269 [2024-10-07 13:35:11.892261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.892290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.892308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.892332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.892355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.892370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.892383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.892406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.906178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.906384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.906413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.906430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.906454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.906504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.906522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.906535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.906559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.919844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.921782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.921828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.921845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.921917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.921944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.921959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.921972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.921996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.929932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.930201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.930231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.930247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.932577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.932878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.932904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.932919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.933038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.940102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.940319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.940348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.940365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.940390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.940412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.940427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.940440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.940463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.951602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.951787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.951830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.951847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.951872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.951895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.951909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.951924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.951947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.966984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.967498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.967529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.967546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.967804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.967860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.967880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.967893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.967918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.977695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.978071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.978103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.978120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.981109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.981906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.981932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.981946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.982333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.987795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.988055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.988083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.988099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.988123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.988146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.988160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.988173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.988196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:11.997878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:11.998144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:11.998174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:11.998190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:11.998216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:11.998240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:11.998254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:11.998272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.270 [2024-10-07 13:35:11.998297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.270 [2024-10-07 13:35:12.011874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.270 [2024-10-07 13:35:12.012124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.270 [2024-10-07 13:35:12.012154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.270 [2024-10-07 13:35:12.012171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.270 [2024-10-07 13:35:12.012196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.270 [2024-10-07 13:35:12.012220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.270 [2024-10-07 13:35:12.012234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.270 [2024-10-07 13:35:12.012248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.012271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.025012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.026187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.026217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.026234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.026338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.026366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.026381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.026395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.026418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.035705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.036063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.036093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.036111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.036231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.036341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.036361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.036375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.036508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.045794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.046029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.046075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.046093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.046118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.046141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.046155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.046168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.046191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.055894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.056095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.056133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.056150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.056174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.056197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.056212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.056225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.056248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.068203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.068768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.068814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.068831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.069022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.069457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.069508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.069524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.069740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.083456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.084040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.084070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.084087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.084328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.084556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.084595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.084611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.084664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.097105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.097536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.097569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.097588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.097806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.097888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.097908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.097922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.097948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.113184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.113434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.113479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.113506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.113533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.113558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.113574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.113588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.271 [2024-10-07 13:35:12.113612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.271 [2024-10-07 13:35:12.128407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.271 [2024-10-07 13:35:12.128812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.271 [2024-10-07 13:35:12.128843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.271 [2024-10-07 13:35:12.128877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.271 [2024-10-07 13:35:12.129132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.271 [2024-10-07 13:35:12.129330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.271 [2024-10-07 13:35:12.129353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.271 [2024-10-07 13:35:12.129368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.129422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.143331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.143476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.143514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.143532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.143558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.143581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.143597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.143611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.143635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.157996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.158347] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.158377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.158394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.158635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.158693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.158713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.158727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.158915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.172443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.172691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.172721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.172739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.172765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.172803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.172817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.172830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.172853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.185750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.185934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.185963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.185984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.186010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.186033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.186047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.186061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.186084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.199868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.200238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.200268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.200285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.200354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.200382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.200398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.200411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.200434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.215124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.215280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.215308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.215325] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.215349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.215372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.215386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.215399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.215750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.230030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.230539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.230571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.230589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.230813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.230870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.230896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.230912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.230936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.241981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.243928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.243960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.243977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.244813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.245058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.245082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.245096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.245287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.253085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.253319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.253349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.253368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.253501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.253617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.253639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.253653] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.257990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.263169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.263346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.263375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.263392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.263416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.272 [2024-10-07 13:35:12.263440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.272 [2024-10-07 13:35:12.263455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.272 [2024-10-07 13:35:12.263484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.272 [2024-10-07 13:35:12.263521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.272 [2024-10-07 13:35:12.273568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.272 [2024-10-07 13:35:12.273919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.272 [2024-10-07 13:35:12.273949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.272 [2024-10-07 13:35:12.273968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.272 [2024-10-07 13:35:12.274016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.274045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.274061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.274076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.274100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.283942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.287746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.287778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.287812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.288274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.288483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.288532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.288548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.288600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.294143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.294306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.294334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.294352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.294832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.294886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.294906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.294920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.294945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.304228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.304409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.304439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.304456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.304512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.304539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.304554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.304568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.304593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.317543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.317706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.317737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.317755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.317781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.317821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.317837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.317850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.317873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.330943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.331097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.331125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.331143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.331168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.331192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.331207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.331220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.331244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.344886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.345016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.345044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.345061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.345086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.345110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.345126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.345145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.345169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.358305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.359187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.359220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.359258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.359666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.359739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.359760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.359775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.359802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.373319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.373908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.373939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.373957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.374591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.374845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.374868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.374882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.375075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.388999] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.389242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.389271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.389288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.389314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.389337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.389352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.389366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.389389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.399366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.399627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.273 [2024-10-07 13:35:12.399662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.273 [2024-10-07 13:35:12.399681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.273 [2024-10-07 13:35:12.399805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.273 [2024-10-07 13:35:12.399916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.273 [2024-10-07 13:35:12.399938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.273 [2024-10-07 13:35:12.399953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.273 [2024-10-07 13:35:12.402714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.273 [2024-10-07 13:35:12.409453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.273 [2024-10-07 13:35:12.409641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.409670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.274 [2024-10-07 13:35:12.409687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.409903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.410059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.410082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.410096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.410215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.419566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.419761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.419791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.274 [2024-10-07 13:35:12.419823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.419848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.419871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.419886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.419899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.419922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.423506] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7c0690 was disconnected and freed. reset controller. 00:24:23.274 [2024-10-07 13:35:12.423554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.423625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.432832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.433646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.433693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.433711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.433727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.434059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.434283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.434313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.274 [2024-10-07 13:35:12.434330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.434581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.435064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.435103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.435120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.435134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.435347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.435545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.435574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.274 [2024-10-07 13:35:12.435591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.435810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.435870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.435890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.435904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.435929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.445039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.445353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.445384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.274 [2024-10-07 13:35:12.445402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.445551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.448556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.448597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.448616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.448630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.449460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.449729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.449760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.274 [2024-10-07 13:35:12.449792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.450378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.450651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.450677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.450703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.450934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.455148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.455390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.455419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.274 [2024-10-07 13:35:12.455436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.455460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.455513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.455545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.455559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.455584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.459862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.460176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.460206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.274 [2024-10-07 13:35:12.460223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.460330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.460451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.460498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.460516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.460634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.465307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.465578] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.465610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.274 [2024-10-07 13:35:12.465628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.465849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.465905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.465925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.465938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.274 [2024-10-07 13:35:12.465962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.274 [2024-10-07 13:35:12.469947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.274 [2024-10-07 13:35:12.470150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.274 [2024-10-07 13:35:12.470178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.274 [2024-10-07 13:35:12.470195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.274 [2024-10-07 13:35:12.470406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.274 [2024-10-07 13:35:12.470599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.274 [2024-10-07 13:35:12.470626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.274 [2024-10-07 13:35:12.470641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.470786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.479739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.480008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.480037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.275 [2024-10-07 13:35:12.480064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.480530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.480790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.480832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.480847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.480916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.480941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.481181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.481222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.275 [2024-10-07 13:35:12.481238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.481410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.481482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.481531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.481553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.481753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.491484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.491648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.491849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.491878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.275 [2024-10-07 13:35:12.491895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.495972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.496003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.275 [2024-10-07 13:35:12.496020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.496039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.496540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.496569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.496584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.496598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.496965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.496990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.497004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.497018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.497221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.501580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.501837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.501865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.275 [2024-10-07 13:35:12.501882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.501906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.501942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.501961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.501975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.502000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.502020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.502232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.502268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.275 [2024-10-07 13:35:12.502284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.502418] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.502572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.502594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.502609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.502752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.511662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.511919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.511947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.275 [2024-10-07 13:35:12.511963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.511987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.512014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.512030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.512044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.512068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.512106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.512342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.512368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.275 [2024-10-07 13:35:12.512383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.512407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.512430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.512444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.275 [2024-10-07 13:35:12.512457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.275 [2024-10-07 13:35:12.512505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.275 [2024-10-07 13:35:12.525979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.526092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.275 [2024-10-07 13:35:12.526338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.526366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.275 [2024-10-07 13:35:12.526382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.526570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.275 [2024-10-07 13:35:12.526599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.275 [2024-10-07 13:35:12.526616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.275 [2024-10-07 13:35:12.526636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.526662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.275 [2024-10-07 13:35:12.526680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.275 [2024-10-07 13:35:12.526693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.526706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.526731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.526748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.526763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.526776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.526798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.536745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.536779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.537119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.537160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.276 [2024-10-07 13:35:12.537176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.537330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.537366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.276 [2024-10-07 13:35:12.537382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.537516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.537552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.537660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.537681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.537695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.537712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.537727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.537740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.537863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.537889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.546858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.546904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.547150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.547177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.276 [2024-10-07 13:35:12.547193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.547368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.547394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.276 [2024-10-07 13:35:12.547409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.547427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.547587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.547613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.547627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.547641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.547765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.547801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.547815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.547828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.547947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.556942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.557194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.557223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.276 [2024-10-07 13:35:12.557240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.557698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.558073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.558111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.558128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.558141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.558341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.558591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.558621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.276 [2024-10-07 13:35:12.558644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.558695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.558723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.558739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.558752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.558791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.569260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.569294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.569543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.569576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.276 [2024-10-07 13:35:12.569593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.569839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.569866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.276 [2024-10-07 13:35:12.569881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.569906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.569926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.569947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.569961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.569974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.569990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.570004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.570016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.570039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.570055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.584519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.584571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.276 [2024-10-07 13:35:12.584899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.584944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.276 [2024-10-07 13:35:12.584961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.585086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.276 [2024-10-07 13:35:12.585115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.276 [2024-10-07 13:35:12.585131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.276 [2024-10-07 13:35:12.585155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.585176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.276 [2024-10-07 13:35:12.585197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.585212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.585225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.585241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.276 [2024-10-07 13:35:12.585255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.276 [2024-10-07 13:35:12.585268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.276 [2024-10-07 13:35:12.585291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.276 [2024-10-07 13:35:12.585307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.596834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.596867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.597212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.597242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.277 [2024-10-07 13:35:12.597259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.597463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.597513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.277 [2024-10-07 13:35:12.597530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.600430] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.600461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.601229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.601254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.601269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.601285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.601300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.601312] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.601764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.601803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.607601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.607633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.607937] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.607966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.277 [2024-10-07 13:35:12.607983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.608063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.608088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.277 [2024-10-07 13:35:12.608103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.608142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.608166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.608187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.608202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.608214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.608231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.608245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.608258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.608280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.608296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.617718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.618162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.618309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.618338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.277 [2024-10-07 13:35:12.618356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.618564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.618594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.277 [2024-10-07 13:35:12.618612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.618631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.618659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.618678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.618692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.618711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.618738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.618756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.618770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.618783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.618822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.628141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.628386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.628415] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.277 [2024-10-07 13:35:12.628431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.631129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.632008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.632046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.632063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.632076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.632531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.632680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.632708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.277 [2024-10-07 13:35:12.632725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.632947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.633181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.633204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.633218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.633270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.638224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.638405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.638432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.277 [2024-10-07 13:35:12.638449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.638607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.638739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.277 [2024-10-07 13:35:12.638762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.277 [2024-10-07 13:35:12.638784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.277 [2024-10-07 13:35:12.638918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.277 [2024-10-07 13:35:12.646693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.277 [2024-10-07 13:35:12.647063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.277 [2024-10-07 13:35:12.647094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.277 [2024-10-07 13:35:12.647111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.277 [2024-10-07 13:35:12.647303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.277 [2024-10-07 13:35:12.647358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.647378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.647391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.647416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.648307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.648498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.648527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.278 [2024-10-07 13:35:12.648560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.648754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.648812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.648834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.648863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.648888] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.661072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.661103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.661276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.661304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.278 [2024-10-07 13:35:12.661321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.661406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.661432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.278 [2024-10-07 13:35:12.661447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.661471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.661520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.661551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.661568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.661581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.661597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.661612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.661625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.661649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.661666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.674966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.674998] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.675138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.675166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.278 [2024-10-07 13:35:12.675183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.675326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.675351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.278 [2024-10-07 13:35:12.675366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.675390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.675411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.675432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.675446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.675459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.675500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.675517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.675530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.676798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.676823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.689568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.689600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.689737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.689765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.278 [2024-10-07 13:35:12.689782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.689950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.689975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.278 [2024-10-07 13:35:12.689990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.690015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.690035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.690055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.690070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.690083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.690099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.690113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.690125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.690150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.690166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.704723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.704756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.704921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.704948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.278 [2024-10-07 13:35:12.704965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.705107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.705133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.278 [2024-10-07 13:35:12.705149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.705173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.705193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.705213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.705228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.705241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.705258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.705272] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.705284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.705308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.705329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.719363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.719395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.719535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.719563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.278 [2024-10-07 13:35:12.719580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.719702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.278 [2024-10-07 13:35:12.719728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.278 [2024-10-07 13:35:12.719744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.278 [2024-10-07 13:35:12.719783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.719803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.278 [2024-10-07 13:35:12.719823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.719838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.719851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.719867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.278 [2024-10-07 13:35:12.719881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.278 [2024-10-07 13:35:12.719893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.278 [2024-10-07 13:35:12.719915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.719931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.278 [2024-10-07 13:35:12.733712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.278 [2024-10-07 13:35:12.733746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.733940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.733968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.279 [2024-10-07 13:35:12.733984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.734129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.734155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.279 [2024-10-07 13:35:12.734170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.734194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.734215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.734235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.734255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.734270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.734287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.734302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.734314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.734337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.734352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.744417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.744449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.744621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.744650] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.279 [2024-10-07 13:35:12.744668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.744766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.744793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.279 [2024-10-07 13:35:12.744809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.747272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.747302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.748456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.748502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.748518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.748536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.748551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.748564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.749998] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.750022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.754554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.754600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.754716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.754744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.279 [2024-10-07 13:35:12.754761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.754905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.754937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.279 [2024-10-07 13:35:12.754953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.754971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.755238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.755264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.755278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.755291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.755419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.755442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.755456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.755484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.755540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.765367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.765398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.765823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.765852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.279 [2024-10-07 13:35:12.765869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.765987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.766012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.279 [2024-10-07 13:35:12.766027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.766219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.766247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.766296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.766316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.766341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.766358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.766372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.766384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.766584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.766608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 8576.00 IOPS, 33.50 MiB/s [2024-10-07T11:35:19.212Z] [2024-10-07 13:35:12.780672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.780708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.780836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.780865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.279 [2024-10-07 13:35:12.780881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.781024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.781050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.279 [2024-10-07 13:35:12.781065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.781104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.781127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.781148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.781163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.781176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.781193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.279 [2024-10-07 13:35:12.781207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.279 [2024-10-07 13:35:12.781220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.279 [2024-10-07 13:35:12.781244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.781272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.279 [2024-10-07 13:35:12.796034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.796066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.279 [2024-10-07 13:35:12.796219] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.796246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.279 [2024-10-07 13:35:12.796263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.796434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.279 [2024-10-07 13:35:12.796467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.279 [2024-10-07 13:35:12.796483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.279 [2024-10-07 13:35:12.796535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.796557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.279 [2024-10-07 13:35:12.796577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.796592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.796611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.796629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.796643] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.796656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.796680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.796696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.808138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.808170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.808391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.808421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.280 [2024-10-07 13:35:12.808438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.808587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.808614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.280 [2024-10-07 13:35:12.808630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.808752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.808803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.811054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.811080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.811095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.811112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.811126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.811139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.812089] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.812114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.818250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.818297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.818437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.818479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.280 [2024-10-07 13:35:12.818507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.818613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.818640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.280 [2024-10-07 13:35:12.818666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.818685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.820815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.820843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.820858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.820871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.821372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.821397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.821411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.821426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.821602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.828662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.828694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.828932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.828961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.280 [2024-10-07 13:35:12.828977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.829067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.829090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.280 [2024-10-07 13:35:12.829105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.829140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.829161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.829181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.829206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.829219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.829236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.829250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.829263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.829286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.829302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.839878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.839915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.840121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.840149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.280 [2024-10-07 13:35:12.840166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.840309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.840335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.280 [2024-10-07 13:35:12.840350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.840809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.840839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.841063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.841086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.841100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.841117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.841132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.280 [2024-10-07 13:35:12.841145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.280 [2024-10-07 13:35:12.841346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.841370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.280 [2024-10-07 13:35:12.851036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.851069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.280 [2024-10-07 13:35:12.851302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.851331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.280 [2024-10-07 13:35:12.851348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.851459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.280 [2024-10-07 13:35:12.851507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.280 [2024-10-07 13:35:12.851524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.280 [2024-10-07 13:35:12.851647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.851674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.280 [2024-10-07 13:35:12.854658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.280 [2024-10-07 13:35:12.854684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.854699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.854722] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.854737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.854750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.855495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.855519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.861146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.861193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.861389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.861417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.281 [2024-10-07 13:35:12.861433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.861563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.861590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.281 [2024-10-07 13:35:12.861606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.861625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.861650] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.861668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.861681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.861695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.861719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.861736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.861748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.861761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.861814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.871687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.871721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.871876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.871905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.281 [2024-10-07 13:35:12.871923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.872044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.872073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.281 [2024-10-07 13:35:12.872089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.872320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.872350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.872411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.872433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.872447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.872481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.872513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.872527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.872747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.872797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.886226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.886259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.886389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.886418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.281 [2024-10-07 13:35:12.886435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.886541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.886584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.281 [2024-10-07 13:35:12.886601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.886628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.886649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.886669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.886684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.886698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.886714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.886729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.886741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.886765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.886782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.896709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.896742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.900727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.900759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.281 [2024-10-07 13:35:12.900777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.900910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.900936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.281 [2024-10-07 13:35:12.900951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.901603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.901633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.902004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.902027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.902042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.902068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.902083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.902095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.902300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.902323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.906825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.906871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.907050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.907077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.281 [2024-10-07 13:35:12.907094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.907220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.907246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.281 [2024-10-07 13:35:12.907261] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.907279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.907304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.907321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.907334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.907347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.907371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.907392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.281 [2024-10-07 13:35:12.907406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.281 [2024-10-07 13:35:12.907424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.281 [2024-10-07 13:35:12.907445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.281 [2024-10-07 13:35:12.916909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.281 [2024-10-07 13:35:12.917125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.281 [2024-10-07 13:35:12.917153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.281 [2024-10-07 13:35:12.917170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.281 [2024-10-07 13:35:12.917207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.281 [2024-10-07 13:35:12.917237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.917264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.917280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.917294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.917318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.917448] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.917507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.282 [2024-10-07 13:35:12.917526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.917551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.917574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.917589] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.917602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.917626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.931707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.931741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.932268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.932298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.282 [2024-10-07 13:35:12.932315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.932407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.932432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.282 [2024-10-07 13:35:12.932447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.932680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.932714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.932928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.932951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.932965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.932983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.932997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.933010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.933058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.933078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.942604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.942637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.942916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.942945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.282 [2024-10-07 13:35:12.942962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.943081] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.943106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.282 [2024-10-07 13:35:12.943122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.943236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.943262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.943377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.943399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.943413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.943430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.943446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.943459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.943594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.943615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.952719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.952775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.953026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.953061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.282 [2024-10-07 13:35:12.953079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.953206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.953234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.282 [2024-10-07 13:35:12.953250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.953269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.953295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.953314] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.953327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.953340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.953366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.953383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.953397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.953412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.953434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.962823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.963030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.963058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.282 [2024-10-07 13:35:12.963076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.963112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.963143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.963171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.963187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.963200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.963224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.963397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.963423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.282 [2024-10-07 13:35:12.963439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.963478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.963513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.963535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.963549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.963574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.977638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.977671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.977864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.977892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.282 [2024-10-07 13:35:12.977908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.978027] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.282 [2024-10-07 13:35:12.978052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.282 [2024-10-07 13:35:12.978066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.282 [2024-10-07 13:35:12.978090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.978111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.282 [2024-10-07 13:35:12.978131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.978146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.978159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.978175] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.282 [2024-10-07 13:35:12.978195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.282 [2024-10-07 13:35:12.978207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.282 [2024-10-07 13:35:12.978230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.978246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.282 [2024-10-07 13:35:12.988737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.282 [2024-10-07 13:35:12.988770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:12.992572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:12.992604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.283 [2024-10-07 13:35:12.992622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:12.992740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:12.992782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.283 [2024-10-07 13:35:12.992798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:12.993550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:12.993581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:12.994009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:12.994043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:12.994057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:12.994073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:12.994088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:12.994105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:12.994321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:12.994342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:12.998868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:12.998913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:12.999130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:12.999158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.283 [2024-10-07 13:35:12.999174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:12.999267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:12.999292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.283 [2024-10-07 13:35:12.999307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:12.999325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:12.999349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:12.999372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:12.999385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:12.999397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:12.999421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:12.999444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:12.999457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:12.999496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:12.999522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:13.010157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.010189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.010563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.010595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.283 [2024-10-07 13:35:13.010618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:13.010736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.010763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.283 [2024-10-07 13:35:13.010794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:13.010991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:13.011019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:13.011207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:13.011230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:13.011244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:13.011262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:13.011276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:13.011288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:13.011337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:13.011356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:13.024152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.024184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.024334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.024363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.283 [2024-10-07 13:35:13.024379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:13.024479] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.024529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.283 [2024-10-07 13:35:13.024546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:13.024571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:13.024592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:13.024613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:13.024639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:13.024652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:13.024669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:13.024683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:13.024695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:13.024725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:13.024754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:13.034767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.034818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.034979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.035008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.283 [2024-10-07 13:35:13.035025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:13.035161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.035187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.283 [2024-10-07 13:35:13.035203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:13.035880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:13.035910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.283 [2024-10-07 13:35:13.039682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:13.039709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:13.039724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:13.039742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.283 [2024-10-07 13:35:13.039757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.283 [2024-10-07 13:35:13.039785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.283 [2024-10-07 13:35:13.040318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:13.040342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.283 [2024-10-07 13:35:13.046327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.046359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.283 [2024-10-07 13:35:13.046601] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.046631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.283 [2024-10-07 13:35:13.046649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.283 [2024-10-07 13:35:13.046766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.283 [2024-10-07 13:35:13.046807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.283 [2024-10-07 13:35:13.046823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.046848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.046895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.046916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.046937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.046951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.046968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.046983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.046995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.047019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.047051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.056611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.056645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.056859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.056888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.284 [2024-10-07 13:35:13.056904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.057009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.057034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.284 [2024-10-07 13:35:13.057050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.057074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.057095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.057115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.057130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.057143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.057159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.057174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.057187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.057695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.057720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.071768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.071815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.072114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.072143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.284 [2024-10-07 13:35:13.072160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.072260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.072285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.284 [2024-10-07 13:35:13.072301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.072325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.072346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.072367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.072392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.072406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.072422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.072436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.072449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.072500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.072529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.085755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.085788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.085979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.086008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.284 [2024-10-07 13:35:13.086025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.086173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.086199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.284 [2024-10-07 13:35:13.086215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.086240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.086261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.086281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.086296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.086309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.086326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.086340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.086353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.086376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.086392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.096816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.096859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.097100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.097129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.284 [2024-10-07 13:35:13.097146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.097236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.097261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.284 [2024-10-07 13:35:13.097277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.097388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.097415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.097546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.097569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.097584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.097602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.097616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.097629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.097745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.097767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.106936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.106983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.284 [2024-10-07 13:35:13.107165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.107194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.284 [2024-10-07 13:35:13.107211] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.107378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.284 [2024-10-07 13:35:13.107405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.284 [2024-10-07 13:35:13.107420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.284 [2024-10-07 13:35:13.107439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.107714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.284 [2024-10-07 13:35:13.107741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.107756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.107793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.107933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.107956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.284 [2024-10-07 13:35:13.107970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.284 [2024-10-07 13:35:13.107983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.284 [2024-10-07 13:35:13.108088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.284 [2024-10-07 13:35:13.117383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.117415] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.117671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.117700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.285 [2024-10-07 13:35:13.117718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.117815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.117840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.285 [2024-10-07 13:35:13.117856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.117880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.117900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.117921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.117937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.117950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.117966] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.117981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.117993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.118019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.118034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.129673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.129723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.129933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.129963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.285 [2024-10-07 13:35:13.129980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.130087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.130114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.285 [2024-10-07 13:35:13.130136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.130338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.130366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.130596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.130631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.130646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.130664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.130679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.130692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.130742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.130779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.141079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.141122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.141380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.141409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.285 [2024-10-07 13:35:13.141426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.141573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.141601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.285 [2024-10-07 13:35:13.141618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.141729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.141756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.141887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.141908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.141921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.141938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.141953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.141965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.142085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.142107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.151202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.151255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.151507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.151537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.285 [2024-10-07 13:35:13.151554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.151679] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.151706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.285 [2024-10-07 13:35:13.151722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.151741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.151766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.151799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.151812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.151824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.151848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.151865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.151878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.151890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.151911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.161291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.161543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.161574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.285 [2024-10-07 13:35:13.161592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.161798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.161863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.161897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.161913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.161926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.161949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.162065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.162090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.285 [2024-10-07 13:35:13.162105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.162282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.162337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.162357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.162371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.162395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.175987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.176242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.285 [2024-10-07 13:35:13.176395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.176434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.285 [2024-10-07 13:35:13.176450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.176840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.285 [2024-10-07 13:35:13.176879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.285 [2024-10-07 13:35:13.176896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.285 [2024-10-07 13:35:13.176914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.177119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.285 [2024-10-07 13:35:13.177149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.285 [2024-10-07 13:35:13.177162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.285 [2024-10-07 13:35:13.177176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.285 [2024-10-07 13:35:13.177372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.285 [2024-10-07 13:35:13.177396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.177409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.177422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.177506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.191045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.191152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.191368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.191397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.286 [2024-10-07 13:35:13.191414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.191541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.191569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.286 [2024-10-07 13:35:13.191585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.191609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.191635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.191664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.191676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.191690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.191714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.191731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.191745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.191758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.191795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.205991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.206024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.206373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.206403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.286 [2024-10-07 13:35:13.206419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.206555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.206583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.286 [2024-10-07 13:35:13.206599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.206939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.206967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.207171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.207193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.207207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.207224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.207238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.207251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.207311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.207341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.220853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.220886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.221180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.221209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.286 [2024-10-07 13:35:13.221226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.221341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.221367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.286 [2024-10-07 13:35:13.221382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.221407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.221428] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.221462] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.221504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.221519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.221537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.221553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.221565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.221590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.221618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.233710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.233743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.234374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.234403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.286 [2024-10-07 13:35:13.234420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.234553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.234580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.286 [2024-10-07 13:35:13.234596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.234835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.234863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.234910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.234930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.234944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.234960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.234980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.234993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.235018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.235034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.247208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.247247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.247792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.247822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.286 [2024-10-07 13:35:13.247839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.247967] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.247993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.286 [2024-10-07 13:35:13.248009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.248257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.248286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.248503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.248528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.248543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.248560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.248575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.248588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.248648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.248668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.257527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.257560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.257872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.257901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.286 [2024-10-07 13:35:13.257918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.258054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.258079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.286 [2024-10-07 13:35:13.258095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.258200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.258231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.286 [2024-10-07 13:35:13.261285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.261311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.261326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.261343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.286 [2024-10-07 13:35:13.261366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.286 [2024-10-07 13:35:13.261378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.286 [2024-10-07 13:35:13.262751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.262797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.286 [2024-10-07 13:35:13.267662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.267703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.286 [2024-10-07 13:35:13.267913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.286 [2024-10-07 13:35:13.267941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.286 [2024-10-07 13:35:13.267958] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.286 [2024-10-07 13:35:13.268052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.268076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.287 [2024-10-07 13:35:13.268092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.268116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.268148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.268169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.268184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.268207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.268223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.268237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.268250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.268273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.268289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.279623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.279657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.279860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.279894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.287 [2024-10-07 13:35:13.279911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.280024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.280050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.287 [2024-10-07 13:35:13.280066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.280238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.280268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.280462] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.280509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.280536] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.280554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.280569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.280583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.280633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.280657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.294418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.294451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.294864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.294894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.287 [2024-10-07 13:35:13.294911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.295016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.295042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.287 [2024-10-07 13:35:13.295057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.295249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.295277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.295481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.295514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.295529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.295546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.295561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.295588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.295639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.295659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.310015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.310048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.310428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.310459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.287 [2024-10-07 13:35:13.310500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.310616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.310643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.287 [2024-10-07 13:35:13.310659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.310882] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.310916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.311105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.311127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.311141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.311158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.311172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.311185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.311397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.311421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.324174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.324205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.324420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.324449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.287 [2024-10-07 13:35:13.324480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.324609] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.324636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.287 [2024-10-07 13:35:13.324652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.324677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.324699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.324726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.324741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.324755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.324772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.324787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.324823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.324847] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.324864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.334283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.334341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.287 [2024-10-07 13:35:13.334589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.334619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.287 [2024-10-07 13:35:13.334637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.337238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.287 [2024-10-07 13:35:13.337269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.287 [2024-10-07 13:35:13.337286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.287 [2024-10-07 13:35:13.337304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.339501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.287 [2024-10-07 13:35:13.339531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.339545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.339559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.339662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.339696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.287 [2024-10-07 13:35:13.339709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.287 [2024-10-07 13:35:13.339723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.287 [2024-10-07 13:35:13.339747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.287 [2024-10-07 13:35:13.344376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.344557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.344588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.288 [2024-10-07 13:35:13.344613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.344657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.344689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.344717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.344740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.344754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.344793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.344990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.345017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.288 [2024-10-07 13:35:13.345033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.345058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.345080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.345095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.345108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.345131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.355815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.355919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.356023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.356052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.288 [2024-10-07 13:35:13.356070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.356359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.356388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.288 [2024-10-07 13:35:13.356405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.356423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.356870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.356897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.356911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.356923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.357134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.357158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.357171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.357190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.357240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.366694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.366859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.367107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.367135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.288 [2024-10-07 13:35:13.367152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.367361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.367396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.288 [2024-10-07 13:35:13.367413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.367431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.367573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.367601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.367615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.367628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.367737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.367758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.367773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.367805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.370885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.376798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.376930] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.376959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.288 [2024-10-07 13:35:13.376981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.377008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.377049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.377069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.377083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.377111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.377131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.377342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.377376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.288 [2024-10-07 13:35:13.377395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.377420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.377444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.377459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.377505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.377536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.387689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.387766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.387923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.387951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.288 [2024-10-07 13:35:13.387968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.388496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.388537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.288 [2024-10-07 13:35:13.388555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.388574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.388804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.388830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.388845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.388859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.388920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.388940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.388967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.388980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.389151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.400897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.400929] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.401063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.401092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.288 [2024-10-07 13:35:13.401109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.401229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.401255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.288 [2024-10-07 13:35:13.401272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.401298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.401319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.401340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.401355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.401368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.401385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.401399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.401411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.288 [2024-10-07 13:35:13.401434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.401450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.288 [2024-10-07 13:35:13.416982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.417028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.288 [2024-10-07 13:35:13.417407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.417438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.288 [2024-10-07 13:35:13.417455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.417575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.288 [2024-10-07 13:35:13.417602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.288 [2024-10-07 13:35:13.417618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.288 [2024-10-07 13:35:13.417924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.417957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.288 [2024-10-07 13:35:13.418009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.288 [2024-10-07 13:35:13.418028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.288 [2024-10-07 13:35:13.418041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.418058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.418073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.418086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.418256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.418288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.431841] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.431873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.432046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.432079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.289 [2024-10-07 13:35:13.432095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.432214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.432240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.289 [2024-10-07 13:35:13.432257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.432722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.432751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.432988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.433012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.433026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.433053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.433068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.433080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.433349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.433373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.443402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.443435] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.443702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.443733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.289 [2024-10-07 13:35:13.443750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.443903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.443937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.289 [2024-10-07 13:35:13.443953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.446844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.446875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.447579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.447604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.447624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.447642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.447658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.447670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.448093] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.448118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.453518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.453565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.453682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.453709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.289 [2024-10-07 13:35:13.453726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.453987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.454021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.289 [2024-10-07 13:35:13.454038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.454057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.454194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.454219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.454233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.454245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.454384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.454408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.454422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.454435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.454582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.463601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.463805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.463835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.289 [2024-10-07 13:35:13.463851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.463887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.463918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.463951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.463967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.463992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.464014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.464185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.464211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.289 [2024-10-07 13:35:13.464228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.464252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.464275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.464290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.464304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.464327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.475763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.475812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.475956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.475983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.289 [2024-10-07 13:35:13.476008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.476162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.476189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.289 [2024-10-07 13:35:13.476205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.476239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.476259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.476279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.476294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.476307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.476323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.476337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.476350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.476373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.476389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.490216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.490255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.490583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.490614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.289 [2024-10-07 13:35:13.490632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.490750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.490791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.289 [2024-10-07 13:35:13.490818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.491018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.491046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.289 [2024-10-07 13:35:13.491235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.491258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.491272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.491290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.289 [2024-10-07 13:35:13.491304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.289 [2024-10-07 13:35:13.491317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.289 [2024-10-07 13:35:13.491537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.491562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.289 [2024-10-07 13:35:13.504482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.504524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.289 [2024-10-07 13:35:13.504718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.504749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.289 [2024-10-07 13:35:13.504767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.289 [2024-10-07 13:35:13.504921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.289 [2024-10-07 13:35:13.504947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.289 [2024-10-07 13:35:13.504963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.504988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.505009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.505043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.505072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.505086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.505108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.505123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.505136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.505159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.505176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.518884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.518916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.519041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.519068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.290 [2024-10-07 13:35:13.519085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.519199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.519225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.290 [2024-10-07 13:35:13.519241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.519265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.519286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.519307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.519321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.519335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.519351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.519365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.519378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.519401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.519418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.530096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.530128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.530464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.530519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.290 [2024-10-07 13:35:13.530536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.530794] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.530819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.290 [2024-10-07 13:35:13.530840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.530955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.530980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.531111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.531133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.531147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.531165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.531180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.531193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.531301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.531323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.540207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.540255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.540492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.540533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.290 [2024-10-07 13:35:13.540550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.540746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.540797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.290 [2024-10-07 13:35:13.540815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.540833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.540857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.540875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.540888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.540901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.540925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.540945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.540958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.540971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.540992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.550294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.550525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.550561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.290 [2024-10-07 13:35:13.550579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.550618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.550650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.550678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.550695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.550708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.550731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.550915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.550941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.290 [2024-10-07 13:35:13.550956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.550979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.551002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.290 [2024-10-07 13:35:13.551017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.290 [2024-10-07 13:35:13.551030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.290 [2024-10-07 13:35:13.551053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.290 [2024-10-07 13:35:13.562497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.562531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.290 [2024-10-07 13:35:13.562852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.562881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.290 [2024-10-07 13:35:13.562897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.563107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.290 [2024-10-07 13:35:13.563131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.290 [2024-10-07 13:35:13.563146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.290 [2024-10-07 13:35:13.564858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.290 [2024-10-07 13:35:13.564889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.565502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.565528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.565542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.565560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.565583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.565597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.565845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.565868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.573077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.573109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.573384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.573412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.291 [2024-10-07 13:35:13.573429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.573636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.573662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.291 [2024-10-07 13:35:13.573679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.575289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.575320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.575463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.575491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.575524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.575543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.575558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.575571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.578500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.578527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.583188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.583233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.583426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.583453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.291 [2024-10-07 13:35:13.583483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.584940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.584969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.291 [2024-10-07 13:35:13.584985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.585009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.585222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.585247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.585261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.585274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.585434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.585458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.585473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.585498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.585614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.593270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.593465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.593517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.291 [2024-10-07 13:35:13.593538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.593730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.593809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.593841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.593857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.593871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.593894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.594120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.594145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.291 [2024-10-07 13:35:13.594161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.594333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.594403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.594423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.594437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.594461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.604925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.605057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.291 [2024-10-07 13:35:13.605287] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.605320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.291 [2024-10-07 13:35:13.605337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.608481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.291 [2024-10-07 13:35:13.608529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.291 [2024-10-07 13:35:13.608546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.291 [2024-10-07 13:35:13.608566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.609320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.291 [2024-10-07 13:35:13.609348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.609362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.609375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.609779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.291 [2024-10-07 13:35:13.609803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.291 [2024-10-07 13:35:13.609816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.291 [2024-10-07 13:35:13.609829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.291 [2024-10-07 13:35:13.610067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.615012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.615228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.615256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.292 [2024-10-07 13:35:13.615273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.615297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.615336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.615355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.615369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.615394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.615413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.615628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.615665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.292 [2024-10-07 13:35:13.615680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.615704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.615729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.615749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.615763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.615801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.625094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.625321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.625349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.292 [2024-10-07 13:35:13.625366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.625390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.625416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.625433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.625447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.625494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.625534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.625738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.625765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.292 [2024-10-07 13:35:13.625781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.625820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.625842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.625857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.625871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.625893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.639099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.639133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.639289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.639334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.292 [2024-10-07 13:35:13.639351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.639445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.639470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.292 [2024-10-07 13:35:13.639508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.640382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.640420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.640636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.640662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.640678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.640697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.640712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.640726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.640980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.641003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.653723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.653759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.654209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.654240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.292 [2024-10-07 13:35:13.654273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.654429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.654456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.292 [2024-10-07 13:35:13.654498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.654805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.654839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.654973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.654997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.655012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.655029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.655045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.655059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.655289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.655312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.667827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.667876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.668170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.668200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.292 [2024-10-07 13:35:13.668223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.668443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.668482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.292 [2024-10-07 13:35:13.668514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.292 [2024-10-07 13:35:13.668558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.668583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.292 [2024-10-07 13:35:13.668605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.668621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.668634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.668651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.292 [2024-10-07 13:35:13.668667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.292 [2024-10-07 13:35:13.668680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.292 [2024-10-07 13:35:13.668704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.668720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.292 [2024-10-07 13:35:13.681533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.681568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.292 [2024-10-07 13:35:13.681895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.292 [2024-10-07 13:35:13.681926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.293 [2024-10-07 13:35:13.681944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.682117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.682143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.293 [2024-10-07 13:35:13.682159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.682201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.682225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.682247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.682262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.682275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.682291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.682316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.682329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.682358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.682383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.693162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.693195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.695198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.695229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.293 [2024-10-07 13:35:13.695247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.695417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.695441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.293 [2024-10-07 13:35:13.695476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.696270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.696300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.696566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.696590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.696604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.696623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.696638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.696651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.696702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.696724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.703276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.703323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.703585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.703620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.293 [2024-10-07 13:35:13.703637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.706276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.706306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.293 [2024-10-07 13:35:13.706323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.706352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.707118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.707151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.707166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.707180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.707339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.707362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.707387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.707399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.707532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.713360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.713589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.713620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.293 [2024-10-07 13:35:13.713637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.713674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.713706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.713735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.713751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.713776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.713815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.713990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.714015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.293 [2024-10-07 13:35:13.714030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.714054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.714078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.714092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.714105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.714128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.724886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.724919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.725104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.725133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.293 [2024-10-07 13:35:13.725150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.725265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.725291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.293 [2024-10-07 13:35:13.725307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.725332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.725353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.725374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.725389] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.725403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.725420] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.293 [2024-10-07 13:35:13.725436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.293 [2024-10-07 13:35:13.725448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.293 [2024-10-07 13:35:13.725497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.725516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.293 [2024-10-07 13:35:13.740342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.740378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.293 [2024-10-07 13:35:13.740599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.740628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.293 [2024-10-07 13:35:13.740645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.740766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.293 [2024-10-07 13:35:13.740818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.293 [2024-10-07 13:35:13.740834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.293 [2024-10-07 13:35:13.740858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.740879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.293 [2024-10-07 13:35:13.740899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.740914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.740927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.740943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.740958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.740970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.740993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.741017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.755074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.755108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.755463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.755517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.294 [2024-10-07 13:35:13.755538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.755640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.755667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.294 [2024-10-07 13:35:13.755683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.755904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.755933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.756128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.756153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.756167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.756186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.756200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.756213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.756261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.756281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.770054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.770088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.770690] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.770722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.294 [2024-10-07 13:35:13.770739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.770952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.770976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.294 [2024-10-07 13:35:13.770992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.771259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.771289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.771349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.771369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.771388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.771407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.771422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.771435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.771638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.771662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 8581.00 IOPS, 33.52 MiB/s [2024-10-07T11:35:19.227Z] [2024-10-07 13:35:13.784685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.784719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.784881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.784917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.294 [2024-10-07 13:35:13.784933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.785051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.785076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.294 [2024-10-07 13:35:13.785092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.785116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.785137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.785158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.785173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.785186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.785203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.785218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.785231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.785255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.785271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.800012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.800047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.800613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.800645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.294 [2024-10-07 13:35:13.800663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.800782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.800811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.294 [2024-10-07 13:35:13.800827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.801205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.801235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.801439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.801463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.801477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.801520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.801538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.801551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.801602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.801622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.294 [2024-10-07 13:35:13.815388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.815420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.294 [2024-10-07 13:35:13.815706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.815733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.294 [2024-10-07 13:35:13.815750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.815892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.294 [2024-10-07 13:35:13.815919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.294 [2024-10-07 13:35:13.815934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.294 [2024-10-07 13:35:13.815958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.815978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.294 [2024-10-07 13:35:13.815998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.816013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.816025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.294 [2024-10-07 13:35:13.816041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.294 [2024-10-07 13:35:13.816056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.294 [2024-10-07 13:35:13.816068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.816091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.816107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.827396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.827429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.829621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.829653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.295 [2024-10-07 13:35:13.829671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.829922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.829946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.295 [2024-10-07 13:35:13.829961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.830656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.830687] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.831070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.831095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.831109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.831127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.831142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.831154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.831215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.831235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.837707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.837740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.838429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.838458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.295 [2024-10-07 13:35:13.838500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.838597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.838621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.295 [2024-10-07 13:35:13.838644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.838692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.838717] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.838739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.838754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.838788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.838805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.838820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.838833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.838856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.838873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.847821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.847868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.848084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.848112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.295 [2024-10-07 13:35:13.848128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.848557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.848586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.295 [2024-10-07 13:35:13.848604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.848622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.848673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.848695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.848708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.848721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.848746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.848763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.848802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.848816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.848838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.859671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.859706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.859888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.859915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.295 [2024-10-07 13:35:13.859948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.860074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.860102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.295 [2024-10-07 13:35:13.860124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.860150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.860172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.860194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.860210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.860239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.860257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.860271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.860284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.860309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.860325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.869802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.869849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.870103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.870132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.295 [2024-10-07 13:35:13.870148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.870311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.870337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.295 [2024-10-07 13:35:13.870353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.295 [2024-10-07 13:35:13.870371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.875108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.295 [2024-10-07 13:35:13.875138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.875152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.875165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.875802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.875831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.295 [2024-10-07 13:35:13.875860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.295 [2024-10-07 13:35:13.875876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.295 [2024-10-07 13:35:13.876084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.295 [2024-10-07 13:35:13.879886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.295 [2024-10-07 13:35:13.880254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.295 [2024-10-07 13:35:13.880283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.295 [2024-10-07 13:35:13.880301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.880575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.880644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.880679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.880697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.880712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.880738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.880869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.880897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.296 [2024-10-07 13:35:13.880915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.881104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.881163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.881185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.881199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.881223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.894655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.894705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.894858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.894885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.296 [2024-10-07 13:35:13.894902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.895063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.895088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.296 [2024-10-07 13:35:13.895105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.895123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.895148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.895166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.895180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.895192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.895222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.895239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.895252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.895264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.895286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.905200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.905232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.905430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.905458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.296 [2024-10-07 13:35:13.905499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.905621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.905648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.296 [2024-10-07 13:35:13.905664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.905790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.905817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.905918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.905939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.905953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.905970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.905984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.905997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.908894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.908920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.917920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.917952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.918776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.918820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.296 [2024-10-07 13:35:13.918837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.918981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.919007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.296 [2024-10-07 13:35:13.919023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.921551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.921582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.922335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.922371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.922386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.922403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.922418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.922431] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.922855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.922880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.928031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.928077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.296 [2024-10-07 13:35:13.928293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.928321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.296 [2024-10-07 13:35:13.928337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.928553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.296 [2024-10-07 13:35:13.928579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.296 [2024-10-07 13:35:13.928604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.296 [2024-10-07 13:35:13.928622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.928648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.296 [2024-10-07 13:35:13.928666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.928680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.928693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.928716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.296 [2024-10-07 13:35:13.928733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.296 [2024-10-07 13:35:13.928746] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.296 [2024-10-07 13:35:13.928759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.296 [2024-10-07 13:35:13.928796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.938601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.938634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.938849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.938876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.297 [2024-10-07 13:35:13.938901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.939086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.939110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.297 [2024-10-07 13:35:13.939125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.939298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.939326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.939545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.939581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.939595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.939613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.939627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.939648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.939875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.939900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.952580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.952614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.953146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.953176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.297 [2024-10-07 13:35:13.953192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.953279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.953303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.297 [2024-10-07 13:35:13.953318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.953552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.953582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.953807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.953830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.953844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.953862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.953877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.953895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.953945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.953965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.967861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.967894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.968262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.968292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.297 [2024-10-07 13:35:13.968309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.968443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.968483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.297 [2024-10-07 13:35:13.968511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.968857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.968885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.969084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.969107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.969121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.969138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.969152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.969166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.969214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.969234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.982134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.982181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.982332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.982360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.297 [2024-10-07 13:35:13.982378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.982480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.982512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.297 [2024-10-07 13:35:13.982528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.982553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.982580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.982602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.982617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.982630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.982647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.982663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.982677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.982701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.982717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.997600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.997635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:13.997961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.997991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.297 [2024-10-07 13:35:13.998008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.998183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:13.998207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.297 [2024-10-07 13:35:13.998222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:13.998247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.998268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.297 [2024-10-07 13:35:13.998289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.998304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.998317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.998333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.297 [2024-10-07 13:35:13.998348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.297 [2024-10-07 13:35:13.998361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.297 [2024-10-07 13:35:13.998385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:13.998401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.297 [2024-10-07 13:35:14.013012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:14.013046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.297 [2024-10-07 13:35:14.013420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:14.013451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.297 [2024-10-07 13:35:14.013498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.297 [2024-10-07 13:35:14.013608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.297 [2024-10-07 13:35:14.013633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.298 [2024-10-07 13:35:14.013649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.013860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.013889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.013937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.013956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.013969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.013986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.014000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.014013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.014184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.014206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.027737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.027785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.028043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.028071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.298 [2024-10-07 13:35:14.028088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.028325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.028351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.298 [2024-10-07 13:35:14.028366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.028390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.028410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.028432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.028447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.028460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.028501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.028518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.028537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.028562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.028579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.042722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.042757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.043035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.043064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.298 [2024-10-07 13:35:14.043081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.043300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.043327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.298 [2024-10-07 13:35:14.043343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.043367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.043388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.043408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.043423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.043436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.043453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.043481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.043504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.043531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.043547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.055971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.056004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.056393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.056429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.298 [2024-10-07 13:35:14.056446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.056564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.056592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.298 [2024-10-07 13:35:14.056608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.056824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.056854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.056910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.056929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.056943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.056959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.056973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.056987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.057011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.057027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.068349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.068381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.068716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.068746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.298 [2024-10-07 13:35:14.068763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.068873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.068905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.298 [2024-10-07 13:35:14.068920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.071409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.071440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.072120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.072145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.072159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.072177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.072191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.072204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.072827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.072853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.298 [2024-10-07 13:35:14.078458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.078529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.298 [2024-10-07 13:35:14.078693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.078721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.298 [2024-10-07 13:35:14.078738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.078923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.298 [2024-10-07 13:35:14.078959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.298 [2024-10-07 13:35:14.078975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.298 [2024-10-07 13:35:14.078993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.079017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.298 [2024-10-07 13:35:14.079035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.298 [2024-10-07 13:35:14.079048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.298 [2024-10-07 13:35:14.079060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.298 [2024-10-07 13:35:14.079083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.079100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.079112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.079125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.081603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.088698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.088730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.088962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.088990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.299 [2024-10-07 13:35:14.089006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.089169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.089194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.299 [2024-10-07 13:35:14.089210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.089234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.089255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.089275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.089290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.089303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.089319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.089333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.089346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.089370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.089391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.100475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.100532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.100978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.101008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.299 [2024-10-07 13:35:14.101025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.101143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.101169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.299 [2024-10-07 13:35:14.101186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.101381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.101410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.101630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.101655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.101671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.101690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.101706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.101719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.101769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.101790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.110615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.111981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.112188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.112215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.299 [2024-10-07 13:35:14.112231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.116813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.116844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.299 [2024-10-07 13:35:14.116862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.116881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.116975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.116999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.117017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.117031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.117056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.117072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.117085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.117098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.117120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.122297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.122667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.122708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.299 [2024-10-07 13:35:14.122726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.122860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.122898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.123199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.123226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.299 [2024-10-07 13:35:14.123242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.123257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.123269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.123282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.123320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.123343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.123366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.123381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.123394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.123416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.132383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.132641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.132672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.299 [2024-10-07 13:35:14.132690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.132721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.132749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.132774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.132803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.132828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.132945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.133166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.299 [2024-10-07 13:35:14.133193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.299 [2024-10-07 13:35:14.133209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.299 [2024-10-07 13:35:14.133235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.299 [2024-10-07 13:35:14.133259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.299 [2024-10-07 13:35:14.133274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.299 [2024-10-07 13:35:14.133287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.299 [2024-10-07 13:35:14.133312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.299 [2024-10-07 13:35:14.146093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.299 [2024-10-07 13:35:14.146127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.146346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.146374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.300 [2024-10-07 13:35:14.146391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.146589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.146616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.300 [2024-10-07 13:35:14.146632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.146986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.147017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.147077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.147098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.147113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.147131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.147146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.147159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.147350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.147372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.161080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.161114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.161303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.161330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.300 [2024-10-07 13:35:14.161346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.161454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.161479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.300 [2024-10-07 13:35:14.161518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.161545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.161566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.161588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.161603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.161616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.161632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.161652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.161665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.161690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.161707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.175444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.175502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.176553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.176586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.300 [2024-10-07 13:35:14.176604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.176742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.176783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.300 [2024-10-07 13:35:14.176800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.177221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.177252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.177452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.177501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.177523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.177542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.177558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.177571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.178023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.178049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.190974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.191008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.191209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.191237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.300 [2024-10-07 13:35:14.191254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.191491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.191526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.300 [2024-10-07 13:35:14.191542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.191870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.191900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.191958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.191977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.191991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.192009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.192023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.192036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.192207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.192229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.300 [2024-10-07 13:35:14.205290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.205323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.300 [2024-10-07 13:35:14.205531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.205560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.300 [2024-10-07 13:35:14.205577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.205763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.300 [2024-10-07 13:35:14.205804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.300 [2024-10-07 13:35:14.205826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.300 [2024-10-07 13:35:14.205851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.205872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.300 [2024-10-07 13:35:14.205892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.205908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.205921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.205937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.300 [2024-10-07 13:35:14.205954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.300 [2024-10-07 13:35:14.205967] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.300 [2024-10-07 13:35:14.205991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.206007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.219202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.220069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.220220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.220247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.301 [2024-10-07 13:35:14.220263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.220503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.220529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.301 [2024-10-07 13:35:14.220545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.220563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.220589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.220607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.220621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.220634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.220659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.220676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.220689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.220703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.220724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.230078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.230377] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.230409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.301 [2024-10-07 13:35:14.230426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.230581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.230703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.230736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.230752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.230765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.230889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.231075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.231101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.301 [2024-10-07 13:35:14.231116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.231225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.231335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.231355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.231368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.231501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.240168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.240389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.240416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.301 [2024-10-07 13:35:14.240433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.240457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.240514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.240533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.240546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.240571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.240794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.241042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.241069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.301 [2024-10-07 13:35:14.241084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.241108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.241137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.241152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.241165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.241189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.250251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.250453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.250504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.301 [2024-10-07 13:35:14.250524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.250549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.250573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.250588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.250601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.250625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.250868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.251074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.251113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.301 [2024-10-07 13:35:14.251129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.251153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.251291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.251314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.251330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.251481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.264418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.264449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.264645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.264673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.301 [2024-10-07 13:35:14.264690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.264823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.264849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.301 [2024-10-07 13:35:14.264865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.264895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.264917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.301 [2024-10-07 13:35:14.264937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.264952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.264965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.264982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.301 [2024-10-07 13:35:14.264996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.301 [2024-10-07 13:35:14.265008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.301 [2024-10-07 13:35:14.265031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.265058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.301 [2024-10-07 13:35:14.274803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.274837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.301 [2024-10-07 13:35:14.277205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.301 [2024-10-07 13:35:14.277245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.301 [2024-10-07 13:35:14.277262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.301 [2024-10-07 13:35:14.277422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.277459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.302 [2024-10-07 13:35:14.277502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.278451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.278480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.278759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.278782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.278812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.278830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.278844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.278856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.279115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.279138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.285129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.285161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.285484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.285520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.302 [2024-10-07 13:35:14.285538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.285662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.285688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.302 [2024-10-07 13:35:14.285704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.285833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.285859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.285892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.285925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.285939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.285958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.285988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.286003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.286029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.286045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.295300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.295332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.295503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.295532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.302 [2024-10-07 13:35:14.295549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.295696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.295722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.302 [2024-10-07 13:35:14.295738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.295927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.295954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.296000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.296019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.296033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.296050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.296070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.296083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.296107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.296124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.308179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.308447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.308685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.308713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.302 [2024-10-07 13:35:14.308730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.308952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.308980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.302 [2024-10-07 13:35:14.308996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.309015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.309199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.309224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.309238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.309251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.309439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.309463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.309502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.309517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.309562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.318927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.318960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.321114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.321145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.302 [2024-10-07 13:35:14.321162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.321388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.321412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.302 [2024-10-07 13:35:14.321427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.322362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.322397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.322672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.322695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.322710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.322727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.322742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.322755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.302 [2024-10-07 13:35:14.323028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.323052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.302 [2024-10-07 13:35:14.329449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.329503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.302 [2024-10-07 13:35:14.329703] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.329731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.302 [2024-10-07 13:35:14.329748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.329950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.302 [2024-10-07 13:35:14.329975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.302 [2024-10-07 13:35:14.329990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.302 [2024-10-07 13:35:14.330015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.330034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.302 [2024-10-07 13:35:14.330056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.302 [2024-10-07 13:35:14.330072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.302 [2024-10-07 13:35:14.330086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.330102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.330116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.330129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.330153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.330170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.339588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.339637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.339890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.339918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.303 [2024-10-07 13:35:14.339940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.340116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.340141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.303 [2024-10-07 13:35:14.340156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.340174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.340199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.340217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.340231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.340244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.340282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.340312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.340326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.340339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.340362] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.350640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.350674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.350869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.350897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.303 [2024-10-07 13:35:14.350913] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.351069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.351094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.303 [2024-10-07 13:35:14.351110] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.351135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.351156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.351177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.351192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.351205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.351221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.351236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.351259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.351284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.351300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.361035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.361068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.364413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.364445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.303 [2024-10-07 13:35:14.364462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.364576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.364601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.303 [2024-10-07 13:35:14.364618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.366073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.366104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.366616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.366642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.366658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.366676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.366691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.366705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.366939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.366961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.371146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.371193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.371396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.371425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.303 [2024-10-07 13:35:14.371441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.371563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.371597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.303 [2024-10-07 13:35:14.371613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.371633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.371659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.371683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.371698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.371711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.371736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.371753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.371782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.371795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.371818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.382458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.382499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.382725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.382754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.303 [2024-10-07 13:35:14.382771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.383006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.303 [2024-10-07 13:35:14.383030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.303 [2024-10-07 13:35:14.383046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.303 [2024-10-07 13:35:14.383070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.383108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.303 [2024-10-07 13:35:14.383131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.383145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.383159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.383176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.303 [2024-10-07 13:35:14.383191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.303 [2024-10-07 13:35:14.383204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.303 [2024-10-07 13:35:14.383228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.383254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.303 [2024-10-07 13:35:14.397815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.397863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.303 [2024-10-07 13:35:14.398089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.398118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.304 [2024-10-07 13:35:14.398134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.398325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.398350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.304 [2024-10-07 13:35:14.398367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.398392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.398413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.398435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.398450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.398463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.398480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.398524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.398540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.398566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.398583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.412416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.412450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.413456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.413513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.304 [2024-10-07 13:35:14.413533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.413725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.413751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.304 [2024-10-07 13:35:14.413768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.414173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.414203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.414408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.414432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.414447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.414465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.414480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.414518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.414721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.414750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.422545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.422577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.423126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.423155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.304 [2024-10-07 13:35:14.423172] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.423336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.423360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.304 [2024-10-07 13:35:14.423375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.423629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.423657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.423680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.423696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.423710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.423727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.423741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.423755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.426221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.426247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.432692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.432724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.432862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.432888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.304 [2024-10-07 13:35:14.432905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.433018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.433044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.304 [2024-10-07 13:35:14.433060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.433234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.433262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.433309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.433333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.433347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.433365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.433379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.433392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.433416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.433432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.304 [2024-10-07 13:35:14.445906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.445938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.304 [2024-10-07 13:35:14.446134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.446165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.304 [2024-10-07 13:35:14.446182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.446303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.304 [2024-10-07 13:35:14.446329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.304 [2024-10-07 13:35:14.446345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.304 [2024-10-07 13:35:14.446545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.446574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.304 [2024-10-07 13:35:14.446784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.304 [2024-10-07 13:35:14.446807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.304 [2024-10-07 13:35:14.446822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.304 [2024-10-07 13:35:14.446838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.446853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.446865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.446914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.446933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.460569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.460603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.460956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.460986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.305 [2024-10-07 13:35:14.461003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.461145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.461176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.305 [2024-10-07 13:35:14.461192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.461386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.461414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.461460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.461506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.461521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.461540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.461555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.461568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.461745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.461769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.475301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.475332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.475495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.475525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.305 [2024-10-07 13:35:14.475542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.475664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.475691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.305 [2024-10-07 13:35:14.475707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.475732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.475753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.475775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.475790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.475818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.475835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.475850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.475862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.475886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.475903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.488213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.488246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.489878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.489909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.305 [2024-10-07 13:35:14.489926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.490042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.490066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.305 [2024-10-07 13:35:14.490082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.490140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.490165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.490186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.490202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.490214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.490231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.490246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.490259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.490282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.490299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.499821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.499853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.500106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.500135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.305 [2024-10-07 13:35:14.500153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.500313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.500338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.305 [2024-10-07 13:35:14.500354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.500475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.500516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.500625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.500646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.500666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.500685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.500700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.500713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.504322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.504348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.509933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.509979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.510093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.510122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.305 [2024-10-07 13:35:14.510139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.510275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.305 [2024-10-07 13:35:14.510301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.305 [2024-10-07 13:35:14.510317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.305 [2024-10-07 13:35:14.510334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.511825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.305 [2024-10-07 13:35:14.511853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.511870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.511883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.512004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.512026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.305 [2024-10-07 13:35:14.512040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.305 [2024-10-07 13:35:14.512053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.305 [2024-10-07 13:35:14.512159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.305 [2024-10-07 13:35:14.520018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.305 [2024-10-07 13:35:14.520172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.520201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.306 [2024-10-07 13:35:14.520219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.520256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.520287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.520315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.520336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.520350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.520374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.521250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.521283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.306 [2024-10-07 13:35:14.521301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.521576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.521724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.521748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.521763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.521804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.531791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.531824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.531975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.532004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.306 [2024-10-07 13:35:14.532022] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.532112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.532136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.306 [2024-10-07 13:35:14.532152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.532176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.532197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.532216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.532231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.532245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.532261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.532275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.532288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.532311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.532326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.542314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.542352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.546520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.546553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.306 [2024-10-07 13:35:14.546571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.546674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.546699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.306 [2024-10-07 13:35:14.546716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.546807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.546834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.546856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.546871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.546885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.546902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.546916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.546929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.546952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.546969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.553290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.553321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.553494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.553524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.306 [2024-10-07 13:35:14.553542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.553668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.553695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.306 [2024-10-07 13:35:14.553711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.554231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.554258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.554280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.554295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.554309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.554330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.554345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.554357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.554381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.554397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.563790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.563838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.563973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.564002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.306 [2024-10-07 13:35:14.564019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.564139] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.564166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.306 [2024-10-07 13:35:14.564182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.564205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.564226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.564247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.564262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.564275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.564291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.306 [2024-10-07 13:35:14.564306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.306 [2024-10-07 13:35:14.564318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.306 [2024-10-07 13:35:14.564342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.564358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.306 [2024-10-07 13:35:14.574549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.574582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.306 [2024-10-07 13:35:14.574708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.574754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.306 [2024-10-07 13:35:14.574772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.574910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.306 [2024-10-07 13:35:14.574936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.306 [2024-10-07 13:35:14.574952] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.306 [2024-10-07 13:35:14.574982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.306 [2024-10-07 13:35:14.575003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.575023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.575037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.575050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.575067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.575082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.575094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.575117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.575133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.590004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.590038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.590240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.590269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.307 [2024-10-07 13:35:14.590286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.590411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.590436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.307 [2024-10-07 13:35:14.590452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.590500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.590524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.590545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.590560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.590574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.590591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.590606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.590619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.590954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.590978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.601464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.601521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.601739] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.601769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.307 [2024-10-07 13:35:14.601802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.601899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.601926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.307 [2024-10-07 13:35:14.601941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.602048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.602074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.604796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.604822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.604837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.604854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.604869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.604881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.605907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.605933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.611608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.611655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.611813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.611841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.307 [2024-10-07 13:35:14.611858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.611985] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.612012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.307 [2024-10-07 13:35:14.612028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.612046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.612072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.612089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.612102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.612115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.612139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.612160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.612174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.612187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.612209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.621693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.621860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.621889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.307 [2024-10-07 13:35:14.621906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.621943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.621974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.622001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.622017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.622030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.622053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.622174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.622199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.307 [2024-10-07 13:35:14.622215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.622239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.622262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.622277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.622289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.622312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.633904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.634216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.307 [2024-10-07 13:35:14.634388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.634417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.307 [2024-10-07 13:35:14.634434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.634741] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.307 [2024-10-07 13:35:14.634785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.307 [2024-10-07 13:35:14.634802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.307 [2024-10-07 13:35:14.634822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.635098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.307 [2024-10-07 13:35:14.635125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.635139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.635151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.307 [2024-10-07 13:35:14.635216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.307 [2024-10-07 13:35:14.635252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.307 [2024-10-07 13:35:14.635271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.307 [2024-10-07 13:35:14.635285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.635483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.647222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.647255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.647512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.647542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.308 [2024-10-07 13:35:14.647560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.647704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.647732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.308 [2024-10-07 13:35:14.647748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.647773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.647795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.647832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.647847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.647861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.647877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.647892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.647904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.647928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.647945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.658437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.658492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.658619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.658649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.308 [2024-10-07 13:35:14.658673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.658797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.658839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.308 [2024-10-07 13:35:14.658855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.658879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.658901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.658922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.658936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.658950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.658967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.658981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.658995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.659019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.659034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.668589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.668622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.668763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.668806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.308 [2024-10-07 13:35:14.668823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.668969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.668995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.308 [2024-10-07 13:35:14.669011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.669035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.669057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.669078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.669092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.669105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.669121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.669135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.669153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.669178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.669194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.678704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.678752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.678933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.678961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.308 [2024-10-07 13:35:14.678978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.679133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.679159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.308 [2024-10-07 13:35:14.679175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.679193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.679218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.679236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.679249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.679261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.679286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.679303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.679316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.679329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.679350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.688804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.688957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.688986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.308 [2024-10-07 13:35:14.689004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.689041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.689071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.308 [2024-10-07 13:35:14.689099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.308 [2024-10-07 13:35:14.689114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.308 [2024-10-07 13:35:14.689128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.308 [2024-10-07 13:35:14.689151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.308 [2024-10-07 13:35:14.689301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.308 [2024-10-07 13:35:14.689328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.308 [2024-10-07 13:35:14.689345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.308 [2024-10-07 13:35:14.689369] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.308 [2024-10-07 13:35:14.689392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.689406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.689420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.689443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.700761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.700809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.701408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.701438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.309 [2024-10-07 13:35:14.701454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.701625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.701652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.309 [2024-10-07 13:35:14.701669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.701959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.701987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.702034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.702053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.702066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.702083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.702097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.702109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.702148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.702167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.712571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.712605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.712937] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.712967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.309 [2024-10-07 13:35:14.712990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.713115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.713142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.309 [2024-10-07 13:35:14.713158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.713350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.713378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.713424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.713443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.713456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.713474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.713510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.713527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.713554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.713572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.722903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.722935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.723106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.723135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.309 [2024-10-07 13:35:14.723153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.723270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.723296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.309 [2024-10-07 13:35:14.723312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.726060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.726090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.727079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.727104] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.727118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.727135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.727149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.727162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.727860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.727885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.733239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.733268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.733413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.733441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.309 [2024-10-07 13:35:14.733458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.733602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.733629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.309 [2024-10-07 13:35:14.733646] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.733671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.733692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.733723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.733741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.733755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.733772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.733786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.733814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.733839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.733855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.743545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.743594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.743712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.743742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.309 [2024-10-07 13:35:14.743759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.743896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.743922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.309 [2024-10-07 13:35:14.743937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.309 [2024-10-07 13:35:14.743955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.744366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.309 [2024-10-07 13:35:14.744393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.744412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.744426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.744683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.744710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.309 [2024-10-07 13:35:14.744724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.309 [2024-10-07 13:35:14.744738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.309 [2024-10-07 13:35:14.744950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.309 [2024-10-07 13:35:14.756449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.756506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.309 [2024-10-07 13:35:14.756825] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.309 [2024-10-07 13:35:14.756855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.310 [2024-10-07 13:35:14.756872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.756958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.756981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.310 [2024-10-07 13:35:14.756997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.757189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.757217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.757440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.757463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.757477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.757522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.757540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.757553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.757607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.757628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.769325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.769357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.769992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.770021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.310 [2024-10-07 13:35:14.770038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.770189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.770216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.310 [2024-10-07 13:35:14.770232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.770599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.770629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.770860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.770883] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.770897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.770914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.770928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.770940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.770989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.771009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 8598.58 IOPS, 33.59 MiB/s [2024-10-07T11:35:19.243Z] [2024-10-07 13:35:14.780214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.780244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.780512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.780542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.310 [2024-10-07 13:35:14.780559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.780655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.780680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.310 [2024-10-07 13:35:14.780695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.781957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.781985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.784265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.784290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.784304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.784321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.784335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.784348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.784721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.784752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.790320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.790365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.790541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.790570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.310 [2024-10-07 13:35:14.790587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.790715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.790742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.310 [2024-10-07 13:35:14.790758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.790791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.792008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.792035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.792049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.792061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.792253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.792276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.792290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.792303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.792434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.800402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.800572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.800601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.310 [2024-10-07 13:35:14.800619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.800825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.800886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.800919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.800935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.800948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.800971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.801066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.801091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.310 [2024-10-07 13:35:14.801116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.801142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.801165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.310 [2024-10-07 13:35:14.801180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.310 [2024-10-07 13:35:14.801193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.310 [2024-10-07 13:35:14.801216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.310 [2024-10-07 13:35:14.812802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.812834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.310 [2024-10-07 13:35:14.813003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.813032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.310 [2024-10-07 13:35:14.813048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.813141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.310 [2024-10-07 13:35:14.813167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.310 [2024-10-07 13:35:14.813182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.310 [2024-10-07 13:35:14.813571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.310 [2024-10-07 13:35:14.813600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.813821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.813844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.813858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.813875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.813889] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.813902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.814330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.814354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.823478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.823519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.823761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.823792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.311 [2024-10-07 13:35:14.823823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.823943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.823968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.311 [2024-10-07 13:35:14.823990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.827092] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.827122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.827921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.827946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.827960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.827977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.827992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.828004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.828398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.828421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.833600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.833648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.833829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.833857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.311 [2024-10-07 13:35:14.833873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.833968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.833994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.311 [2024-10-07 13:35:14.834010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.834027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.834052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.834070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.834082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.834095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.834128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.834147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.834160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.834172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.834194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.843685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.844019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.844050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.311 [2024-10-07 13:35:14.844067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.844144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.844179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.844206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.844223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.844236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.844679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.844831] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.844858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.311 [2024-10-07 13:35:14.844874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.845080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.845135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.845155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.845169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.845193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.856209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.856242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.856798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.856828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.311 [2024-10-07 13:35:14.856844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.856960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.856984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.311 [2024-10-07 13:35:14.856999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.857203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.857231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.857442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.857465] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.857480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.857529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.857545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.857558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.857770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.857809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.311 [2024-10-07 13:35:14.866961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.866994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.311 [2024-10-07 13:35:14.870812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.870844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.311 [2024-10-07 13:35:14.870861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.871007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.311 [2024-10-07 13:35:14.871033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.311 [2024-10-07 13:35:14.871048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.311 [2024-10-07 13:35:14.872063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.872094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.311 [2024-10-07 13:35:14.872456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.872504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.872520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.311 [2024-10-07 13:35:14.872539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.311 [2024-10-07 13:35:14.872553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.311 [2024-10-07 13:35:14.872566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.872930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.872955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.877092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.877138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.877273] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.877301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.312 [2024-10-07 13:35:14.877318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.877860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.877888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.312 [2024-10-07 13:35:14.877909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.877928] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.877996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.878018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.878031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.878044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.878069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.878085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.878098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.878110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.878132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.887175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.887354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.887383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.312 [2024-10-07 13:35:14.887400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.887622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.887687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.887721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.887738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.887752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.887939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.888096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.888124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.312 [2024-10-07 13:35:14.888140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.888361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.888419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.888440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.888454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.888480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.901781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.901817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.902171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.902201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.312 [2024-10-07 13:35:14.902219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.902339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.902364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.312 [2024-10-07 13:35:14.902379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.902601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.902630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.902679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.902698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.902712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.902730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.902745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.902758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.902945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.902968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.915349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.915381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.915536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.915567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.312 [2024-10-07 13:35:14.915585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.915731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.915757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.312 [2024-10-07 13:35:14.915774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.915812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.915833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.915854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.915869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.915882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.915898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.915917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.915931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.915954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.915971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.927460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.927515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.927776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.927821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.312 [2024-10-07 13:35:14.927839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.927954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.927980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.312 [2024-10-07 13:35:14.927996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.312 [2024-10-07 13:35:14.928105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.928131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.312 [2024-10-07 13:35:14.928232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.928253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.928266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.928283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.312 [2024-10-07 13:35:14.928297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.312 [2024-10-07 13:35:14.928310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.312 [2024-10-07 13:35:14.928415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.928435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.312 [2024-10-07 13:35:14.937986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.938019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.312 [2024-10-07 13:35:14.938220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.312 [2024-10-07 13:35:14.938249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.312 [2024-10-07 13:35:14.938266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.938379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.938404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.313 [2024-10-07 13:35:14.938420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.938558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.938586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.938691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.938712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.938727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.938744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.938759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.938772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.938823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.938843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.948158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.948190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.948519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.948550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.313 [2024-10-07 13:35:14.948567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.948687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.948714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.313 [2024-10-07 13:35:14.948731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.948939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.948968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.949013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.949032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.949046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.949063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.949077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.949089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.949261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.949284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.961412] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.961445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.961842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.961877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.313 [2024-10-07 13:35:14.961894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.962016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.962040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.313 [2024-10-07 13:35:14.962056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.962318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.962347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.962569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.962594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.962609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.962626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.962641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.962654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.962704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.962724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.972220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.972252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.972511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.972541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.313 [2024-10-07 13:35:14.972560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.972685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.972712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.313 [2024-10-07 13:35:14.972728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.972852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.972879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.972981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.973002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.973016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.973033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.973048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.973066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.976248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.976274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.982331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.982376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.982527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.982555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.313 [2024-10-07 13:35:14.982572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.982667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.982693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.313 [2024-10-07 13:35:14.982709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.313 [2024-10-07 13:35:14.982728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.982753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.313 [2024-10-07 13:35:14.982771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.982784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.982797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.982822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.982839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.313 [2024-10-07 13:35:14.982867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.313 [2024-10-07 13:35:14.982880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.313 [2024-10-07 13:35:14.982902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.313 [2024-10-07 13:35:14.992413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.313 [2024-10-07 13:35:14.992591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.313 [2024-10-07 13:35:14.992622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.314 [2024-10-07 13:35:14.992639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:14.992677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:14.992709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:14.992737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:14.992753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:14.992767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:14.992811] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:14.992957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:14.992984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.314 [2024-10-07 13:35:14.993000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:14.993024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:14.993047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:14.993061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:14.993075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:14.993097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.004859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.004892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.005172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.005202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.314 [2024-10-07 13:35:15.005219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.005336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.005362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.314 [2024-10-07 13:35:15.005377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.005425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.005449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.005470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.005510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.005528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.005546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.005561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.005573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.005830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.005854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.016568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.016601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.016818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.016863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.314 [2024-10-07 13:35:15.016886] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.017037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.017065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.314 [2024-10-07 13:35:15.017097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.017225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.017253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.017373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.017394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.017407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.017425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.017439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.017451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.020558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.020585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.026682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.026728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.026906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.026934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.314 [2024-10-07 13:35:15.026950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.027101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.027126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.314 [2024-10-07 13:35:15.027141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.027159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.027184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.027201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.027215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.027227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.027251] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.027268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.027280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.027298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.027320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.036767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.036940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.036970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.314 [2024-10-07 13:35:15.036987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.037023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.037054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.037082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.037097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.037111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.037134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.037258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.037283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.314 [2024-10-07 13:35:15.037299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.037323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.314 [2024-10-07 13:35:15.037346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.314 [2024-10-07 13:35:15.037360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.314 [2024-10-07 13:35:15.037373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.314 [2024-10-07 13:35:15.037396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.314 [2024-10-07 13:35:15.048191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.048223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.314 [2024-10-07 13:35:15.048430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.048458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.314 [2024-10-07 13:35:15.048500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.314 [2024-10-07 13:35:15.048604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.314 [2024-10-07 13:35:15.048631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.314 [2024-10-07 13:35:15.048647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.048757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.048799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.048907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.048929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.048943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.048960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.048975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.048988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.051552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.051579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.058868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.058903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.059047] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.059074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.315 [2024-10-07 13:35:15.059091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.059210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.059237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.315 [2024-10-07 13:35:15.059253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.059277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.059297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.059317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.059332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.059345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.059361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.059375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.059388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.059411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.059426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.068982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.069035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.069238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.069266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.315 [2024-10-07 13:35:15.069283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.069755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.069785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.315 [2024-10-07 13:35:15.069818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.069837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.069887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.069908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.069921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.069934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.069981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.070000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.070014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.070026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.070049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.081595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.081635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.082013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.082042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.315 [2024-10-07 13:35:15.082060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.082208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.082233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.315 [2024-10-07 13:35:15.082249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.082439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.082467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.082683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.082717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.082731] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.082750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.082765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.082778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.082836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.082864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.096123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.096155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.096323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.096351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.315 [2024-10-07 13:35:15.096368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.096447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.096473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.315 [2024-10-07 13:35:15.096512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.096540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.096561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.096582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.096597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.096610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.096627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.096642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.096655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.096678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.096706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.315 [2024-10-07 13:35:15.106641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.106674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.315 [2024-10-07 13:35:15.110834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.110865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.315 [2024-10-07 13:35:15.110882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.110970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.315 [2024-10-07 13:35:15.110994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.315 [2024-10-07 13:35:15.111010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.315 [2024-10-07 13:35:15.111093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.111123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.315 [2024-10-07 13:35:15.111145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.111159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.111178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.315 [2024-10-07 13:35:15.111195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.315 [2024-10-07 13:35:15.111209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.315 [2024-10-07 13:35:15.111222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.111246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.111262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.117923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.117955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.118157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.118186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.316 [2024-10-07 13:35:15.118203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.118398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.118424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.316 [2024-10-07 13:35:15.118439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.118463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.118508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.118541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.118556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.118569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.118585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.118606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.118618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.118643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.118664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.128149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.128180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.128416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.128444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.316 [2024-10-07 13:35:15.128461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.128597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.128630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.316 [2024-10-07 13:35:15.128648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.128673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.128694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.128715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.128730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.128744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.128761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.128776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.128789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.128840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.128856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.139926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.139960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.140260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.140290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.316 [2024-10-07 13:35:15.140308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.140403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.140429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.316 [2024-10-07 13:35:15.140445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.140519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.140545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.140820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.140845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.140860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.140878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.140908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.140922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.140977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.141000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.153347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.153380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.155419] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.155451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.316 [2024-10-07 13:35:15.155468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.155633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.155660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.316 [2024-10-07 13:35:15.155677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.156308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.156337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.156735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.156760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.156774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.156817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.156831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.156844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.157049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.157072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.163530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.163561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.163733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.163762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.316 [2024-10-07 13:35:15.163779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.163929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.163955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.316 [2024-10-07 13:35:15.163971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.316 [2024-10-07 13:35:15.163994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.164015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.316 [2024-10-07 13:35:15.164035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.164049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.164068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.164085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.316 [2024-10-07 13:35:15.164099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.316 [2024-10-07 13:35:15.164119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.316 [2024-10-07 13:35:15.164142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.164158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.316 [2024-10-07 13:35:15.173642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.173691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.316 [2024-10-07 13:35:15.173833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.316 [2024-10-07 13:35:15.173862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.316 [2024-10-07 13:35:15.173878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.174047] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.174073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.317 [2024-10-07 13:35:15.174089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.174107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.174132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.174150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.174163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.174175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.174199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.174216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.174229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.174241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.174262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.185844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.185876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.186021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.186048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.317 [2024-10-07 13:35:15.186065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.186178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.186204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.317 [2024-10-07 13:35:15.186224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.186398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.186425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.186699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.186724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.186747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.186766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.186781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.186794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.187031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.187055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.200687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.200721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.200976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.201005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.317 [2024-10-07 13:35:15.201021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.201136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.201161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.317 [2024-10-07 13:35:15.201176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.201201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.201222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.201242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.201263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.201276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.201292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.201307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.201319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.201343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.201358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.211677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.211711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.213498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.213529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.317 [2024-10-07 13:35:15.213547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.213657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.213683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.317 [2024-10-07 13:35:15.213699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.215762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.215793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.216549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.216575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.216597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.216615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.216630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.216643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.217029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.217053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.221810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.221857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.317 [2024-10-07 13:35:15.222041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.222069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.317 [2024-10-07 13:35:15.222085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.222208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.317 [2024-10-07 13:35:15.222234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.317 [2024-10-07 13:35:15.222250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.317 [2024-10-07 13:35:15.222268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.222293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.317 [2024-10-07 13:35:15.222317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.222330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.222343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.222367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.222388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.317 [2024-10-07 13:35:15.222401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.317 [2024-10-07 13:35:15.222417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.317 [2024-10-07 13:35:15.222440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.317 [2024-10-07 13:35:15.231895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.232104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.232134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.318 [2024-10-07 13:35:15.232151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.232188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.232219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.232246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.232264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.232277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.232300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.232511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.232539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.318 [2024-10-07 13:35:15.232556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.232690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.232887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.232911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.232925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.232973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.243755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.243789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.244169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.244199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.318 [2024-10-07 13:35:15.244216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.244333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.244359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.318 [2024-10-07 13:35:15.244375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.244621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.244651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.244709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.244728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.244743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.244760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.244775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.244787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.244974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.245003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.254404] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.254436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.254668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.254699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.318 [2024-10-07 13:35:15.254717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.254864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.254890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.318 [2024-10-07 13:35:15.254906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.255012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.255039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.255156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.255188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.255202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.255219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.255236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.255248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.259412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.259439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.264520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.264569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.264739] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.264787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.318 [2024-10-07 13:35:15.264805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.265000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.265026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.318 [2024-10-07 13:35:15.265042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.265060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.265085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.265102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.265115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.265127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.265152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.265168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.265181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.265194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.265215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.274607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.274873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.274903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.318 [2024-10-07 13:35:15.274920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.274957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.274988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.275016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.275032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.275045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.275068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.275281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.275306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.318 [2024-10-07 13:35:15.275322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.275346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.275371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.318 [2024-10-07 13:35:15.275391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.318 [2024-10-07 13:35:15.275405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.318 [2024-10-07 13:35:15.275429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.318 [2024-10-07 13:35:15.285075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.285437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.318 [2024-10-07 13:35:15.285483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.318 [2024-10-07 13:35:15.285512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.318 [2024-10-07 13:35:15.285626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.318 [2024-10-07 13:35:15.285664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.318 [2024-10-07 13:35:15.290096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.290127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.319 [2024-10-07 13:35:15.290144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.290159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.290171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.290184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.290846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.290876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.290958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.290978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.290992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.291017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.295161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.295387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.295416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.319 [2024-10-07 13:35:15.295433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.295457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.295508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.295525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.295539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.295563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.295707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.295941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.295969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.319 [2024-10-07 13:35:15.295985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.296009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.296033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.296047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.296060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.296082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.305243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.305519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.305566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.319 [2024-10-07 13:35:15.305585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.305611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.305636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.305652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.305666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.305690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.305783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.306051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.306079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.319 [2024-10-07 13:35:15.306095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.306119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.306142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.306157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.306170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.306193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.319126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.320028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.320205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.320232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.319 [2024-10-07 13:35:15.320253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.320885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.320916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.319 [2024-10-07 13:35:15.320933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.320953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.321158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.321182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.321196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.321209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.321672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.321700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.321715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.321729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.321953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.329641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.329990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.330021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.319 [2024-10-07 13:35:15.330038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.330144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.333884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.333912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.333927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.334734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.334765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.335522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.335552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.319 [2024-10-07 13:35:15.335570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.335787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.336017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.336042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.336063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.336115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.339910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.340159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.340187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.319 [2024-10-07 13:35:15.340204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.319 [2024-10-07 13:35:15.340228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.319 [2024-10-07 13:35:15.340253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.319 [2024-10-07 13:35:15.340269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.319 [2024-10-07 13:35:15.340281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.319 [2024-10-07 13:35:15.340305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.319 [2024-10-07 13:35:15.348289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.319 [2024-10-07 13:35:15.348699] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.319 [2024-10-07 13:35:15.348731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.320 [2024-10-07 13:35:15.348749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.348960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.349018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.349038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.349053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.349077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.349992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.350180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.350208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.320 [2024-10-07 13:35:15.350224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.350247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.350270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.350285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.350299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.350322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.361908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.361946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.362196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.362225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.320 [2024-10-07 13:35:15.362242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.362392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.362419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.320 [2024-10-07 13:35:15.362434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.362464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.362511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.362541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.362557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.362571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.362588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.362603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.362615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.362639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.362655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.372232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.372264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.374202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.374233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.320 [2024-10-07 13:35:15.374251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.374394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.374418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.320 [2024-10-07 13:35:15.374433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.376651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.376684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.377551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.377576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.377591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.377610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.377633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.377648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.377953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.377977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.383167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.383199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.383453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.383503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.320 [2024-10-07 13:35:15.383522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.383687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.383714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.320 [2024-10-07 13:35:15.383731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.383756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.383792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.383813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.383828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.383841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.383858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.383872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.383884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.383907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.383928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.393626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.393660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.393868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.393896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.320 [2024-10-07 13:35:15.393912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.394094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.394119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.320 [2024-10-07 13:35:15.394136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.394419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.394447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.320 [2024-10-07 13:35:15.394707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.394733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.394750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.394768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.320 [2024-10-07 13:35:15.394783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.320 [2024-10-07 13:35:15.394812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.320 [2024-10-07 13:35:15.394860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.394880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.320 [2024-10-07 13:35:15.405966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.406005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.320 [2024-10-07 13:35:15.406279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.406310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.320 [2024-10-07 13:35:15.406327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.406411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.320 [2024-10-07 13:35:15.406436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.320 [2024-10-07 13:35:15.406456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.320 [2024-10-07 13:35:15.406697] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.406745] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.407234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.407261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.407277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.407296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.407311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.407324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.407580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.407604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.421120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.421154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.421347] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.421379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.321 [2024-10-07 13:35:15.421398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.421613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.421640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.321 [2024-10-07 13:35:15.421658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.422134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.422166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.422386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.422411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.422427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.422445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.422460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.422502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.422823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.422848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.435911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.435945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.436510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.436541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.321 [2024-10-07 13:35:15.436558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.436688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.436725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.321 [2024-10-07 13:35:15.436741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.436961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.436990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.437180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.437205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.437219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.437237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.437251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.437270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.437321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.437341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.446237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.446270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.446576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.446607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.321 [2024-10-07 13:35:15.446624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.446749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.446780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.321 [2024-10-07 13:35:15.446811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.446920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.446945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.447079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.447102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.447115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.447133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.447148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.447160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.451063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.451091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.456953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.456985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.457305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.457336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.321 [2024-10-07 13:35:15.457353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.457538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.457564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.321 [2024-10-07 13:35:15.457580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.321 [2024-10-07 13:35:15.457690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.457723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.321 [2024-10-07 13:35:15.457842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.457863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.457877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.457894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.321 [2024-10-07 13:35:15.457909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.321 [2024-10-07 13:35:15.457921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.321 [2024-10-07 13:35:15.458056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.458079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.321 [2024-10-07 13:35:15.467063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.467111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.321 [2024-10-07 13:35:15.467306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.321 [2024-10-07 13:35:15.467338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.321 [2024-10-07 13:35:15.467354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.467563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.467589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.322 [2024-10-07 13:35:15.467606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.467625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.467651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.467669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.467684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.467698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.467724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.467740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.467753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.467766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.467804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.479389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.479422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.479654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.479683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.322 [2024-10-07 13:35:15.479706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.479836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.479862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.322 [2024-10-07 13:35:15.479888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.479912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.479933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.479954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.479969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.479982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.479998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.480013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.480025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.480050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.480066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.493203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.493235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.493477] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.493528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.322 [2024-10-07 13:35:15.493546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.493773] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.493815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.322 [2024-10-07 13:35:15.493831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.493856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.493876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.493897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.493912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.493926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.493942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.493956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.493968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.493997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.494014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.503423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.503455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.503723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.503752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.322 [2024-10-07 13:35:15.503768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.503958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.503982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.322 [2024-10-07 13:35:15.503998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.507081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.507113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.507861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.507886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.507900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.507917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.507931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.507944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.509171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.509196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.513567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.513598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.513852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.513880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.322 [2024-10-07 13:35:15.513897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.514017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.514042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.322 [2024-10-07 13:35:15.514057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.514266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.514295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.514351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.514371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.514384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.514400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.322 [2024-10-07 13:35:15.514415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.322 [2024-10-07 13:35:15.514427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.322 [2024-10-07 13:35:15.514451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.514481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.322 [2024-10-07 13:35:15.525851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.525885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.322 [2024-10-07 13:35:15.526325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.526356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.322 [2024-10-07 13:35:15.526372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.526563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.322 [2024-10-07 13:35:15.526589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.322 [2024-10-07 13:35:15.526605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.322 [2024-10-07 13:35:15.526946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.526976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.322 [2024-10-07 13:35:15.527034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.527053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.527067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.527083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.527098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.527111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.527282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.527304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.541894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.541927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.542232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.542261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.323 [2024-10-07 13:35:15.542278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.542494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.542530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.323 [2024-10-07 13:35:15.542547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.542572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.542594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.542614] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.542629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.542643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.542659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.542675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.542688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.542713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.542730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.555988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.556020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.556242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.556271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.323 [2024-10-07 13:35:15.556288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.556401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.556427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.323 [2024-10-07 13:35:15.556442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.556482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.556515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.556538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.556553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.556566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.556593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.556608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.556621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.556645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.556666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.566098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.566144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.566382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.566408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.323 [2024-10-07 13:35:15.566424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.571007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.571037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.323 [2024-10-07 13:35:15.571054] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.571072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.571350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.571378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.571392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.571406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.572078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.572104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.572118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.572131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.572548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.576182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.576423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.576453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.323 [2024-10-07 13:35:15.576552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.576758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.576990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.577026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.577043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.577055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.577103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.577244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.577271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.323 [2024-10-07 13:35:15.577303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.577521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.577579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.577600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.577614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.577639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.589797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.589831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.323 [2024-10-07 13:35:15.590000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.590028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.323 [2024-10-07 13:35:15.590045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.590217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.323 [2024-10-07 13:35:15.590242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.323 [2024-10-07 13:35:15.590258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.323 [2024-10-07 13:35:15.590284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.590304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.323 [2024-10-07 13:35:15.590325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.590341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.590354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.590371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.323 [2024-10-07 13:35:15.590385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.323 [2024-10-07 13:35:15.590398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.323 [2024-10-07 13:35:15.590422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.590438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.323 [2024-10-07 13:35:15.600968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.601002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.601300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.601331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.324 [2024-10-07 13:35:15.601348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.601575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.601606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.324 [2024-10-07 13:35:15.601623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.601742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.601769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.601906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.601928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.601942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.601959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.601974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.601986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.602096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.602117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.611128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.611162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.611362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.611390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.324 [2024-10-07 13:35:15.611407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.611627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.611654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.324 [2024-10-07 13:35:15.611670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.611695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.611718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.611739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.611753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.611767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.611799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.611814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.611827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.611850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.611867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.621241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.621438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.621673] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.621704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.324 [2024-10-07 13:35:15.621721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.621941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.621967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.324 [2024-10-07 13:35:15.621984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.622002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.622242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.622267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.622280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.622294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.622343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.622363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.622376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.622389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.622412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.635142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.635176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.635572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.635604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.324 [2024-10-07 13:35:15.635621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.635813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.635839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.324 [2024-10-07 13:35:15.635855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.636053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.636082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.636207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.636230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.636250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.636268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.636282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.636295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.636338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.636358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.647510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.647554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.647841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.647871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.324 [2024-10-07 13:35:15.647889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.647996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.648020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.324 [2024-10-07 13:35:15.648038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.648084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.648109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.324 [2024-10-07 13:35:15.648130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.648146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.648159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.648175] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.324 [2024-10-07 13:35:15.648191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.324 [2024-10-07 13:35:15.648203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.324 [2024-10-07 13:35:15.648227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.648242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.324 [2024-10-07 13:35:15.662836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.662871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.324 [2024-10-07 13:35:15.663009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.663037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.324 [2024-10-07 13:35:15.663053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.663182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.324 [2024-10-07 13:35:15.663208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.324 [2024-10-07 13:35:15.663229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.324 [2024-10-07 13:35:15.663254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.663275] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.663295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.663311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.663323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.663340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.663354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.663366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.663389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.663406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.674804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.674838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.675082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.675112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.325 [2024-10-07 13:35:15.675129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.675258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.675284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.325 [2024-10-07 13:35:15.675300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.677286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.677316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.678311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.678336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.678350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.678368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.678382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.678395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.678794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.678819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.684915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.686146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.686395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.686423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.325 [2024-10-07 13:35:15.686440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.686808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.686851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.325 [2024-10-07 13:35:15.686868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.686886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.687012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.687038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.687052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.687081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.687214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.687238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.687253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.687268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.687396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.695331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.695463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.695519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.325 [2024-10-07 13:35:15.695539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.695564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.695589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.695604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.695617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.695641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.696410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.696587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.696616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.325 [2024-10-07 13:35:15.696634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.696659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.696689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.696705] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.696719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.696750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.706452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.706611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.706642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.325 [2024-10-07 13:35:15.706660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.706696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.706728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.706760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.706793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.706807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.706831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.707012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.707038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.325 [2024-10-07 13:35:15.707054] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.707078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.707101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.707116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.707131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.707155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.325 [2024-10-07 13:35:15.722358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.722390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.325 [2024-10-07 13:35:15.722731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.722775] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.325 [2024-10-07 13:35:15.722808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.722940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.325 [2024-10-07 13:35:15.722967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.325 [2024-10-07 13:35:15.722998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.325 [2024-10-07 13:35:15.723267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.723296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.325 [2024-10-07 13:35:15.723347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.723367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.325 [2024-10-07 13:35:15.723390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.325 [2024-10-07 13:35:15.723406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.325 [2024-10-07 13:35:15.723421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.723434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.723642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.723667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.737871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.737905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.738196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.738226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.326 [2024-10-07 13:35:15.738242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.738383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.738410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.326 [2024-10-07 13:35:15.738438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.738652] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.738682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.738730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.738750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.738765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.738783] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.738798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.738812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.738837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.738854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.750721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.750756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.751135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.751165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.326 [2024-10-07 13:35:15.751182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.751309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.751335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.326 [2024-10-07 13:35:15.751351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.751715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.751746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.751807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.751827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.751841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.751858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.751873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.751887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.752114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.752137] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.760857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.760904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.761057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.761086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.326 [2024-10-07 13:35:15.761102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.761229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.761254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.326 [2024-10-07 13:35:15.761270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.761288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.763826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.763865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.763880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.763893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.764874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.764902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.764922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.764937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.765177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.770942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.771164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.771195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.326 [2024-10-07 13:35:15.771213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.771438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.771523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.771559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.771577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.771591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.771616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 [2024-10-07 13:35:15.771760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.771804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.326 [2024-10-07 13:35:15.771833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.771873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.771898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.326 [2024-10-07 13:35:15.771914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.326 [2024-10-07 13:35:15.771943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.326 [2024-10-07 13:35:15.771966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.326 8610.46 IOPS, 33.63 MiB/s [2024-10-07T11:35:19.259Z] [2024-10-07 13:35:15.784684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.784714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.326 [2024-10-07 13:35:15.786144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.786174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.326 [2024-10-07 13:35:15.786190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.786338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.326 [2024-10-07 13:35:15.786363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.326 [2024-10-07 13:35:15.786393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.326 [2024-10-07 13:35:15.787117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.326 [2024-10-07 13:35:15.787170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.787457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.787481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.787504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.787539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.787554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.787568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.787621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.787642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.796286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.796333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.796627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.796659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.327 [2024-10-07 13:35:15.796677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.796812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.796853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.327 [2024-10-07 13:35:15.796868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.796984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.797010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.799496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.799523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.799539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.799558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.799573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.799585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.800560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.800586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.806413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.806460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.806633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.806660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.327 [2024-10-07 13:35:15.806682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.806852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.806879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.327 [2024-10-07 13:35:15.806895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.806913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.806938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.806957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.806970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.806983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.807007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.807024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.807037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.807061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.807083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.816576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.816625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.816790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.816820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.327 [2024-10-07 13:35:15.816838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.817209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.817238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.327 [2024-10-07 13:35:15.817254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.817272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.817482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.817519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.817533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.817547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.817614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.817637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.817650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.817669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.817693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.831013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.831063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.831249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.831279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.327 [2024-10-07 13:35:15.831297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.831434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.831463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.327 [2024-10-07 13:35:15.831503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.831546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.831569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.327 [2024-10-07 13:35:15.831591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.831606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.831620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.831637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.327 [2024-10-07 13:35:15.831652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.327 [2024-10-07 13:35:15.831665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.327 [2024-10-07 13:35:15.831690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.831707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.327 [2024-10-07 13:35:15.841146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.841197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.327 [2024-10-07 13:35:15.841427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.841456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.327 [2024-10-07 13:35:15.841496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.842565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.327 [2024-10-07 13:35:15.842595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.327 [2024-10-07 13:35:15.842613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.327 [2024-10-07 13:35:15.842633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.842671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.842698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.842713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.842726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.842752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.842785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.842798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.842816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.842838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.851231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.851570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.851603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.328 [2024-10-07 13:35:15.851622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.851688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.851722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.851752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.851769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.851799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.851977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.852157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.852184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.328 [2024-10-07 13:35:15.852201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.852248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.852275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.852290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.852303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.852327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.864816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.864850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.865100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.865130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.328 [2024-10-07 13:35:15.865148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.865363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.865390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.328 [2024-10-07 13:35:15.865406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.865858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.865888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.866128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.866153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.866168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.866185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.866200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.866214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.866430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.866452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.879309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.879343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.879570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.879600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.328 [2024-10-07 13:35:15.879617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.879851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.879877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.328 [2024-10-07 13:35:15.879893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.879917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.879938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.879959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.879974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.879988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.880004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.880018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.328 [2024-10-07 13:35:15.880031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.328 [2024-10-07 13:35:15.880060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.880088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.328 [2024-10-07 13:35:15.889422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.889473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.328 [2024-10-07 13:35:15.889729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.889758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.328 [2024-10-07 13:35:15.889776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.892413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.328 [2024-10-07 13:35:15.892444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.328 [2024-10-07 13:35:15.892475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.328 [2024-10-07 13:35:15.892511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.893759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.328 [2024-10-07 13:35:15.893802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.328 [2024-10-07 13:35:15.893817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.893830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.894153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.894178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.894192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.894208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.894340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.899674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.899707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.899847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.899874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.329 [2024-10-07 13:35:15.899891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.900061] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.900088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.329 [2024-10-07 13:35:15.900104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.900128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.900149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.900169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.900190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.900205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.900221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.900236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.900248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.900272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.900300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.911431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.911463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.911732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.911762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.329 [2024-10-07 13:35:15.911794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.911933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.911960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.329 [2024-10-07 13:35:15.911976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.912002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.912023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.912044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.912059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.912072] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.912090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.912105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.912118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.912142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.912159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.926815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.926848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.927037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.927076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.329 [2024-10-07 13:35:15.927093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.927233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.927268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.329 [2024-10-07 13:35:15.927284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.927308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.927328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.927348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.927363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.927376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.927392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.927406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.927418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.927441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.927469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.942164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.942206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.943300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.943341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.329 [2024-10-07 13:35:15.943359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.943502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.943528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.329 [2024-10-07 13:35:15.943544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.943943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.943972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.944422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.944447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.944461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.944478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.944518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.944533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.944748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.944771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.329 [2024-10-07 13:35:15.956409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.956441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.329 [2024-10-07 13:35:15.956710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.956740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.329 [2024-10-07 13:35:15.956757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.956993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.329 [2024-10-07 13:35:15.957020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.329 [2024-10-07 13:35:15.957036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.329 [2024-10-07 13:35:15.957061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.957082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.329 [2024-10-07 13:35:15.957102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.957116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.329 [2024-10-07 13:35:15.957130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.329 [2024-10-07 13:35:15.957146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.329 [2024-10-07 13:35:15.957160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:15.957173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:15.957196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:15.957212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:15.972242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:15.972275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:15.972518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:15.972547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.330 [2024-10-07 13:35:15.972565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:15.972727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:15.972752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.330 [2024-10-07 13:35:15.972782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:15.972807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:15.972827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:15.972848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:15.972863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:15.972881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:15.972898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:15.972913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:15.972925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:15.972949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:15.972964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:15.986522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:15.986557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:15.986814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:15.986842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.330 [2024-10-07 13:35:15.986860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:15.987049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:15.987074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.330 [2024-10-07 13:35:15.987090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:15.987114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:15.987135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:15.987155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:15.987170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:15.987183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:15.987199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:15.987240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:15.987254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:15.987310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:15.987332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:15.998680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:15.998715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:15.999047] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:15.999077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.330 [2024-10-07 13:35:15.999094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:15.999214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:15.999239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.330 [2024-10-07 13:35:15.999262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:16.003088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:16.003122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:16.003637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:16.003664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:16.003678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:16.003696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:16.003711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:16.003724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:16.003956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:16.003979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:16.008808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:16.008854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:16.009071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:16.009099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.330 [2024-10-07 13:35:16.009116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:16.009417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:16.009444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.330 [2024-10-07 13:35:16.009460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:16.009501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:16.009661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:16.009687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:16.009701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:16.009714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:16.009880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:16.009902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:16.009916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:16.009930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.330 [2024-10-07 13:35:16.010068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.330 [2024-10-07 13:35:16.018890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:16.019186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.330 [2024-10-07 13:35:16.019216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.330 [2024-10-07 13:35:16.019233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.330 [2024-10-07 13:35:16.019271] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.330 [2024-10-07 13:35:16.019302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.330 [2024-10-07 13:35:16.019329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.330 [2024-10-07 13:35:16.019345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.330 [2024-10-07 13:35:16.019358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.019381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.019616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.019642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.331 [2024-10-07 13:35:16.019658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.019683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.019707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.019722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.019736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.019760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.031535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.031581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.031809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.031837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.331 [2024-10-07 13:35:16.031853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.032085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.032109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.331 [2024-10-07 13:35:16.032125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.032149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.032171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.032193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.032208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.032220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.032242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.032258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.032270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.032294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.032310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.045997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.046030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.046447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.046501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.331 [2024-10-07 13:35:16.046521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.046652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.046680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.331 [2024-10-07 13:35:16.046696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.046918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.046946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.046992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.047012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.047026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.047044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.047059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.047071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.047243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.047265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.058975] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.059009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.060276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.060307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.331 [2024-10-07 13:35:16.060324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.060442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.060467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.331 [2024-10-07 13:35:16.060482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.060981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.061011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.061461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.061508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.061526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.061546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.061561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.061575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.061790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.061827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.074401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.074434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.074663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.074692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.331 [2024-10-07 13:35:16.074708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.074898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.074922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.331 [2024-10-07 13:35:16.074937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.074962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.074982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.075003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.075018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.075031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.075048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.075062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.075074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.075110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.075126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.331 [2024-10-07 13:35:16.089074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.089107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.331 [2024-10-07 13:35:16.089315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.089342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.331 [2024-10-07 13:35:16.089360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.089565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.331 [2024-10-07 13:35:16.089591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.331 [2024-10-07 13:35:16.089607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.331 [2024-10-07 13:35:16.089633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.089654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.331 [2024-10-07 13:35:16.089674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.089689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.089703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.331 [2024-10-07 13:35:16.089720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.331 [2024-10-07 13:35:16.089735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.331 [2024-10-07 13:35:16.089747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.089771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.089788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.104674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.104708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.105048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.105077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.332 [2024-10-07 13:35:16.105095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.105286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.105310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.332 [2024-10-07 13:35:16.105326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.105670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.105701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.105996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.106021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.332 [2024-10-07 13:35:16.106036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.106053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.106073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.332 [2024-10-07 13:35:16.106087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.106142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.106162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.119825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.119859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.120352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.120383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.332 [2024-10-07 13:35:16.120400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.120597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.120623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.332 [2024-10-07 13:35:16.120639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.120990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.121020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.121077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.121096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.332 [2024-10-07 13:35:16.121110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.121126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.121141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.332 [2024-10-07 13:35:16.121154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.121325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.121348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.133983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.134016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.134234] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.134261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.332 [2024-10-07 13:35:16.134277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.134434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.134460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.332 [2024-10-07 13:35:16.134476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.134526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.134555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.134591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.134610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.332 [2024-10-07 13:35:16.134623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.134641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.134655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.332 [2024-10-07 13:35:16.134672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.134697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.134715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.332 [2024-10-07 13:35:16.148408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.148441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.332 [2024-10-07 13:35:16.149072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.149102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.332 [2024-10-07 13:35:16.149119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.149286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.332 [2024-10-07 13:35:16.149312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.332 [2024-10-07 13:35:16.149327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.332 [2024-10-07 13:35:16.149726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.149758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.332 [2024-10-07 13:35:16.149979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.150002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.332 [2024-10-07 13:35:16.150017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.332 [2024-10-07 13:35:16.150034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.332 [2024-10-07 13:35:16.150049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.150062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.150254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.150278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.158786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.158821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.159129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.159165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.333 [2024-10-07 13:35:16.159184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.159307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.159334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.333 [2024-10-07 13:35:16.159350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.159375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.159400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.159426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.159440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.159453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.159469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.159484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.159524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.162206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.162233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.168918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.168967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.169232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.169259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.333 [2024-10-07 13:35:16.169275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.169773] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.169804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.333 [2024-10-07 13:35:16.169821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.169855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.170049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.170076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.170090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.170104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.170153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.170173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.170192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.170207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.170231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.180928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.180961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.181147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.181174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.333 [2024-10-07 13:35:16.181190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.181360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.181385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.333 [2024-10-07 13:35:16.181402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.181426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.181448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.181468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.181484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.181506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.181525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.181540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.181553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.181577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.181593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.191945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.191978] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.192264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.192294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.333 [2024-10-07 13:35:16.192311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.192428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.192454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.333 [2024-10-07 13:35:16.192496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.192614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.192642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.192755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.192803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.192817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.192835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.192850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.192863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.192971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.192992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.202585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.202620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.203022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.203052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.333 [2024-10-07 13:35:16.203070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.203264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.333 [2024-10-07 13:35:16.203289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.333 [2024-10-07 13:35:16.203305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.333 [2024-10-07 13:35:16.203411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.203438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.333 [2024-10-07 13:35:16.203653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.203679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.203694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.203713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.333 [2024-10-07 13:35:16.203727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.333 [2024-10-07 13:35:16.203740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.333 [2024-10-07 13:35:16.203790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.203826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.333 [2024-10-07 13:35:16.212731] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.333 [2024-10-07 13:35:16.212780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.212969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.212997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.334 [2024-10-07 13:35:16.213019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.213305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.213334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.334 [2024-10-07 13:35:16.213350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.213370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.213420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.213442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.213455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.213468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.213670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.213694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.213709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.213723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.213773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.225625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.225659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.226508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.226540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.334 [2024-10-07 13:35:16.226557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.226685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.226710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.334 [2024-10-07 13:35:16.226726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.227093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.227122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.227180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.227199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.227213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.227229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.227244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.227257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.227287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.227304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.239502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.239536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.239893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.239923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.334 [2024-10-07 13:35:16.239940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.240087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.240113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.334 [2024-10-07 13:35:16.240130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.240322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.240350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.240567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.240592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.240607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.240625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.240640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.240654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.240705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.240725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.252279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.252312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.252650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.252682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.334 [2024-10-07 13:35:16.252700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.252842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.252868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.334 [2024-10-07 13:35:16.252884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.253518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.253557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.253846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.253876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.253892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.253909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.253924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.253937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.253990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.254011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.267324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.267356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.267872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.267901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.334 [2024-10-07 13:35:16.267918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.268010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.268035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.334 [2024-10-07 13:35:16.268051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.268269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.268297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.334 [2024-10-07 13:35:16.268344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.268363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.268376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.268393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.334 [2024-10-07 13:35:16.268408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.334 [2024-10-07 13:35:16.268420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.334 [2024-10-07 13:35:16.268444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.268460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.334 [2024-10-07 13:35:16.280148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.280182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.334 [2024-10-07 13:35:16.281120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.281150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.334 [2024-10-07 13:35:16.281167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.334 [2024-10-07 13:35:16.281326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.334 [2024-10-07 13:35:16.281352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.334 [2024-10-07 13:35:16.281368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.281810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.281840] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.282044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.282067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.282082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.282099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.282114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.282126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.282264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.282286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.290258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.290305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.290446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.290494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.335 [2024-10-07 13:35:16.290513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.293113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.293143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.335 [2024-10-07 13:35:16.293160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.293179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.295751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.295795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.295810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.295823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.296160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.296186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.296200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.296213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.296417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.300343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.300538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.300568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.335 [2024-10-07 13:35:16.300586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.300624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.300656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.300685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.300702] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.300716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.300739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.300905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.300931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.335 [2024-10-07 13:35:16.300948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.300972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.300995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.301010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.301023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.301047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.310427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.310705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.310735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.335 [2024-10-07 13:35:16.310753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.310779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.310830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.310849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.310862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.310887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.310920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.311127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.311154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.335 [2024-10-07 13:35:16.311179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.311205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.311228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.311243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.311256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.311280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.325021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.325054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.335 [2024-10-07 13:35:16.325269] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.325298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.335 [2024-10-07 13:35:16.325315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.325476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.335 [2024-10-07 13:35:16.325511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.335 [2024-10-07 13:35:16.325528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.335 [2024-10-07 13:35:16.326566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.326605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.335 [2024-10-07 13:35:16.327210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.327235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.327249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.327266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.335 [2024-10-07 13:35:16.327281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.335 [2024-10-07 13:35:16.327293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.335 [2024-10-07 13:35:16.327599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.327625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.335 [2024-10-07 13:35:16.336926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.336958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.337168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.337198] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.336 [2024-10-07 13:35:16.337216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.337392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.337418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.336 [2024-10-07 13:35:16.337440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.337556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.337583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.337685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.337706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.337719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.337740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.337754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.337767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.337882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.337902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.347039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.347086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.347299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.347327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.336 [2024-10-07 13:35:16.347344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.347463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.347513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.336 [2024-10-07 13:35:16.347531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.347550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.347576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.347594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.347608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.347621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.347646] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.347663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.347676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.347696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.347718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.357318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.357356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.357523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.357554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.336 [2024-10-07 13:35:16.357571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.357669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.357696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.336 [2024-10-07 13:35:16.357712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.357903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.357931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.358127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.358151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.358166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.358184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.358199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.358211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.358268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.358287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.371184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.371217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.371595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.371626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.336 [2024-10-07 13:35:16.371644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.371739] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.371766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.336 [2024-10-07 13:35:16.371782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.372016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.372044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.372091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.372110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.372123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.372145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.372160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.372173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.372345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.372372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.385602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.385635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.385828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.385856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.336 [2024-10-07 13:35:16.385874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.385966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.385992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.336 [2024-10-07 13:35:16.386007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.386032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.386053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.336 [2024-10-07 13:35:16.386074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.386095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.386108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.386125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.336 [2024-10-07 13:35:16.386139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.336 [2024-10-07 13:35:16.386151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.336 [2024-10-07 13:35:16.386174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.386190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.336 [2024-10-07 13:35:16.395722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.398234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.336 [2024-10-07 13:35:16.398407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.398435] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.336 [2024-10-07 13:35:16.398451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.336 [2024-10-07 13:35:16.400372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.336 [2024-10-07 13:35:16.400402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.336 [2024-10-07 13:35:16.400418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.400442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.400549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.400573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.400587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.400600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.400626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.400643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.400657] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.400670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.400693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.407239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.407531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.407577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.337 [2024-10-07 13:35:16.407596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.407751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.407903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.407926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.407941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.408054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.408568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.408761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.408791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.337 [2024-10-07 13:35:16.408824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.408852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.408878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.408893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.408907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.408931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.417326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.417500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.417535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.337 [2024-10-07 13:35:16.417553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.417732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.417812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.417844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.417858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.417883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.418667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.418867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.418894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.337 [2024-10-07 13:35:16.418910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.418934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.418958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.418972] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.418985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.419008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.431310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.431342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.431686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.431717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.337 [2024-10-07 13:35:16.431735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.431866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.431892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.337 [2024-10-07 13:35:16.431908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.432100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.432128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.432183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.432202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.432216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.432237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.432256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.432270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.432441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.432496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.444874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.444905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.445118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.445147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.337 [2024-10-07 13:35:16.445164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.445256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.445282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.337 [2024-10-07 13:35:16.445297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.445322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.445342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.445363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.445378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.445391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.445407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.445428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.445440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.445463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.445516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.337 [2024-10-07 13:35:16.455336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.455368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.337 [2024-10-07 13:35:16.455636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.455667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.337 [2024-10-07 13:35:16.455684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.455838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.337 [2024-10-07 13:35:16.455864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.337 [2024-10-07 13:35:16.455880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.337 [2024-10-07 13:35:16.455988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.456026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.337 [2024-10-07 13:35:16.456140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.337 [2024-10-07 13:35:16.456160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.337 [2024-10-07 13:35:16.456174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.337 [2024-10-07 13:35:16.456191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.456210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.456223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.459081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.459107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.465610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.465642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.466874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.466904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.338 [2024-10-07 13:35:16.466921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.467070] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.467094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.338 [2024-10-07 13:35:16.467109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.467208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.467234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.467270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.467288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.467302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.467319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.467333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.467349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.467372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.467388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.475981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.476012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.476190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.476224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.338 [2024-10-07 13:35:16.476241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.476327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.476353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.338 [2024-10-07 13:35:16.476369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.476393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.476414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.476435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.476450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.476463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.476504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.476521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.476534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.476685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.476709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.488913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.488945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.489337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.489367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.338 [2024-10-07 13:35:16.489384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.489483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.489518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.338 [2024-10-07 13:35:16.489534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.489797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.489826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.490038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.490062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.490076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.490093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.490108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.490126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.490318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.490351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.503216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.503249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.503664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.503696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.338 [2024-10-07 13:35:16.503713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.503855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.503880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.338 [2024-10-07 13:35:16.503896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.504089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.504117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.504307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.504330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.504344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.504361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.504380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.504392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.504450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.504494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.519378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.519411] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.519800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.519831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.338 [2024-10-07 13:35:16.519848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.519963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.519988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.338 [2024-10-07 13:35:16.520004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.338 [2024-10-07 13:35:16.520196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.520224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.338 [2024-10-07 13:35:16.520423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.520450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.520464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.520516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.338 [2024-10-07 13:35:16.520532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.338 [2024-10-07 13:35:16.520546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.338 [2024-10-07 13:35:16.520604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.520634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.338 [2024-10-07 13:35:16.533429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.533461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.338 [2024-10-07 13:35:16.533680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.338 [2024-10-07 13:35:16.533722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.339 [2024-10-07 13:35:16.533740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.533867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.533893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.339 [2024-10-07 13:35:16.533909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.533933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.533961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.533981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.533996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.534009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.534025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.534039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.534063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.534088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.534104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.546100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.546132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.548774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.548821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.339 [2024-10-07 13:35:16.548843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.548954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.548979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.339 [2024-10-07 13:35:16.548995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.550342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.550372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.550903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.550927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.550949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.550966] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.550980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.550992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.551208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.551231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.556211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.556258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.556411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.556439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.339 [2024-10-07 13:35:16.556455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.556621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.556660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.339 [2024-10-07 13:35:16.556676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.556694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.556731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.556749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.556762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.556775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.556840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.556859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.556879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.556897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.556920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.566328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.566374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.566627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.566657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.339 [2024-10-07 13:35:16.566674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.567149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.567177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.339 [2024-10-07 13:35:16.567194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.567212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.567269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.567291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.567304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.567316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.567355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.567374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.567387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.567400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.567428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.578513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.578546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.339 [2024-10-07 13:35:16.578973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.579002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.339 [2024-10-07 13:35:16.579019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.579102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.339 [2024-10-07 13:35:16.579127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.339 [2024-10-07 13:35:16.579143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.339 [2024-10-07 13:35:16.579346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.579377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.339 [2024-10-07 13:35:16.579596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.579625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.579640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.579658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.339 [2024-10-07 13:35:16.579675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.339 [2024-10-07 13:35:16.579688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.339 [2024-10-07 13:35:16.579748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.339 [2024-10-07 13:35:16.579769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.593759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.593817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.594105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.594134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.340 [2024-10-07 13:35:16.594150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.594260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.594285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.340 [2024-10-07 13:35:16.594301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.594564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.594603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.594651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.594670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.594684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.594701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.594719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.594731] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.595155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.595179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.606842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.606874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.607232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.607263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.340 [2024-10-07 13:35:16.607280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.607366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.607392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.340 [2024-10-07 13:35:16.607408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.607627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.607668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.608181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.608204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.608218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.608235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.608249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.608261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.608515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.608542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.617121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.617152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.617360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.617388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.340 [2024-10-07 13:35:16.617404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.617533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.617560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.340 [2024-10-07 13:35:16.617576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.620123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.620153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.621025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.621049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.621063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.621080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.621094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.621106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.621765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.621814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.627231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.627277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.627531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.627561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.340 [2024-10-07 13:35:16.627578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.627731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.627758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.340 [2024-10-07 13:35:16.627773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.627806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.629746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.629774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.629814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.629827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.630040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.630064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.630078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.630100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.630841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.637314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.637550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.637581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.340 [2024-10-07 13:35:16.637599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.637637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.637685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.637718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.637734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.637758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.637782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.637995] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.638021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.340 [2024-10-07 13:35:16.638042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.638067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.340 [2024-10-07 13:35:16.638105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.340 [2024-10-07 13:35:16.638122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.340 [2024-10-07 13:35:16.638135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.340 [2024-10-07 13:35:16.638157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.340 [2024-10-07 13:35:16.648877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.648910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.340 [2024-10-07 13:35:16.649135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.649164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.340 [2024-10-07 13:35:16.649181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.340 [2024-10-07 13:35:16.649304] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.340 [2024-10-07 13:35:16.649329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.341 [2024-10-07 13:35:16.649345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.649555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.649596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.650083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.650107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.650121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.650138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.650153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.650166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.650419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.650443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.659635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.659669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.659975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.660007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.341 [2024-10-07 13:35:16.660025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.660118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.660148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.341 [2024-10-07 13:35:16.660172] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.660285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.660328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.660447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.660503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.660521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.660543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.660561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.660575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.663929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.663956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.670016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.670064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.670369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.670398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.341 [2024-10-07 13:35:16.670415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.670554] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.670581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.341 [2024-10-07 13:35:16.670597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.670654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.670678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.670700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.670716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.670729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.670746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.670761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.670792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.670817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.670833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.680150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.680203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.680349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.680375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.341 [2024-10-07 13:35:16.680392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.680809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.680838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.341 [2024-10-07 13:35:16.680854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.680872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.681066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.681100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.681114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.681127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.681177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.681197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.681210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.681223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.681392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.692236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.692274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.692421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.692450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.341 [2024-10-07 13:35:16.692465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.692671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.692699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.341 [2024-10-07 13:35:16.692715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.692905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.692933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.693153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.693176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.693190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.693221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.693236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.341 [2024-10-07 13:35:16.693249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.341 [2024-10-07 13:35:16.693299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.693318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.341 [2024-10-07 13:35:16.702708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.702742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.341 [2024-10-07 13:35:16.703066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.703096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.341 [2024-10-07 13:35:16.703112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.703203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.341 [2024-10-07 13:35:16.703227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.341 [2024-10-07 13:35:16.703243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.341 [2024-10-07 13:35:16.703350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.703387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.341 [2024-10-07 13:35:16.703532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.341 [2024-10-07 13:35:16.703555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.703570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.703587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.703602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.703614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.706652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.706679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.713099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.713130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.713403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.713432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.342 [2024-10-07 13:35:16.713449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.713609] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.713637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.342 [2024-10-07 13:35:16.713653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.713767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.713806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.713936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.713957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.713971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.713988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.714003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.714015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.714122] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.714142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.723550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.723583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.723735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.723762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.342 [2024-10-07 13:35:16.723778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.723881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.723905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.342 [2024-10-07 13:35:16.723920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.723944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.723963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.723983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.723997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.724010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.724026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.724039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.724058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.724081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.724096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.736624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.736657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.736870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.736899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.342 [2024-10-07 13:35:16.736915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.737054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.737079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.342 [2024-10-07 13:35:16.737095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.737226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.737264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.737624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.737649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.737664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.737682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.737697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.737719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.737950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.737974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.748849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.748881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.749155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.749184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.342 [2024-10-07 13:35:16.749201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.749315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.749340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.342 [2024-10-07 13:35:16.749356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.751319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.751349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.752151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.752175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.752189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.752207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.752225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.752238] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.752514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.752540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.759251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.759294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.342 [2024-10-07 13:35:16.759508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.759538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.342 [2024-10-07 13:35:16.759555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.759666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.342 [2024-10-07 13:35:16.759693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.342 [2024-10-07 13:35:16.759709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.342 [2024-10-07 13:35:16.759734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.759755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.342 [2024-10-07 13:35:16.759777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.759807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.759820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.759836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.342 [2024-10-07 13:35:16.759851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.342 [2024-10-07 13:35:16.759863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.342 [2024-10-07 13:35:16.759897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.342 [2024-10-07 13:35:16.759914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.769403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.769456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.769619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.769649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.343 [2024-10-07 13:35:16.769667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.770007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.770035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.343 [2024-10-07 13:35:16.770051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.770074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.770135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.770157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.770171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.770184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.770208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.770225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.770238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.770251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.770272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.780842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.780875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.781097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.781126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.343 [2024-10-07 13:35:16.781142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.781282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.781308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.343 [2024-10-07 13:35:16.781324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.781348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.781369] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.781390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.781404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.781417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.781434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.781447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.781460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.781511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.781529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 8613.36 IOPS, 33.65 MiB/s [2024-10-07T11:35:19.276Z] [2024-10-07 13:35:16.795610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.795644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.796462] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.796524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.343 [2024-10-07 13:35:16.796545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.796662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.796689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.343 [2024-10-07 13:35:16.796705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.797206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.797235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.797303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.797323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.797337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.797365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.797380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.797392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.797426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.797442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.808772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.808822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.809085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.809114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.343 [2024-10-07 13:35:16.809130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.809227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.809253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.343 [2024-10-07 13:35:16.809269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.811546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.811579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.812502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.812528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.812544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.812562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.812578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.812597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.813022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.813046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.818901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.818947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.343 [2024-10-07 13:35:16.819154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.819183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.343 [2024-10-07 13:35:16.819199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.819321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.343 [2024-10-07 13:35:16.819347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.343 [2024-10-07 13:35:16.819363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.343 [2024-10-07 13:35:16.819380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.821516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.343 [2024-10-07 13:35:16.821545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.821560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.343 [2024-10-07 13:35:16.821573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.343 [2024-10-07 13:35:16.822190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.343 [2024-10-07 13:35:16.822216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.343 [2024-10-07 13:35:16.822240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.822253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.822396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.828985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.829143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.829172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.344 [2024-10-07 13:35:16.829189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.829226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.829257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.829285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.829301] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.829314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.829342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.829464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.829512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.344 [2024-10-07 13:35:16.829531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.829556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.829580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.829596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.829609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.829633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.840952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.840984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.841116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.841143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.344 [2024-10-07 13:35:16.841159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.841276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.841303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.344 [2024-10-07 13:35:16.841318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.841343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.841364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.841384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.841399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.841412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.841428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.841443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.841456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.841479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.841521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.853767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.853801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.855429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.855461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.344 [2024-10-07 13:35:16.855484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.855611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.855637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.344 [2024-10-07 13:35:16.855654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.855713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.855737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.855760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.855777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.855791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.855823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.855838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.855850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.855874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.855891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.868450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.868483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.869534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.869566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.344 [2024-10-07 13:35:16.869584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.869697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.869724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.344 [2024-10-07 13:35:16.869741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.870251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.870279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.870515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.870540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.870554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.870572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.870586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.870600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.870673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.870695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.879281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.879315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.879558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.879589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.344 [2024-10-07 13:35:16.879606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.879699] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.344 [2024-10-07 13:35:16.879725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.344 [2024-10-07 13:35:16.879741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.344 [2024-10-07 13:35:16.879864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.879891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.344 [2024-10-07 13:35:16.879993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.880025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.880039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.880056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.344 [2024-10-07 13:35:16.880070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.344 [2024-10-07 13:35:16.880090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.344 [2024-10-07 13:35:16.880194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.880214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.344 [2024-10-07 13:35:16.889394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.344 [2024-10-07 13:35:16.889440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.889585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.889614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.345 [2024-10-07 13:35:16.889630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.889719] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.889746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.345 [2024-10-07 13:35:16.889763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.889781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.889822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.889846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.889859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.889872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.889896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.889912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.889924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.889937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.889959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.900326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.900358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.900550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.900578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.345 [2024-10-07 13:35:16.900595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.900691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.900716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.345 [2024-10-07 13:35:16.900733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.900759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.900780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.900816] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.900831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.900844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.900861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.900875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.900887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.900911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.900927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.915532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.915566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.915756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.915802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.345 [2024-10-07 13:35:16.915819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.915934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.915960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.345 [2024-10-07 13:35:16.915976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.916001] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.916021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.916042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.916057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.916070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.916086] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.916101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.916113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.916136] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.916157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.930178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.930211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.930556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.930588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.345 [2024-10-07 13:35:16.930605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.930702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.930728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.345 [2024-10-07 13:35:16.930744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.930953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.930991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.931179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.931202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.931217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.931233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.931248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.931260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.931320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.931345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.944690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.944734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.944900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.944929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.345 [2024-10-07 13:35:16.944946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.945109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.945135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.345 [2024-10-07 13:35:16.945150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.945174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.945194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.345 [2024-10-07 13:35:16.945215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.945230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.945243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.945259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.345 [2024-10-07 13:35:16.945282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.345 [2024-10-07 13:35:16.945295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.345 [2024-10-07 13:35:16.945318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.945345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.345 [2024-10-07 13:35:16.959795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.959828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.345 [2024-10-07 13:35:16.960202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.960232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.345 [2024-10-07 13:35:16.960248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.345 [2024-10-07 13:35:16.960343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.345 [2024-10-07 13:35:16.960368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.345 [2024-10-07 13:35:16.960384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:16.960608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:16.960638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:16.960858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:16.960886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:16.960901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:16.960918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:16.960932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:16.960945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:16.961147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:16.961170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:16.974840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:16.974872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:16.975006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:16.975034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.346 [2024-10-07 13:35:16.975051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:16.975189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:16.975214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.346 [2024-10-07 13:35:16.975230] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:16.975255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:16.975275] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:16.975296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:16.975311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:16.975324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:16.975341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:16.975355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:16.975374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:16.975397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:16.975413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:16.990378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:16.990412] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:16.990774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:16.990818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.346 [2024-10-07 13:35:16.990835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:16.990947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:16.990979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.346 [2024-10-07 13:35:16.990995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:16.991194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:16.991231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:16.991419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:16.991449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:16.991464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:16.991506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:16.991523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:16.991545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:16.991755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:16.991794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:17.004876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:17.004909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:17.005074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:17.005103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.346 [2024-10-07 13:35:17.005120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:17.005235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:17.005261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.346 [2024-10-07 13:35:17.005277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:17.005301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:17.005322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:17.005342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:17.005357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:17.005370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:17.005386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:17.005401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:17.005413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:17.005446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:17.005462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:17.019708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:17.019743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:17.020290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:17.020320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.346 [2024-10-07 13:35:17.020337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:17.020515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:17.020543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.346 [2024-10-07 13:35:17.020559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:17.020848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:17.020888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:17.020948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:17.020969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:17.020983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:17.021008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:17.021023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:17.021036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:17.021208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:17.021231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.346 [2024-10-07 13:35:17.032087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:17.032127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.346 [2024-10-07 13:35:17.032376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:17.032405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.346 [2024-10-07 13:35:17.032422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:17.032568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.346 [2024-10-07 13:35:17.032596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.346 [2024-10-07 13:35:17.032612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.346 [2024-10-07 13:35:17.032723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:17.032756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.346 [2024-10-07 13:35:17.034885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.346 [2024-10-07 13:35:17.034910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.346 [2024-10-07 13:35:17.034930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.346 [2024-10-07 13:35:17.034949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.034963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.034975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.035781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.035807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.042589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.042628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.042779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.042824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.347 [2024-10-07 13:35:17.042840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.042955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.042981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.347 [2024-10-07 13:35:17.042997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.043021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.043042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.043062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.043077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.043090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.043106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.043121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.043133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.043157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.043185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.052819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.052858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.053068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.053097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.347 [2024-10-07 13:35:17.053114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.053225] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.053251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.347 [2024-10-07 13:35:17.053272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.053446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.053510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.053562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.053587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.053601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.053618] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.053634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.053647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.053671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.053687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.064791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.064849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.065058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.065085] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.347 [2024-10-07 13:35:17.065101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.065227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.065260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.347 [2024-10-07 13:35:17.065276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.065300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.065332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.065352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.065367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.065380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.065397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.065412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.065425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.065448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.065494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.079874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.079913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.080355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.080386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.347 [2024-10-07 13:35:17.080403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.080599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.080625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.347 [2024-10-07 13:35:17.080641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.080986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.081015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.081073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.081092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.081106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.081123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.081137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.081150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.081321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.081345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.095077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.095110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.095331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.095359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.347 [2024-10-07 13:35:17.095376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.095529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.347 [2024-10-07 13:35:17.095566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.347 [2024-10-07 13:35:17.095582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.347 [2024-10-07 13:35:17.095607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.095627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.347 [2024-10-07 13:35:17.095647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.095662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.095676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.095698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.347 [2024-10-07 13:35:17.095714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.347 [2024-10-07 13:35:17.095727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.347 [2024-10-07 13:35:17.095750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.095766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.347 [2024-10-07 13:35:17.108698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.108733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.347 [2024-10-07 13:35:17.109164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.109194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.348 [2024-10-07 13:35:17.109212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.109343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.109368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.348 [2024-10-07 13:35:17.109392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.109619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.109647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.109857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.109881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.109895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.109913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.109928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.109941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.109990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.110009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.123085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.123118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.123380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.123409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.348 [2024-10-07 13:35:17.123425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.123640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.123666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.348 [2024-10-07 13:35:17.123682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.123713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.123737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.123758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.123773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.123787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.123818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.123833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.123845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.123869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.123884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.135008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.135041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.135401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.135430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.348 [2024-10-07 13:35:17.135448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.135648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.135675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.348 [2024-10-07 13:35:17.135691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.135822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.135863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.136023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.136045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.136059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.136077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.136092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.136105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.136171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.136192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.148606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.148640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.150056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.150087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.348 [2024-10-07 13:35:17.150103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.150283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.150308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.348 [2024-10-07 13:35:17.150336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.150616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.150645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.150780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.150816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.150830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.150848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.150863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.150876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.150983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.151004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.348 [2024-10-07 13:35:17.161576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.161612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.348 [2024-10-07 13:35:17.162230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.162260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.348 [2024-10-07 13:35:17.162277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.162408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.348 [2024-10-07 13:35:17.162433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.348 [2024-10-07 13:35:17.162453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.348 [2024-10-07 13:35:17.162592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.162637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.348 [2024-10-07 13:35:17.162695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.162716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.162730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.162748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.348 [2024-10-07 13:35:17.162764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.348 [2024-10-07 13:35:17.162799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.348 [2024-10-07 13:35:17.162829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.162847] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.176672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.176706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.176946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.176973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.349 [2024-10-07 13:35:17.176989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.177087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.177122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.349 [2024-10-07 13:35:17.177138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.177510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.177542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.177751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.177775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.177804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.177823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.177837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.177850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.178281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.178306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.191598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.191631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.191849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.191877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.349 [2024-10-07 13:35:17.191894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.192010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.192046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.349 [2024-10-07 13:35:17.192062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.192508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.192544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.192764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.192802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.192818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.192836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.192850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.192862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.193092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.193115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.206207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.206239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.206393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.206430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.349 [2024-10-07 13:35:17.206446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.206625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.206652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.349 [2024-10-07 13:35:17.206669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.206693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.206714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.206735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.206751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.206763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.206780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.206819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.206832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.207382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.207405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.219878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.219910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.220124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.220152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.349 [2024-10-07 13:35:17.220173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.220297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.220334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.349 [2024-10-07 13:35:17.220349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.220374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.220394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.220414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.220429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.220441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.220457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.220508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.220524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.220550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.220567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.233371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.233405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.235130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.235161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.349 [2024-10-07 13:35:17.235178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.235394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.235418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.349 [2024-10-07 13:35:17.235433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.236094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.236125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.349 [2024-10-07 13:35:17.236501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.236527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.236541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.236560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.349 [2024-10-07 13:35:17.236575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.349 [2024-10-07 13:35:17.236593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.349 [2024-10-07 13:35:17.236805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.236842] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.349 [2024-10-07 13:35:17.243634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.243667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.349 [2024-10-07 13:35:17.244286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.244315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.349 [2024-10-07 13:35:17.244332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.349 [2024-10-07 13:35:17.244443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.349 [2024-10-07 13:35:17.244467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.350 [2024-10-07 13:35:17.244483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.244545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.244566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.244586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.244601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.244614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.244631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.244646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.244658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.244691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.244707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.254344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.254377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.254585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.254614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.350 [2024-10-07 13:35:17.254631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.254827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.254851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.350 [2024-10-07 13:35:17.254866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.254891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.254914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.254959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.254977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.254991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.255007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.255022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.255035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.255059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.255075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.265276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.265309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.265557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.265586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.350 [2024-10-07 13:35:17.265602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.265711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.265736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.350 [2024-10-07 13:35:17.265752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.265776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.265798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.265834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.265849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.265861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.265877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.265891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.265914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.265937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.265953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.280907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.280940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.281232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.281260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.350 [2024-10-07 13:35:17.281277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.281400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.281438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.350 [2024-10-07 13:35:17.281454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.281479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.281526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.281549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.281564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.281577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.281601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.281615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.281628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.282731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.282757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.292699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.292733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.293072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.293101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.350 [2024-10-07 13:35:17.293118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.293274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.293299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.350 [2024-10-07 13:35:17.293314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.296407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.296439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.297182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.297208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.297222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.297239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.297254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.297267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.297648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.297677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.350 [2024-10-07 13:35:17.302831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.302877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.350 [2024-10-07 13:35:17.303090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.303118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.350 [2024-10-07 13:35:17.303134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.303263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.350 [2024-10-07 13:35:17.303293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.350 [2024-10-07 13:35:17.303309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.350 [2024-10-07 13:35:17.303327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.303351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.350 [2024-10-07 13:35:17.303368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.350 [2024-10-07 13:35:17.303381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.350 [2024-10-07 13:35:17.303394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.350 [2024-10-07 13:35:17.303417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.303433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.303446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.303459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.303505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.313030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.313063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.313272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.313299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.351 [2024-10-07 13:35:17.313316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.313467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.313531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.351 [2024-10-07 13:35:17.313549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.313728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.313757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.313964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.313993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.314008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.314026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.314040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.314054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.314102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.314121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.327027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.327060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.327247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.327273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.351 [2024-10-07 13:35:17.327290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.327405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.327431] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.351 [2024-10-07 13:35:17.327447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.327494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.327519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.327540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.327556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.327577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.327594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.327608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.327620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.327645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.327662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.337508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.337542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.337785] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.337827] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.351 [2024-10-07 13:35:17.337844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.338023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.338052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.351 [2024-10-07 13:35:17.338069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.340555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.340589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.342671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.342698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.342713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.342732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.342748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.342761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.343615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.343642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.347623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.347670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.347884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.347913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.351 [2024-10-07 13:35:17.347929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.348106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.348132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.351 [2024-10-07 13:35:17.348157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.348175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.348200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.348218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.348230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.348244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.348268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.348285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.348298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.348310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.348572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.358862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.358895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.359091] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.359129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.351 [2024-10-07 13:35:17.359146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.359386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.351 [2024-10-07 13:35:17.359413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.351 [2024-10-07 13:35:17.359435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.351 [2024-10-07 13:35:17.359461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.359507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.351 [2024-10-07 13:35:17.359537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.359552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.359566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.359583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.351 [2024-10-07 13:35:17.359602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.351 [2024-10-07 13:35:17.359614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.351 [2024-10-07 13:35:17.359639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.359655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.351 [2024-10-07 13:35:17.374145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.351 [2024-10-07 13:35:17.374178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.374331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.374360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.352 [2024-10-07 13:35:17.374377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.374508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.374536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.352 [2024-10-07 13:35:17.374553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.375049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.375078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.375289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.375312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.375332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.375351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.375366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.375379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.375602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.375627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.387461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.387518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.387751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.387782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.352 [2024-10-07 13:35:17.387817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.387976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.388001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.352 [2024-10-07 13:35:17.388017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.388042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.388062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.388083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.388098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.388111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.388129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.388144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.388156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.388180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.388197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.402583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.402617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.402788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.402831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.352 [2024-10-07 13:35:17.402848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.402938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.402964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.352 [2024-10-07 13:35:17.402985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.403010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.403031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.403052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.403067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.403080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.403097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.403111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.403123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.403147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.403163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.416645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.416679] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.418034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.418065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.352 [2024-10-07 13:35:17.418081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.418187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.418211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.352 [2024-10-07 13:35:17.418226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.418678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.418709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.418772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.418793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.418822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.418839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.418853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.418866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.418890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.418906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.426760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.426828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.352 [2024-10-07 13:35:17.426992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.427021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.352 [2024-10-07 13:35:17.427038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.427164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.352 [2024-10-07 13:35:17.427190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.352 [2024-10-07 13:35:17.427206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.352 [2024-10-07 13:35:17.427225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.427250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.352 [2024-10-07 13:35:17.427268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.352 [2024-10-07 13:35:17.427280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.352 [2024-10-07 13:35:17.427293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.352 [2024-10-07 13:35:17.427317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.352 [2024-10-07 13:35:17.427333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.427346] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.427358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.427379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.436953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.436986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.437161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.437191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.353 [2024-10-07 13:35:17.437208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.437334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.437359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.353 [2024-10-07 13:35:17.437375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.437413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.437437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.437458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.437473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.437495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.437535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.437551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.437564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.437589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.437605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.449387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.449420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.449613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.449643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.353 [2024-10-07 13:35:17.449661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.449802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.449828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.353 [2024-10-07 13:35:17.449845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.450054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.450082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.450274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.450297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.450311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.450329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.450343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.450357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.450581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.450607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.463836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.463869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.464184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.464214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.353 [2024-10-07 13:35:17.464231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.464354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.464381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.353 [2024-10-07 13:35:17.464397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.464628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.464658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.464720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.464741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.464755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.464773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.464803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.464817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.464989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.465013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.478112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.478144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.478343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.478372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.353 [2024-10-07 13:35:17.478389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.478543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.478571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.353 [2024-10-07 13:35:17.478587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.478612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.478633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.478655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.478670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.478684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.478701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.478715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.478728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.478763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.478795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.488542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.488577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.492757] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.492804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.353 [2024-10-07 13:35:17.492822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.492905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.353 [2024-10-07 13:35:17.492929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.353 [2024-10-07 13:35:17.492944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.353 [2024-10-07 13:35:17.493016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.493042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.353 [2024-10-07 13:35:17.493065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.493079] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.493093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.493110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.353 [2024-10-07 13:35:17.493124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.353 [2024-10-07 13:35:17.493140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.353 [2024-10-07 13:35:17.493163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.493179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.353 [2024-10-07 13:35:17.498691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.498723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.353 [2024-10-07 13:35:17.498921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.498951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.354 [2024-10-07 13:35:17.498968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.499088] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.499114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.354 [2024-10-07 13:35:17.499129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.499153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.499174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.499194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.499209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.499222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.499239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.499258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.499272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.500286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.500312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.508815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.508864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.509116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.509146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.354 [2024-10-07 13:35:17.509163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.509747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.509792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.354 [2024-10-07 13:35:17.509809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.509828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.510167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.510193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.510207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.510220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.510280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.510301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.510313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.510326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.510365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.521515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.521549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.522155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.522185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.354 [2024-10-07 13:35:17.522201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.522327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.522352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.354 [2024-10-07 13:35:17.522367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.522603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.522638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.522848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.522872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.522887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.522905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.522920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.522933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.523138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.523160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.536373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.536406] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.536666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.536695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.354 [2024-10-07 13:35:17.536712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.536860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.536888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.354 [2024-10-07 13:35:17.536903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.536928] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.536949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.536969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.536984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.536997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.537018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.537033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.537045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.537068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.537084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.550677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.550712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.551055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.551085] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.354 [2024-10-07 13:35:17.551108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.551327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.551354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.354 [2024-10-07 13:35:17.551370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.551395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.551416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.354 [2024-10-07 13:35:17.551436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.551451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.551465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.551482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.354 [2024-10-07 13:35:17.551523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.354 [2024-10-07 13:35:17.551537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.354 [2024-10-07 13:35:17.551565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.551582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.354 [2024-10-07 13:35:17.561065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.561099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.354 [2024-10-07 13:35:17.561436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.561466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.354 [2024-10-07 13:35:17.561484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.561706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.354 [2024-10-07 13:35:17.561732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.354 [2024-10-07 13:35:17.561749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.354 [2024-10-07 13:35:17.561870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.561909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.562025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.562045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.562060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.562077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.562091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.562113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.562221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.562243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.571177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.571225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.571495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.571530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.355 [2024-10-07 13:35:17.571546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.572481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.572518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.355 [2024-10-07 13:35:17.572535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.572554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.572729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.572754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.572768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.572797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.572907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.572928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.572943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.572955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.573054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.581405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.581437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.581707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.581736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.355 [2024-10-07 13:35:17.581753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.581863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.581889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.355 [2024-10-07 13:35:17.581905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.582078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.582115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.582168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.582189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.582203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.582220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.582234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.582247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.582271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.582288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.592755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.592790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.595949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.595982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.355 [2024-10-07 13:35:17.596001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.596184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.596209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.355 [2024-10-07 13:35:17.596225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.597154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.597185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.597621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.597647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.597663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.597682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.597698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.597711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.597935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.597958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.602886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.602932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.603130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.603158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.355 [2024-10-07 13:35:17.603174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.603366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.603391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.355 [2024-10-07 13:35:17.603407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.603426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.603589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.603616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.603630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.603643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.603785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.603808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.603822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.603835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.603970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.612968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.613180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.613209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.355 [2024-10-07 13:35:17.613226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.613263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.613295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.355 [2024-10-07 13:35:17.613323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.355 [2024-10-07 13:35:17.613338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.355 [2024-10-07 13:35:17.613352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.355 [2024-10-07 13:35:17.613374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.355 [2024-10-07 13:35:17.613561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.355 [2024-10-07 13:35:17.613588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.355 [2024-10-07 13:35:17.613605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.355 [2024-10-07 13:35:17.613630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.355 [2024-10-07 13:35:17.613654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.613669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.613682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.613713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.625851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.625884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.626295] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.626325] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.356 [2024-10-07 13:35:17.626342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.626548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.626575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.356 [2024-10-07 13:35:17.626591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.626640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.626666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.626688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.626704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.626717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.626734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.626749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.626763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.626787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.626818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.636297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.636330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.636650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.636679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.356 [2024-10-07 13:35:17.636697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.636876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.636902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.356 [2024-10-07 13:35:17.636918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.639147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.639178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.640007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.640038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.640054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.640071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.640086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.640100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.640337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.640361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.646409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.646455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.646728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.646755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.356 [2024-10-07 13:35:17.646772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.647103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.647131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.356 [2024-10-07 13:35:17.647148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.647167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.647291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.647316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.647329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.647342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.647454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.647502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.647518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.647531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.647666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.658106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.658139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.658544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.658575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.356 [2024-10-07 13:35:17.658593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.658746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.658776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.356 [2024-10-07 13:35:17.658808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.659242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.659273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.659334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.659355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.659369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.659387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.659402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.356 [2024-10-07 13:35:17.659414] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.356 [2024-10-07 13:35:17.659438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.659453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.356 [2024-10-07 13:35:17.670000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.670034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.356 [2024-10-07 13:35:17.670224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.670254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.356 [2024-10-07 13:35:17.670274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.670366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.356 [2024-10-07 13:35:17.670391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.356 [2024-10-07 13:35:17.670406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.356 [2024-10-07 13:35:17.670433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.670459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.356 [2024-10-07 13:35:17.670481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.356 [2024-10-07 13:35:17.670522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.670537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.670555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.670570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.670584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.670609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.670627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.681521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.681557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.681905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.681939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.357 [2024-10-07 13:35:17.681957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.682101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.682128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.357 [2024-10-07 13:35:17.682152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.682284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.682312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.682419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.682440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.682453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.682493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.682512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.682536] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.682650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.682671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.691640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.691690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.691929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.691956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.357 [2024-10-07 13:35:17.691973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.692173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.692198] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.357 [2024-10-07 13:35:17.692214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.692233] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.692641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.692668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.692683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.692701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.692886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.692910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.692924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.692938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.693059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.701973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.702007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.702351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.702382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.357 [2024-10-07 13:35:17.702399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.702583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.702610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.357 [2024-10-07 13:35:17.702627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.703080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.703111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.703317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.703342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.703356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.703373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.703389] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.703402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.703624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.703649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.715150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.715182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.715422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.715450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.357 [2024-10-07 13:35:17.715480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.715674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.715699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.357 [2024-10-07 13:35:17.715720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.715746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.715767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.715803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.715817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.715830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.715845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.715860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.715873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.715912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.715940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.357 [2024-10-07 13:35:17.727098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.727131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.357 [2024-10-07 13:35:17.727433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.727461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.357 [2024-10-07 13:35:17.727503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.727663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.357 [2024-10-07 13:35:17.727689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.357 [2024-10-07 13:35:17.727705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.357 [2024-10-07 13:35:17.730754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.730787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.357 [2024-10-07 13:35:17.731444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.731483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.731510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.731529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.357 [2024-10-07 13:35:17.731544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.357 [2024-10-07 13:35:17.731557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.357 [2024-10-07 13:35:17.731941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.731964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.737206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.737258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.737518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.737547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.358 [2024-10-07 13:35:17.737564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.737824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.737851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.358 [2024-10-07 13:35:17.737866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.737885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.737910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.737928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.737940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.737953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.737977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.737993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.738004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.738017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.738039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.747339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.747387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.747580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.747609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.358 [2024-10-07 13:35:17.747626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.748041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.748071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.358 [2024-10-07 13:35:17.748087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.748106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.748303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.748327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.748342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.748355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.748409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.748430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.748443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.748456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.748672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.762284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.762316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.762635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.762664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.358 [2024-10-07 13:35:17.762682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.762816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.762841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.358 [2024-10-07 13:35:17.762857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.762881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.762902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.762922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.762936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.762949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.762965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.762979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.762998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.763020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.763037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.772395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.774923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.775164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.775194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.358 [2024-10-07 13:35:17.775210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.777243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.777273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.358 [2024-10-07 13:35:17.777290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.777314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.777400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.777423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.777436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.777449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.777474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.777519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.777536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.777550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.777573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.782595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.782727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.782757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.358 [2024-10-07 13:35:17.782775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.782815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.782840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.782855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.782868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.782892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 [2024-10-07 13:35:17.785020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.358 [2024-10-07 13:35:17.785172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.358 [2024-10-07 13:35:17.785199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.358 [2024-10-07 13:35:17.785216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.358 [2024-10-07 13:35:17.785241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.358 [2024-10-07 13:35:17.785263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.358 [2024-10-07 13:35:17.785279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.358 [2024-10-07 13:35:17.785292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.358 [2024-10-07 13:35:17.785315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.358 00:24:23.358 Latency(us) 00:24:23.358 [2024-10-07T11:35:19.291Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:23.358 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:24:23.358 Verification LBA range: start 0x0 length 0x4000 00:24:23.358 NVMe0n1 : 15.01 8614.54 33.65 0.00 0.00 14831.43 2791.35 31068.92 00:24:23.358 [2024-10-07T11:35:19.292Z] =================================================================================================================== 00:24:23.359 [2024-10-07T11:35:19.292Z] Total : 8614.54 33.65 0.00 0.00 14831.43 2791.35 31068.92 00:24:23.359 [2024-10-07 13:35:17.792673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.792851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.792885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.359 [2024-10-07 13:35:17.792902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.792924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.792944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.792958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.792971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.792990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.795093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.795283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.795310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.359 [2024-10-07 13:35:17.795327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.795348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.795368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.795384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.795397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.795416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.802752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.802996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.803023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.359 [2024-10-07 13:35:17.803040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.803061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.803080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.803094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.803107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.803126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.805162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.805371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.805398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.359 [2024-10-07 13:35:17.805416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.805436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.805455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.805503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.805531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.805550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.812854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.813012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.813039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.359 [2024-10-07 13:35:17.813056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.813076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.813095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.813109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.813122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.813140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.815230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.815380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.815406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.359 [2024-10-07 13:35:17.815422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.815442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.815476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.815500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.815515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.815533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.822924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.823066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.823092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.359 [2024-10-07 13:35:17.823108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.823134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.823154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.823167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.823180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.823197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.825297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.825459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.825508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.359 [2024-10-07 13:35:17.825526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.825547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.825568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.825582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.825595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.825614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.832993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.833156] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.833182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.359 [2024-10-07 13:35:17.833197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.833217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.833237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.833250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.833262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.833280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.835364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.835537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.835564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.359 [2024-10-07 13:35:17.835581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.359 [2024-10-07 13:35:17.835602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.359 [2024-10-07 13:35:17.835622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.359 [2024-10-07 13:35:17.835637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.359 [2024-10-07 13:35:17.835656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.359 [2024-10-07 13:35:17.835686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.359 [2024-10-07 13:35:17.843061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.359 [2024-10-07 13:35:17.843216] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.359 [2024-10-07 13:35:17.843242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.360 [2024-10-07 13:35:17.843258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.360 [2024-10-07 13:35:17.843279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.360 [2024-10-07 13:35:17.843298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.360 [2024-10-07 13:35:17.843312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.360 [2024-10-07 13:35:17.843324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.360 [2024-10-07 13:35:17.843342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.360 [2024-10-07 13:35:17.845431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.360 [2024-10-07 13:35:17.845620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.360 [2024-10-07 13:35:17.845649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.360 [2024-10-07 13:35:17.845667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.360 [2024-10-07 13:35:17.845688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.360 [2024-10-07 13:35:17.845708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.360 [2024-10-07 13:35:17.845722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.360 [2024-10-07 13:35:17.845736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.360 [2024-10-07 13:35:17.845755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.360 Received shutdown signal, test time was about 15.000000 seconds 00:24:23.360 00:24:23.360 Latency(us) 00:24:23.360 [2024-10-07T11:35:19.293Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:23.360 [2024-10-07T11:35:19.293Z] =================================================================================================================== 00:24:23.360 [2024-10-07T11:35:19.293Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # count=1 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@67 -- # (( count != 3 )) 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # false 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # trap - ERR 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # print_backtrace 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp') 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:24:23.360 ========== Backtrace start: ========== 00:24:23.360 00:24:23.360 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh:68 -> main(["--transport=tcp"]) 00:24:23.360 ... 00:24:23.360 63 cat $testdir/try.txt 00:24:23.360 64 # if this test fails it means we didn't fail over to the second 00:24:23.360 65 count="$(grep -c "Resetting controller successful" < $testdir/try.txt)" 00:24:23.360 66 00:24:23.360 67 if ((count != 3)); then 00:24:23.360 => 68 false 00:24:23.360 69 fi 00:24:23.360 70 00:24:23.360 71 # Part 2 of the test. Start removing ports, starting with the one we are connected to, confirm that the ctrlr remains active until the final trid is removed. 00:24:23.360 72 $rootdir/build/examples/bdevperf -z -r $bdevperf_rpc_sock -q 128 -o 4096 -w verify -t 1 -f &> $testdir/try.txt & 00:24:23.360 73 bdevperf_pid=$! 00:24:23.360 ... 00:24:23.360 00:24:23.360 ========== Backtrace end ========== 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # process_shm --id 0 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@808 -- # type=--id 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@809 -- # id=0 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@820 -- # for n in $shm_files 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:24:23.360 nvmf_trace.0 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@823 -- # return 0 00:24:23.360 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:23.360 [2024-10-07 13:35:01.601595] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:24:23.360 [2024-10-07 13:35:01.601678] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid709749 ] 00:24:23.360 [2024-10-07 13:35:01.660439] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:23.360 [2024-10-07 13:35:01.769559] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:24:23.360 Running I/O for 15 seconds... 00:24:23.360 8672.00 IOPS, 33.88 MiB/s [2024-10-07T11:35:19.293Z] [2024-10-07 13:35:03.921642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:81344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:81352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:81360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:81368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:81376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:81384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:81392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:81400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:81408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.921976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:81416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.921990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:81424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:81432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:81440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:81448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:81456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:81464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:81472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:81480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.360 [2024-10-07 13:35:03.922231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.360 [2024-10-07 13:35:03.922246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:81488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:81496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:81504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:81512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:81520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:81528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:81536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:81544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:81552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:81560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:81568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:81576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:81584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:81592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:81600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:81608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:81616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:81624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:81632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:81640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:81648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:81656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:81664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:81672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.922984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.922999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:81680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:81688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:81696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:81704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:81712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:81720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:81728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:81736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:81744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:81752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:81760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:81768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:81776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.361 [2024-10-07 13:35:03.923398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.361 [2024-10-07 13:35:03.923414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:81784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:81792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:81800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:81808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:81816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:81824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:81832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:81840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:81848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.362 [2024-10-07 13:35:03.923694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:81856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:81864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:81872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:81880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:81888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:81896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:81904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:81912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:81920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.923980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.923995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:81928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:81936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:81944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:81952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:81960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:81968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:81976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:81984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:81992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:82000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:82008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:82016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:82024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:82032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:82040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:82048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:82056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:82064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:82072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:82080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:82088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:82096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:82104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:82112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.362 [2024-10-07 13:35:03.924733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.362 [2024-10-07 13:35:03.924748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:82120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:82128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:82136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:82144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:82152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:82160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:82168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:82176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.924972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.924987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:82184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.925001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:82192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.925030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:82200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.925059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:82208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.925087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:82216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.925116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:82224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.925146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:82232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.363 [2024-10-07 13:35:03.925175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925210] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82240 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925258] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925271] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82248 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925308] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925318] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82256 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925369] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925380] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82264 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925416] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925427] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82272 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925464] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925474] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82280 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925522] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925532] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82288 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925568] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925580] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82296 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925620] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925631] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82304 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925668] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925681] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82312 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925717] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925727] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82320 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925769] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925780] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82328 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925817] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925828] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82336 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925869] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925879] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82344 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925916] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925927] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82352 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.925950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.925967] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.363 [2024-10-07 13:35:03.925978] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.363 [2024-10-07 13:35:03.925992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:82360 len:8 PRP1 0x0 PRP2 0x0 00:24:23.363 [2024-10-07 13:35:03.926005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.363 [2024-10-07 13:35:03.926063] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x6964d0 was disconnected and freed. reset controller. 00:24:23.364 [2024-10-07 13:35:03.926150] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.364 [2024-10-07 13:35:03.926172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.364 [2024-10-07 13:35:03.926192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.364 [2024-10-07 13:35:03.926205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.364 [2024-10-07 13:35:03.926219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.364 [2024-10-07 13:35:03.926231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.364 [2024-10-07 13:35:03.926255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.364 [2024-10-07 13:35:03.926268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.364 [2024-10-07 13:35:03.926281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.927524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:03.927563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.927765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:03.927794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:03.927810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.927836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.927860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:03.927875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:03.927891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:03.927917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:03.937863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:03.938038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:03.938069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:03.938086] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.938111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.938135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:03.938156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:03.938169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:03.938194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:03.948019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:03.948252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:03.948282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:03.948298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.948323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.948528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:03.948551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:03.948565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:03.948638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:03.959462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:03.959745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:03.959790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:03.959807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.959922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.961828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:03.961867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:03.961880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:03.962708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:03.969576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:03.969815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:03.969843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:03.969859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.969883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.969918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:03.969935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:03.969947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:03.969971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:03.979675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:03.979862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:03.979892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:03.979908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.979932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.979955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:03.979969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:03.979982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:03.980006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:03.993333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:03.993525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:03.993556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:03.993573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:03.993599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:03.993623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:03.993638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:03.993651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:03.993675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:04.004799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:04.005053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:04.005083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:04.005100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:04.005208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:04.005320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:04.005340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:04.005353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:04.008275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:04.014898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:04.015174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:04.015202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:04.015218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.364 [2024-10-07 13:35:04.015248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.364 [2024-10-07 13:35:04.015271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.364 [2024-10-07 13:35:04.015286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.364 [2024-10-07 13:35:04.015298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.364 [2024-10-07 13:35:04.015322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.364 [2024-10-07 13:35:04.024995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.364 [2024-10-07 13:35:04.025205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.364 [2024-10-07 13:35:04.025234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.364 [2024-10-07 13:35:04.025250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.025274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.025956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.025986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.026015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.026532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.036816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.038658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.038690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.038708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.039340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.039626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.039650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.039664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.039896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.046900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.047179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.047207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.047223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.047247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.047270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.047285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.047303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.047327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.057015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.057201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.057230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.057247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.057425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.057497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.057534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.057548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.057574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.070317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.070715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.070746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.070763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.070828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.070862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.070877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.070889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.070913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.085094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.085236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.085265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.085282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.085306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.085330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.085344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.085357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.085381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.095806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.099966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.100016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.100034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.100105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.100133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.100148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.100160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.100184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.106960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.107297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.107327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.107343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.107511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.107642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.107665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.107679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.107790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.117129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.117332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.117362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.117378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.117867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.118103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.118126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.118140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.118190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.129270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.365 [2024-10-07 13:35:04.129440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.365 [2024-10-07 13:35:04.129469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.365 [2024-10-07 13:35:04.129493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.365 [2024-10-07 13:35:04.129536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.365 [2024-10-07 13:35:04.129565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.365 [2024-10-07 13:35:04.129580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.365 [2024-10-07 13:35:04.129593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.365 [2024-10-07 13:35:04.129618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.365 [2024-10-07 13:35:04.142924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.145223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.145268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.145286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.146118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.146864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.146887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.146915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.147150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.153021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.153299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.153327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.153343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.153368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.153391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.153405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.153417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.153441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.163117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.163382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.163411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.163428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.163639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.163703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.163729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.163743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.163768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.176558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.176980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.177022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.177039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.177292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.177353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.177373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.177388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.177413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.191631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.191786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.191817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.191834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.191860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.191885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.191900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.191913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.191937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.202389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.205132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.205177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.205196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.206734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.206842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.206863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.206877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.206902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.214544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.214953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.214982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.215017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.215128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.215238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.215259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.215272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.215379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.224806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.224963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.224997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.225014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.225038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.225062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.225076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.225089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.225113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.235740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.235999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.236030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.236046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.236260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.236319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.236339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.236353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.236377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.248094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.248425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.248456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.248494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.248609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.248800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.248828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.248843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.366 [2024-10-07 13:35:04.248908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.366 [2024-10-07 13:35:04.258553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.366 [2024-10-07 13:35:04.258884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.366 [2024-10-07 13:35:04.258914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.366 [2024-10-07 13:35:04.258932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.366 [2024-10-07 13:35:04.259039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.366 [2024-10-07 13:35:04.259150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.366 [2024-10-07 13:35:04.259170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.366 [2024-10-07 13:35:04.259183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.262727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.268661] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.268927] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.268955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.268972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.268996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.269019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.269033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.269046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.269069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.279093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.279248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.279277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.279294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.279318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.279340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.279354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.279367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.279390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.290866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.291111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.291141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.291158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.291267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.291391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.291413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.291429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.291562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.301446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.301651] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.301681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.301698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.301723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.301747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.301761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.301789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.301814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.311677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.311859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.311889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.311905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.312083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.312151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.312171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.312184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.312208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.324562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.324978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.325007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.325037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.325240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.325296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.325315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.325328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.325353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.336705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.338763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.338811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.338828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.339529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.339987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.340018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.340047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.340261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.346824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.347046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.347075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.347091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.347114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.347138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.347159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.347172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.347196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.356914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.357108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.357137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.357155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.357179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.357202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.357217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.357235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.357261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.368619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.368985] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.369029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.369045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.369108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.369135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.369150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.369163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.369350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.380870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.381172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.367 [2024-10-07 13:35:04.381202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.367 [2024-10-07 13:35:04.381218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.367 [2024-10-07 13:35:04.384087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.367 [2024-10-07 13:35:04.384640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.367 [2024-10-07 13:35:04.384665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.367 [2024-10-07 13:35:04.384694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.367 [2024-10-07 13:35:04.384913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.367 [2024-10-07 13:35:04.392724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.367 [2024-10-07 13:35:04.392928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.392957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.392973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.393721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.393927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.393949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.393963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.398084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.402823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.403045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.403079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.403095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.403120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.403143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.403157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.403170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.403193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.413536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.413731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.413761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.413794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.413971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.414026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.414046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.414059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.414083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.425635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.425808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.425853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.425870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.425894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.425917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.425931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.425944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.425967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.438420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.438688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.438719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.438737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.438859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.438994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.439015] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.439028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.442711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.448826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.449121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.449151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.449168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.449504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.449654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.449676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.449690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.449728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.459014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.459223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.459252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.459268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.459292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.459493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.459516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.459532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.459584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.472655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.473086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.473115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.473131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.473196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.473223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.473237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.473249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.473283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.486719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.487404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.487447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.487465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.487708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.487765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.487786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.487800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.488001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.501348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.501562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.501594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.501611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.501636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.501660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.501675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.501688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.501713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.512567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.512871] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.512901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.512918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.513060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.513204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.513226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.513240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.513351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.523266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.368 [2024-10-07 13:35:04.524186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.368 [2024-10-07 13:35:04.524230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.368 [2024-10-07 13:35:04.524253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.368 [2024-10-07 13:35:04.524279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.368 [2024-10-07 13:35:04.524303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.368 [2024-10-07 13:35:04.524317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.368 [2024-10-07 13:35:04.524330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.368 [2024-10-07 13:35:04.524354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.368 [2024-10-07 13:35:04.533370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.533571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.533602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.533620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.533818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.533875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.533894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.533908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.533933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.545636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.545824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.545853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.545870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.545894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.545918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.545933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.545946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.545970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.556860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.557223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.557253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.557270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.557410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.557566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.557595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.557610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.557740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.566958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.567207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.567235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.567252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.567437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.567684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.567719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.567733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.567874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.577077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.577318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.577347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.577364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.577388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.577411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.577426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.577439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.577477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.587408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.587820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.587850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.587867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.587977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.588093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.588114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.588127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.591351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.597967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.598237] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.598266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.598283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.598390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.598526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.598549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.598563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.598674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.608071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.608292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.608321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.608338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.608548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.608607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.608628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.608642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.608666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.620732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.620890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.620919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.620936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.620960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.620984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.620999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.621012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.621035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.630817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.631061] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.631091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.631109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.632115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.632308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.369 [2024-10-07 13:35:04.632331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.369 [2024-10-07 13:35:04.632345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.369 [2024-10-07 13:35:04.632456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.369 [2024-10-07 13:35:04.640914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.369 [2024-10-07 13:35:04.641172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.369 [2024-10-07 13:35:04.641200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.369 [2024-10-07 13:35:04.641217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.369 [2024-10-07 13:35:04.641241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.369 [2024-10-07 13:35:04.641264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.641279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.641292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.641316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.651927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.652103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.652132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.652149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.652173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.652196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.652211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.652225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.652249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.666377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.666728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.666759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.666791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.666816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.666839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.666854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.666872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.666896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.680808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.681026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.681055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.681072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.681096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.681119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.681133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.681145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.681169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.692887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.694832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.694868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.694887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.697028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.697757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.697786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.697801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.698229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.703208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.703383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.703411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.703428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.703898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.703962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.703982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.703995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.704020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.713305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.713443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.713500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.713521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.713714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.713771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.713807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.713820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.713845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.726427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.726786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.726828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.726871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.727086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.727142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.727162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.727176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.727201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.736876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.740754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.740800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.740816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.741718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.742002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.742026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.742039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.742091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.747103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.747369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.747398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.747414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.747438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 8594.50 IOPS, 33.57 MiB/s [2024-10-07T11:35:19.303Z] [2024-10-07 13:35:04.751107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.751128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.751166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.752092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.757296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.757574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.757604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.757621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.757819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.757879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.757899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.757912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.757937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.767608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.767856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.767887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.767903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.771721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.772062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.772086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.772101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.772347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.777695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.370 [2024-10-07 13:35:04.777898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.370 [2024-10-07 13:35:04.777927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.370 [2024-10-07 13:35:04.777944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.370 [2024-10-07 13:35:04.777969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.370 [2024-10-07 13:35:04.777992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.370 [2024-10-07 13:35:04.778007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.370 [2024-10-07 13:35:04.778021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.370 [2024-10-07 13:35:04.778052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.370 [2024-10-07 13:35:04.787807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.787984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.788013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.788030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.788054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.788077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.788092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.788105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.788129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.801146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.801417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.801446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.801463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.801512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.801543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.801558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.801571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.801596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.811619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.811943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.811978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.811995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.812103] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.812215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.812235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.812248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.812357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.821705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.822372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.822414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.822437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.823101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.823147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.823164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.823177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.823200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.831817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.832062] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.832090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.832106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.832130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.832153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.832167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.832180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.832204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.846412] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.846672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.846701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.846718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.846742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.846766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.846781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.846794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.846834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.860322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.860543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.860574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.860592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.860618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.860656] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.860680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.860694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.860720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.873848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.874288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.874331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.874349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.874576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.874634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.874654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.874668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.874693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.888676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.888877] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.888906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.888922] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.888946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.888969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.888983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.888996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.889019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.898775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.899061] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.899090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.899106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.900099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.900293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.900315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.900329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.900449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.908873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.909147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.909177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.909193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.909217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.909240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.909254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.909267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.909290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.920425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.920648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.920678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.920695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.920721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.920744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.920759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.371 [2024-10-07 13:35:04.920772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.371 [2024-10-07 13:35:04.920796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.371 [2024-10-07 13:35:04.934309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.371 [2024-10-07 13:35:04.934538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.371 [2024-10-07 13:35:04.934568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.371 [2024-10-07 13:35:04.934585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.371 [2024-10-07 13:35:04.934610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.371 [2024-10-07 13:35:04.934635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.371 [2024-10-07 13:35:04.934651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:04.934664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:04.934688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:04.944599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:04.944860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:04.944890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:04.944907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:04.945197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:04.948025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:04.948051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:04.948082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:04.951641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:04.954686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:04.955110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:04.955155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:04.955171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:04.955237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:04.955421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:04.955444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:04.955459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:04.955519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:04.967853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:04.968120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:04.968149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:04.968166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:04.968190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:04.968213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:04.968228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:04.968241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:04.968264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:04.977951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:04.978229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:04.978259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:04.978285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:04.978310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:04.978334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:04.978349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:04.978368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:04.978409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:04.988048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:04.988265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:04.988295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:04.988312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:04.988515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:04.988573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:04.988594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:04.988608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:04.988633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.000329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.000821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.000865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.000882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:05.001200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:05.001264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:05.001284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:05.001297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:05.001322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.011899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.012171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.012200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.012217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:05.012333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:05.015876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:05.015901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:05.015931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:05.016569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.021997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.022244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.022277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.022294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:05.022437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:05.022603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:05.022627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:05.022642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:05.022756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.032093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.032320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.032350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.032366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:05.032390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:05.032413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:05.032428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:05.032440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:05.032480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.044751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.045172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.045202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.045234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:05.045434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:05.045671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:05.045695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:05.045709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:05.045763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.059834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.060085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.060114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.060131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:05.060155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:05.060189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:05.060204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:05.060217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:05.060256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.069932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.070204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.070232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.070248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.372 [2024-10-07 13:35:05.072807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.372 [2024-10-07 13:35:05.076151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.372 [2024-10-07 13:35:05.076177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.372 [2024-10-07 13:35:05.076206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.372 [2024-10-07 13:35:05.076739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.372 [2024-10-07 13:35:05.080026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.372 [2024-10-07 13:35:05.080249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.372 [2024-10-07 13:35:05.080277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.372 [2024-10-07 13:35:05.080294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.080318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.080341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.080355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.080367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.080391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.091594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.091872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.091901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.091918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.091942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.091965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.091979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.091992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.092021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.101695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.101934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.101963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.101980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.102004] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.102027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.102041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.102053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.102076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.111798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.112214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.112242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.112258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.112322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.112348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.112362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.112374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.112398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.124419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.124871] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.124901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.124918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.125137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.125195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.125215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.125229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.125424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.140076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.140260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.140289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.140310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.140336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.140359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.140373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.140386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.140409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.155057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.155280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.155310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.155326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.155350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.155374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.155388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.155401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.155425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.170762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.171791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.171820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.171851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.373 [2024-10-07 13:35:05.172430] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.373 [2024-10-07 13:35:05.172904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.373 [2024-10-07 13:35:05.172941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.373 [2024-10-07 13:35:05.172955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.373 [2024-10-07 13:35:05.173190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.373 [2024-10-07 13:35:05.182606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.373 [2024-10-07 13:35:05.182914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.373 [2024-10-07 13:35:05.182944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.373 [2024-10-07 13:35:05.182961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.183071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.185459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.185509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.185524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.186625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.192691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.192951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.192980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.192996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.193021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.193044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.193059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.193071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.193094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.202808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.203077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.203107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.203124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.203436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.203607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.203630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.203644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.203684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.216478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.216934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.216980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.216998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.217229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.217287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.217308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.217322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.217347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.232011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.232270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.232300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.232317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.232341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.232364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.232379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.232391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.232415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.242961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.243321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.243351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.243368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.243509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.243629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.243649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.243664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.243791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.253058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.253328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.253357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.253374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.253398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.253421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.253436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.253448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.253495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.263155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.263388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.263417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.263433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.263463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.263516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.263532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.263545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.263570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.274341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.274679] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.274709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.274727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.274859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.274976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.274997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.275010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.275121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.284835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.285137] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.285166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.285183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.285293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.285406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.285427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.285440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.285576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.295100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.295362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.295392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.374 [2024-10-07 13:35:05.295408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.374 [2024-10-07 13:35:05.295616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.374 [2024-10-07 13:35:05.295674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.374 [2024-10-07 13:35:05.295695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.374 [2024-10-07 13:35:05.295714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.374 [2024-10-07 13:35:05.295740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.374 [2024-10-07 13:35:05.308120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.374 [2024-10-07 13:35:05.308319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.374 [2024-10-07 13:35:05.308349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.308365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.308389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.308412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.308427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.308439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.308479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.319229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.319573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.319605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.319622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.319736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.319867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.319888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.319901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.324156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.329326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.329608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.329638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.329655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.329680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.329704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.329718] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.329732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.329756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.339423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.339709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.339740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.339757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.339796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.339820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.339835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.339847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.339870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.354194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.354447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.354500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.354519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.354545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.354569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.354584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.354597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.354622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.367221] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.369261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.369304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.369321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.369399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.369441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.369460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.369498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.369527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.377320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.377519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.377549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.377566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.377591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.377620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.377637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.377650] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.377675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.387446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.387625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.387655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.387673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.387698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.387722] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.387737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.387750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.387775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.399711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.400120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.400150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.400167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.400380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.400450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.400495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.400513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.400539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.411620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.413933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.413977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.413994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.414822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.415085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.415108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.415122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.415344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.421721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.375 [2024-10-07 13:35:05.421901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.375 [2024-10-07 13:35:05.421930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.375 [2024-10-07 13:35:05.421947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.375 [2024-10-07 13:35:05.421971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.375 [2024-10-07 13:35:05.421995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.375 [2024-10-07 13:35:05.422009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.375 [2024-10-07 13:35:05.422022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.375 [2024-10-07 13:35:05.422046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.375 [2024-10-07 13:35:05.432146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.432292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.432321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.432338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.432374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.432400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.432415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.432428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.432452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.444333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.444526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.444556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.444573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.444599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.444623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.444638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.444652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.444677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.458005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.458195] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.458225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.458248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.458274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.458299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.458314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.458328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.458352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.469159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.469389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.469419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.469436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.469580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.469704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.469725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.469739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.469865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.479256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.479480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.479518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.479536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.479561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.479585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.479600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.479613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.479637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.490608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.490846] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.490876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.490893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.491070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.491126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.491151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.491166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.491191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.504493] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.504629] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.504658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.504675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.504700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.504725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.504740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.504754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.504810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.516998] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.517255] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.517285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.517302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.517413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.517554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.517577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.517592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.517702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.527353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.527613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.527644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.527662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.528145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.528215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.528234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.528247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.528272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.537454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.537622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.537653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.537671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.537867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.537924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.537944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.537958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.537982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.376 [2024-10-07 13:35:05.550393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.376 [2024-10-07 13:35:05.551066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.376 [2024-10-07 13:35:05.551095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.376 [2024-10-07 13:35:05.551127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.376 [2024-10-07 13:35:05.551348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.376 [2024-10-07 13:35:05.551580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.376 [2024-10-07 13:35:05.551604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.376 [2024-10-07 13:35:05.551618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.376 [2024-10-07 13:35:05.551685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.565023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.565198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.565244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.565262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.565287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.565311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.565326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.565339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.565363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.575119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.575293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.575322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.575338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.576401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.576604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.576628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.576643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.576756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.585218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.585421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.585451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.585468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.585503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.585542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.585560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.585574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.585599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.596957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.597320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.597350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.597367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.597417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.597627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.597651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.597665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.597717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.611716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.611914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.611944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.611961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.611986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.612009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.612024] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.612042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.612067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.623194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.625480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.625534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.625551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.627087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.627501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.627525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.627540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.628030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.633550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.634182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.634225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.634242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.634357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.634387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.634402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.634415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.634439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.643648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.643833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.643862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.643879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.643903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.643926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.643941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.643954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.643978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.656064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.656416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.656446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.656463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.656538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.377 [2024-10-07 13:35:05.656566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.377 [2024-10-07 13:35:05.656581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.377 [2024-10-07 13:35:05.656595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.377 [2024-10-07 13:35:05.656778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.377 [2024-10-07 13:35:05.670278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.377 [2024-10-07 13:35:05.670427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.377 [2024-10-07 13:35:05.670456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.377 [2024-10-07 13:35:05.670472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.377 [2024-10-07 13:35:05.670520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.670546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.670561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.670574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.670598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.686153] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.686550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.686596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.686613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.686846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.686902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.686922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.686935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.687112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.701240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.701452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.701504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.701523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.701548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.701578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.701594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.701606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.701632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.715297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.715503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.715534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.715551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.715577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.715601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.715616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.715630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.715656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.726090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.726346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.726376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.726393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.726528] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.726688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.726712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.726727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.726866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.736253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.736419] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.736447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.736464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.736513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.736538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.736553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.736566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.736596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.748174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.748344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.748373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.748389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.748414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.748437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.748452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.748480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.748516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 8573.00 IOPS, 33.49 MiB/s [2024-10-07T11:35:19.311Z] [2024-10-07 13:35:05.762163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.762360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.762390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.762406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.762431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.762455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.762494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.762511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.762536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.777744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.778119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.778163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.778180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.778391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.778632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.778658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.778672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.778725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.792199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.792376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.792409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.792426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.792450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.792498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.792515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.792529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.792554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.806798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.378 [2024-10-07 13:35:05.807013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.378 [2024-10-07 13:35:05.807043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.378 [2024-10-07 13:35:05.807060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.378 [2024-10-07 13:35:05.807084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.378 [2024-10-07 13:35:05.807107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.378 [2024-10-07 13:35:05.807122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.378 [2024-10-07 13:35:05.807135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.378 [2024-10-07 13:35:05.807158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.378 [2024-10-07 13:35:05.819540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.819837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.819866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.819884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.819991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.820100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.820120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.820134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.822900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.829641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.829839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.829867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.829884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.830017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.830147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.830169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.830183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.830291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.839725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.840037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.840067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.840084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.840133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.840160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.840175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.840187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.840364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.852915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.853077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.853105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.853122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.853147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.853171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.853186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.853199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.853223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.863387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.866112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.866157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.866175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.867711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.867801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.867835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.867849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.867874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.875356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.875611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.875651] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.875668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.875780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.875906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.875927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.875941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.876049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.885580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.885772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.885814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.885830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.885854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.885877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.885892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.885905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.885928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.897016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.897366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.897396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.897412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.897643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.897715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.897738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.897752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.897792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.908882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.909022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.909050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.909072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.909098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.909122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.909137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.909149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.909174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.921101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.921354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.921384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.921401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.922382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.922839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.922878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.922897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.379 [2024-10-07 13:35:05.922975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.379 [2024-10-07 13:35:05.931200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.379 [2024-10-07 13:35:05.931481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.379 [2024-10-07 13:35:05.931533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.379 [2024-10-07 13:35:05.931551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.379 [2024-10-07 13:35:05.931577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.379 [2024-10-07 13:35:05.931602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.379 [2024-10-07 13:35:05.931617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.379 [2024-10-07 13:35:05.931630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:05.931655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:05.941298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:05.941478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:05.941528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:05.941546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:05.941731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:05.941813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:05.941832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:05.941851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:05.941876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:05.953551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:05.953792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:05.953837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:05.953854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:05.954217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:05.954361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:05.954384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:05.954398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:05.954615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:05.968910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:05.969238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:05.969269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:05.969286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:05.969312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:05.969685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:05.969724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:05.969738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:05.970045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:05.982687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:05.983364] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:05.983408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:05.983425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:05.983826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:05.984051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:05.984074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:05.984088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:05.984152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:05.998051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:05.998389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:05.998419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:05.998436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:05.998461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:05.998510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:05.998527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:05.998540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:05.998564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:06.012665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:06.013342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:06.013387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:06.013404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:06.013718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:06.013777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:06.013812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:06.013827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:06.014004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:06.028268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:06.028542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:06.028574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:06.028593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:06.028619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:06.028643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:06.028658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:06.028671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:06.029048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:06.042577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:06.042820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:06.042850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:06.042868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:06.042897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:06.042922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:06.042937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:06.042950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:06.042974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:06.054424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:06.054882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:06.054927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:06.054943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:06.055066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:06.055189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:06.055211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:06.055225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:06.058532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:06.064727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:06.065467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:06.065519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:06.065538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:06.065598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:06.065626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.380 [2024-10-07 13:35:06.065642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.380 [2024-10-07 13:35:06.065655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.380 [2024-10-07 13:35:06.065686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.380 [2024-10-07 13:35:06.074887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.380 [2024-10-07 13:35:06.075114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.380 [2024-10-07 13:35:06.075143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.380 [2024-10-07 13:35:06.075160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.380 [2024-10-07 13:35:06.075338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.380 [2024-10-07 13:35:06.075394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.075414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.075432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.075467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.088962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.089322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.089352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.089369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.089635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.089708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.089729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.089743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.089768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.103632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.103827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.103871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.103888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.103914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.103937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.103951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.103964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.103988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.114663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.114991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.115020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.115036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.115154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.115263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.115293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.115305] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.115412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.125211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.125421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.125454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.125495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.125523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.125560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.125578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.125591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.125616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.135750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.136256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.136299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.136315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.136360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.136387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.136402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.136415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.136438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.146979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.147198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.147227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.147244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.147269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.147304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.147321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.147334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.147359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.161099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.161559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.161589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.161621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.162103] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.162347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.162370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.162384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.162444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.176872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.177999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.178029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.178060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.178158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.178199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.178223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.178236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.178261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.192312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.192560] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.192591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.192608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.192634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.192658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.192673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.192686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.381 [2024-10-07 13:35:06.192710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.381 [2024-10-07 13:35:06.207898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.381 [2024-10-07 13:35:06.208136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.381 [2024-10-07 13:35:06.208164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.381 [2024-10-07 13:35:06.208181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.381 [2024-10-07 13:35:06.208205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.381 [2024-10-07 13:35:06.208249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.381 [2024-10-07 13:35:06.208267] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.381 [2024-10-07 13:35:06.208279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.208304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.222193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.223312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.223356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.223373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.223808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.224025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.224048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.224063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.224114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.237704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.237942] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.237972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.237989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.238016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.238039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.238054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.238066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.238090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.249000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.249322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.249350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.249367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.249508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.249627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.249648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.249662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.249834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.259101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.259375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.259403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.259425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.259641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.259873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.259896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.259910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.260053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.269654] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.269930] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.269960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.269977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.270192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.270266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.270288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.270301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.270326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.280022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.280348] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.280378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.280395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.280544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.280677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.280699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.280713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.282576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.290120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.290395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.290423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.290439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.290463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.290511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.290538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.290552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.290741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.300216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.300506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.300536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.300553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.301636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.302110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.302133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.302163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.302209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.313970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.314257] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.314286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.314303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.314327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.314350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.314365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.314377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.314401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.382 [2024-10-07 13:35:06.328159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.382 [2024-10-07 13:35:06.328372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.382 [2024-10-07 13:35:06.328401] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.382 [2024-10-07 13:35:06.328418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.382 [2024-10-07 13:35:06.328443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.382 [2024-10-07 13:35:06.328480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.382 [2024-10-07 13:35:06.328506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.382 [2024-10-07 13:35:06.328519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.382 [2024-10-07 13:35:06.328544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.338624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.338954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.338984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.339001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.339109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.339230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.339250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.339263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.339380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.348717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.349004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.349033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.349049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.349074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.349098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.349112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.349125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.349149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.359615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.359837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.359866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.359883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.359907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.359930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.359945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.359958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.359982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.373285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.373594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.373625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.373643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.373845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.373903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.373923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.373936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.373960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.386352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.387313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.387358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.387375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.387788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.388034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.388057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.388071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.388121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.396494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.396758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.396802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.396819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.396843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.396866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.396880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.396892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.396916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.406879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.407183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.407212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.407229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.407253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.407277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.407291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.407309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.407334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.416979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.417258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.417288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.417304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.417507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.417565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.417585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.417599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.417624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.429823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.430297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.430340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.430357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.430584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.430810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.430833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.430846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.430897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.443422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.443908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.443938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.443969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.444519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.444766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.444804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.383 [2024-10-07 13:35:06.444818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.383 [2024-10-07 13:35:06.445018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.383 [2024-10-07 13:35:06.453523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.383 [2024-10-07 13:35:06.453820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.383 [2024-10-07 13:35:06.453854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.383 [2024-10-07 13:35:06.453872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.383 [2024-10-07 13:35:06.453896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.383 [2024-10-07 13:35:06.453919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.383 [2024-10-07 13:35:06.453933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.453946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.456449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.463623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.463879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.463907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.463923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.464071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.464201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.464223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.464237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.464349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.473763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.473969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.473998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.474014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.474039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.474063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.474077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.474091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.474115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.489407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.489590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.489621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.489638] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.489663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.489692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.489709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.489722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.489747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.499962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.500321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.500351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.500382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.500539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.500657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.500678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.500692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.500882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.510061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.510279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.510307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.510323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.510348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.510370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.510384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.510397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.510420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.520388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.520613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.520644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.520661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.520686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.520710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.520724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.520738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.520762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.531613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.534700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.534745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.534763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.535892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.536366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.536388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.536418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.536659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.541698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.541952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.541980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.541996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.542020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.542043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.542058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.542070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.542094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.551807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.552040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.552069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.552085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.552109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.552132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.552146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.552158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.552182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.564742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.564976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.565005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.565027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.565052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.384 [2024-10-07 13:35:06.565075] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.384 [2024-10-07 13:35:06.565089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.384 [2024-10-07 13:35:06.565102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.384 [2024-10-07 13:35:06.565125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.384 [2024-10-07 13:35:06.579502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.384 [2024-10-07 13:35:06.579677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.384 [2024-10-07 13:35:06.579717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.384 [2024-10-07 13:35:06.579734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.384 [2024-10-07 13:35:06.579928] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.579983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.580003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.580017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.580042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.592649] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.593852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.593896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.593913] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.594255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.594460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.594507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.594523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.595004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.605377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.605654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.605685] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.605703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.605829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.605944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.605974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.605988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.608434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.616015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.616201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.616230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.616247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.616587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.616630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.616646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.616659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.616683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.626112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.626262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.626291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.626308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.626509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.626569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.626590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.626604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.626629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.638367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.638566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.638596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.638613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.638638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.638662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.638677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.638691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.638716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.653861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.654663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.654708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.654726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.654829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.654857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.654872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.654885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.654910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.668707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.668875] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.668903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.668920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.668945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.668968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.668982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.668995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.669019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.679482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.681310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.681354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.681372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.683514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.684225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.684248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.684277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.684709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.689576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.689733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.689763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.689794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.689824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.689848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.689862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.689876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.689900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.699703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.699882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.699910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.385 [2024-10-07 13:35:06.699926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.385 [2024-10-07 13:35:06.699951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.385 [2024-10-07 13:35:06.699974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.385 [2024-10-07 13:35:06.699989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.385 [2024-10-07 13:35:06.700002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.385 [2024-10-07 13:35:06.700215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.385 [2024-10-07 13:35:06.713161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.385 [2024-10-07 13:35:06.713722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.385 [2024-10-07 13:35:06.713767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.713784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.714061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.714121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.714141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.714155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.714179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.727230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.727439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.727469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.727495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.727523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.727548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.727563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.727581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.727607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.740002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.740350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.740380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.740397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.740554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.740673] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.740694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.740708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.743174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.750408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.750669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.750700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.750717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.750850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.750963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.750984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.750997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.751109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 8605.25 IOPS, 33.61 MiB/s [2024-10-07T11:35:19.319Z] [2024-10-07 13:35:06.760559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.760791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.760821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.760853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.761069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.761129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.761149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.761164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.761189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.773111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.773524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.773574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.773592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.773825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.773883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.773903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.773917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.774093] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.783212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.783456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.783510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.783529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.787824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.788035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.788060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.788074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.788781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.793310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.793576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.793606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.793623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.793806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.793877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.793897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.793911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.793936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.806232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.806467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.806521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.806539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.806564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.806594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.806610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.806622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.806648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.386 [2024-10-07 13:35:06.821884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.386 [2024-10-07 13:35:06.822264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.386 [2024-10-07 13:35:06.822309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.386 [2024-10-07 13:35:06.822326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.386 [2024-10-07 13:35:06.822365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.386 [2024-10-07 13:35:06.822389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.386 [2024-10-07 13:35:06.822404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.386 [2024-10-07 13:35:06.822417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.386 [2024-10-07 13:35:06.822441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.837818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.838086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.838116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.838133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.838158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.838182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.838197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.838210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.838234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.848894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.852095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.852139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.852157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.852976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.853378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.853415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.853429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.853685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.858995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.859246] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.859274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.859290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.859314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.859337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.859351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.859364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.859388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.869090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.869310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.869339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.869356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.869380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.869404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.869418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.869430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.869454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.879482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.879794] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.879825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.879842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.879981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.880108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.880129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.880143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.883329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.889575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.889840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.889869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.889894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.889920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.889943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.889958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.889970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.889994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.900454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.901266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.901311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.901328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.901584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.901810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.901833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.901847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.901899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.914953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.915431] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.915475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.915501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.915723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.915781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.915801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.915816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.915856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.930783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.931722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.931767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.931786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.931886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.931914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.931934] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.931948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.931973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.944704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.945119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.945151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.945169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.945367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.945423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.945443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.387 [2024-10-07 13:35:06.945457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.387 [2024-10-07 13:35:06.945508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.387 [2024-10-07 13:35:06.956685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.387 [2024-10-07 13:35:06.956990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.387 [2024-10-07 13:35:06.957021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.387 [2024-10-07 13:35:06.957038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.387 [2024-10-07 13:35:06.957146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.387 [2024-10-07 13:35:06.957257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.387 [2024-10-07 13:35:06.957278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:06.957291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:06.960306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:06.966800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:06.966994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:06.967023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:06.967040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:06.967064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:06.967088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:06.967102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:06.967115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:06.967139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:06.976967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:06.977160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:06.977191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:06.977208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:06.977234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:06.977429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:06.977452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:06.977481] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:06.977545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:06.991274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:06.991467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:06.991520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:06.991538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:06.991564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:06.991588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:06.991603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:06.991616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:06.991641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.003995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.004220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.004250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.004268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.004376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.004575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:07.004600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:07.004614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:07.004668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.014095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.014314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.014343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.014360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.014390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.014413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:07.014428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:07.014440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:07.014464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.024192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.024324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.024353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.024370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.024394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.024418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:07.024432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:07.024445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:07.024469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.036252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.036394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.036423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.036440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.036464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.036525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:07.036545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:07.036559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:07.036583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.048615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.049017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.049061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.049077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.049293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.049362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:07.049384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:07.049403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:07.049429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.059997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.060374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.060404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.060421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.060586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.060731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:07.060754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:07.060768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:07.060896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.071013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.071243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.071272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.071289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.071315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.071339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.388 [2024-10-07 13:35:07.071354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.388 [2024-10-07 13:35:07.071368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.388 [2024-10-07 13:35:07.071403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.388 [2024-10-07 13:35:07.081111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.388 [2024-10-07 13:35:07.081389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.388 [2024-10-07 13:35:07.081418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.388 [2024-10-07 13:35:07.081435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.388 [2024-10-07 13:35:07.081459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.388 [2024-10-07 13:35:07.081509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.081527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.081540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.081748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.091207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.091427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.091461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.091479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.091713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.091884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.091908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.091923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.092046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.103175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.103527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.103560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.103577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.103640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.103839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.103862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.103876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.103927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.115038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.115573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.115618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.115635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.115830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.115895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.115915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.115929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.115960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.128687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.128998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.129043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.129060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.129169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.129298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.129318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.129332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.131317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.138801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.139014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.139043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.139060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.139084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.139107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.139123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.139135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.139286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.148898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.149098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.149128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.149144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.149359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.149429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.149450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.149478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.149684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.162451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.162918] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.162948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.162979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.163178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.163227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.163246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.163259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.163451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.172568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.172822] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.172867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.172884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.172909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.172945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.172962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.172975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.172999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.182948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.183131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.183159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.183176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.183716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.183909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.183931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.183947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.183973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.193707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.193867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.193897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.193914] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.389 [2024-10-07 13:35:07.193939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.389 [2024-10-07 13:35:07.193963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.389 [2024-10-07 13:35:07.193977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.389 [2024-10-07 13:35:07.193990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.389 [2024-10-07 13:35:07.194014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.389 [2024-10-07 13:35:07.204075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.389 [2024-10-07 13:35:07.204307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.389 [2024-10-07 13:35:07.204336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.389 [2024-10-07 13:35:07.204359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.204384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.204407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.204422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.204434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.204458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.214174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.214390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.214419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.214437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.214461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.214522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.214537] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.214550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.214575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.225924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.226143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.226173] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.226190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.226406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.226477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.226530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.226546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.226730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.240314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.240637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.240670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.240688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.241142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.241432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.241473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.241499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.241735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.252171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.252605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.252637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.252656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.256344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.257051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.257076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.257106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.257330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.262303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.262532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.262562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.262580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.262605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.262736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.262753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.262768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.262793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.272399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.272762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.272794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.272811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.272876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.273055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.273077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.273091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.273141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.287921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.288400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.288444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.288461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.288693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.288764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.288794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.288809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.288849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.302912] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.303114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.303143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.303161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.303185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.303209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.303223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.303236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.303260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.313223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.390 [2024-10-07 13:35:07.313401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.390 [2024-10-07 13:35:07.313431] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.390 [2024-10-07 13:35:07.313447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.390 [2024-10-07 13:35:07.313496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.390 [2024-10-07 13:35:07.313523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.390 [2024-10-07 13:35:07.313538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.390 [2024-10-07 13:35:07.313552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.390 [2024-10-07 13:35:07.313577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.390 [2024-10-07 13:35:07.323833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.323997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.324026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.324044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.324074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.324097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.324112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.324124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.324149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.335373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.335754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.335804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.335821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.335870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.336072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.336096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.336110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.336160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.351207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.351838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.351884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.351901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.352128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.352184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.352205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.352218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.352395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.365818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.365989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.366018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.366034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.366059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.366091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.366105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.366124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.366149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.381936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.382604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.382650] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.382669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.382922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.383126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.383149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.383163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.383220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.392572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.392879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.392909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.392927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.396591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.397458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.397482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.397522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.397974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.402876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.403203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.403231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.403248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.403355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.403435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.403462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.403502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.403541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.412973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.413174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.413209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.413226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.413251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.413274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.413289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.413302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.413326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.425656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.425856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.425885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.425902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.425926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.425949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.425964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.425977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.426001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.440910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.441100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.441130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.441147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.441172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.441195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.441209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.441222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.391 [2024-10-07 13:35:07.441246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.391 [2024-10-07 13:35:07.454910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.391 [2024-10-07 13:35:07.455077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.391 [2024-10-07 13:35:07.455107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.391 [2024-10-07 13:35:07.455124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.391 [2024-10-07 13:35:07.455148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.391 [2024-10-07 13:35:07.455177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.391 [2024-10-07 13:35:07.455192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.391 [2024-10-07 13:35:07.455205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.455229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.468659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.470441] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.470493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.470512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.470635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.470674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.470692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.470706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.470732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.479070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.479342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.479374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.479392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.479529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.479661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.479683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.479697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.479808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.489271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.489465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.489504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.489524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.489709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.489776] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.489797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.489822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.489853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.502758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.503171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.503203] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.503222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.503452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.503521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.503544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.503559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.503741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.518428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.518864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.518909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.518926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.519138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.519194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.519221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.519234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.519259] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.533956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.534107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.534136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.534153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.534178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.534216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.534234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.534247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.534271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.544078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.544324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.544353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.544376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.544401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.544439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.544457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.544470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.544519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.554494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.554702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.554732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.554748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.554774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.554813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.554827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.554840] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.554864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.564580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.564907] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.564936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.564953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.565894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.566550] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.566575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.566590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.566833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.578676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.578878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.578908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.578925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.578950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.392 [2024-10-07 13:35:07.578974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.392 [2024-10-07 13:35:07.578995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.392 [2024-10-07 13:35:07.579008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.392 [2024-10-07 13:35:07.579033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.392 [2024-10-07 13:35:07.590282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.392 [2024-10-07 13:35:07.590621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.392 [2024-10-07 13:35:07.590652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.392 [2024-10-07 13:35:07.590670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.392 [2024-10-07 13:35:07.593007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.594017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.594041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.594069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.594652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.600382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.600603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.600633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.600650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.600676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.600700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.600715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.600728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.600752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.610824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.610983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.611011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.611028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.611053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.611230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.611253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.611267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.611317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.621175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.621409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.621440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.621456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.623730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.624741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.624765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.624796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.625087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.631523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.631699] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.631735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.631752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.631791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.631815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.631830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.631842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.631866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.641622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.641791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.641837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.641854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.641880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.642057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.642080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.642093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.642144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.656079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.656435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.656465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.656509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.656578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.656764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.656802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.656817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.656868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.670290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.670430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.670460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.670503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.670530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.670554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.670569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.670583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.670609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.685196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.686156] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.686201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.686219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.686452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.686950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.686974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.687002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.687272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.696231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.696496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.696527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.696545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.696658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.696790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.696811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.696830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.697644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.710044] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.711447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.711501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.393 [2024-10-07 13:35:07.711520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.393 [2024-10-07 13:35:07.713055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.393 [2024-10-07 13:35:07.713738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.393 [2024-10-07 13:35:07.713763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.393 [2024-10-07 13:35:07.713793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.393 [2024-10-07 13:35:07.714061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.393 [2024-10-07 13:35:07.720144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.393 [2024-10-07 13:35:07.720300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.393 [2024-10-07 13:35:07.720339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.394 [2024-10-07 13:35:07.720355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.394 [2024-10-07 13:35:07.720379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.394 [2024-10-07 13:35:07.720403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.394 [2024-10-07 13:35:07.720419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.394 [2024-10-07 13:35:07.720432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.394 [2024-10-07 13:35:07.720456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.394 [2024-10-07 13:35:07.730505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.394 [2024-10-07 13:35:07.730655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.394 [2024-10-07 13:35:07.730686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.394 [2024-10-07 13:35:07.730704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.394 [2024-10-07 13:35:07.730901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.394 [2024-10-07 13:35:07.730958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.394 [2024-10-07 13:35:07.730978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.394 [2024-10-07 13:35:07.730992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.394 [2024-10-07 13:35:07.731018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.394 [2024-10-07 13:35:07.742965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.394 [2024-10-07 13:35:07.743167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.394 [2024-10-07 13:35:07.743202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.394 [2024-10-07 13:35:07.743219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.394 [2024-10-07 13:35:07.743244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.394 [2024-10-07 13:35:07.743268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.394 [2024-10-07 13:35:07.743282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.394 [2024-10-07 13:35:07.743296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.394 [2024-10-07 13:35:07.743522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.394 [2024-10-07 13:35:07.754343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.394 [2024-10-07 13:35:07.754588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.394 [2024-10-07 13:35:07.754620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.394 [2024-10-07 13:35:07.754638] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.394 [2024-10-07 13:35:07.756853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.394 8595.20 IOPS, 33.58 MiB/s [2024-10-07T11:35:19.327Z] [2024-10-07 13:35:07.759765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.394 [2024-10-07 13:35:07.759789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.394 [2024-10-07 13:35:07.759809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.394 [2024-10-07 13:35:07.760830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.394 [2024-10-07 13:35:07.764636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.394 [2024-10-07 13:35:07.764789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.394 [2024-10-07 13:35:07.764818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.394 [2024-10-07 13:35:07.764835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.394 [2024-10-07 13:35:07.764859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.394 [2024-10-07 13:35:07.764882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.394 [2024-10-07 13:35:07.764897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.394 [2024-10-07 13:35:07.764911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.394 [2024-10-07 13:35:07.764935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.394 [2024-10-07 13:35:07.774725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.394 [2024-10-07 13:35:07.775057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.394 [2024-10-07 13:35:07.775087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.394 [2024-10-07 13:35:07.775104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.394 [2024-10-07 13:35:07.775154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.394 [2024-10-07 13:35:07.775186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.394 [2024-10-07 13:35:07.775202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.394 [2024-10-07 13:35:07.775215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.394 [2024-10-07 13:35:07.775393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.394 [2024-10-07 13:35:07.786361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:83928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:83936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:83944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:83952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:83960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:83968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:83976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:83984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:83992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:84000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:84008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:84016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:84024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:84032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:84040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.394 [2024-10-07 13:35:07.786926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:84048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.394 [2024-10-07 13:35:07.786940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.786955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:84056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.786969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.786984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:84064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.786999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:84072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:84080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:84088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:84096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:84104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:84112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:84120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:84128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:84136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:84144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:84152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:84160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:84168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:84176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:84184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:84192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:84200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:84208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:84216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:84224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:84232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:84248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:84256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:84264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:84272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:84280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:84288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:84296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:84304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.787979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.787995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:84312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:84320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:84328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:84336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:84344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:84352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:84360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:84368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:84376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.395 [2024-10-07 13:35:07.788268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:84384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.395 [2024-10-07 13:35:07.788283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:84392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:84400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:84408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:84416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:84424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:83720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:83728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:83736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:83744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:83752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:83760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:83768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:83776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:83784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:83792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.788762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:84432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:84440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:84448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:84456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:84464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:84472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.788979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:84480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.788993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:84488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:84496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:84504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:84512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:84520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:84528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:84536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:84544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:84552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:84560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:84568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:84576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.396 [2024-10-07 13:35:07.789386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:83800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.789417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:83808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.789457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:83816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.789497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:83824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.789541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:83832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.789572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:83840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.789603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:83848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:23.396 [2024-10-07 13:35:07.789633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.396 [2024-10-07 13:35:07.789649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:84584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.397 [2024-10-07 13:35:07.789668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.789684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:84592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.397 [2024-10-07 13:35:07.789699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.789714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:84600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.397 [2024-10-07 13:35:07.789729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.789745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:84608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.397 [2024-10-07 13:35:07.789760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.789776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:84616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.397 [2024-10-07 13:35:07.789790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.789805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:84624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:23.397 [2024-10-07 13:35:07.789823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.789854] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.789872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84632 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.789886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.789954] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.397 [2024-10-07 13:35:07.789976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790002] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.397 [2024-10-07 13:35:07.790016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790031] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.397 [2024-10-07 13:35:07.790045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790060] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:23.397 [2024-10-07 13:35:07.790074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.397 [2024-10-07 13:35:07.790338] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790359] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84640 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790418] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790430] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84648 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790477] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790496] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84656 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790543] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790554] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84664 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790592] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790603] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84672 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790641] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790652] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84680 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790691] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790702] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84688 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790739] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790750] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84696 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790787] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790798] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84704 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790848] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790859] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84712 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790895] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790914] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84720 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.790950] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.790961] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.790976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84728 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.790989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.791002] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.791013] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.791023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84736 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.791036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.791048] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.791059] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.791070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83856 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.791082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.791094] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.791105] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.791117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83864 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.791129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.791142] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.791153] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.791164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83872 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.791176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.791196] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.791208] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.791219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83880 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.791232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.791244] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.397 [2024-10-07 13:35:07.791255] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.397 [2024-10-07 13:35:07.791266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83888 len:8 PRP1 0x0 PRP2 0x0 00:24:23.397 [2024-10-07 13:35:07.791279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.397 [2024-10-07 13:35:07.791291] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791302] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83896 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791339] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791350] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83904 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791386] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791397] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83912 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791434] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791444] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83920 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791500] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791513] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83928 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791551] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791562] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83936 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791603] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791616] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83944 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791654] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791666] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83952 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791703] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791715] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83960 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791752] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791764] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83968 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791805] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791817] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83976 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791858] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791869] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83984 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791906] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791918] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83992 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.791955] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.791966] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.791981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84000 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.791995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792008] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792020] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84008 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792057] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792068] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84016 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792123] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792134] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84024 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792171] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792182] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84032 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792219] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792230] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84040 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792267] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792278] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84048 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792314] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792326] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84056 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792362] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792376] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84064 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792413] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792425] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84072 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792461] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792475] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84080 len:8 PRP1 0x0 PRP2 0x0 00:24:23.398 [2024-10-07 13:35:07.792514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.398 [2024-10-07 13:35:07.792528] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.398 [2024-10-07 13:35:07.792539] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.398 [2024-10-07 13:35:07.792551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84088 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792576] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792587] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84096 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792624] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792635] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84104 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792671] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792683] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84112 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792719] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792730] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84120 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792777] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792788] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84128 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792825] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792836] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84136 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792873] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792884] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84144 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792921] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792932] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84152 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.792955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.792968] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.792978] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.792990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84160 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793015] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793026] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84168 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793062] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793072] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84176 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793109] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793119] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84184 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793159] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793170] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84192 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793206] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793222] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84200 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793260] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793273] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84208 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793309] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793320] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84216 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793364] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793375] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84224 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793412] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793423] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84232 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793460] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793480] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84240 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793527] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793538] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84248 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793578] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793589] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84256 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.399 [2024-10-07 13:35:07.793626] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.399 [2024-10-07 13:35:07.793646] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.399 [2024-10-07 13:35:07.793658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84264 len:8 PRP1 0x0 PRP2 0x0 00:24:23.399 [2024-10-07 13:35:07.793671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.793684] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.793695] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.793706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84272 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.793719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.793732] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.793743] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.793754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84280 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.793767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.793789] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.793800] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.793811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84288 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.793823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.793837] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.793847] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.793858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84296 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.793870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.793883] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.793894] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.793905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84304 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.793917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.793934] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.793945] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.793957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84312 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.793978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.793991] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794002] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84320 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794038] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794058] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84328 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794103] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794114] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84336 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794151] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794162] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84344 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794198] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794209] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84352 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794245] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794256] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84360 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794292] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794303] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84368 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794344] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794355] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.794366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84376 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.794378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.794391] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.794402] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.800740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84384 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.800771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.800791] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.800805] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.800816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84392 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.800829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.800842] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.800853] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.800864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84400 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.800876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.800889] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.800900] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.800911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84408 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.800923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.800936] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.800946] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.800957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84416 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.800969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.800982] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.800993] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.801004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84424 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.801016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.801029] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.801039] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.801057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83720 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.801071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.801085] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.801096] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.801107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83728 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.801119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.801131] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.801142] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.801153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83736 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.801165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.801178] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.801189] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.400 [2024-10-07 13:35:07.801199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83744 len:8 PRP1 0x0 PRP2 0x0 00:24:23.400 [2024-10-07 13:35:07.801212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.400 [2024-10-07 13:35:07.801224] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.400 [2024-10-07 13:35:07.801235] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83752 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801271] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801281] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83760 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801316] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801327] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83768 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801363] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801373] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83776 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801409] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801424] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83784 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801461] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801472] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83792 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801521] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801532] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84432 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801569] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801579] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84440 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801616] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801626] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84448 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801662] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801673] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84456 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801709] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801720] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84464 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801755] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801766] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84472 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801806] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801817] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84480 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801853] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801864] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84488 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801900] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801911] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84496 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801947] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.801958] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.801968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84504 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.801981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.801993] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802005] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84512 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802041] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802053] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84520 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802090] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802101] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84528 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802137] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802148] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84536 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802189] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802200] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84544 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802236] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802247] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84552 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802284] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802294] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84560 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802330] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802341] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84568 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802378] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.401 [2024-10-07 13:35:07.802389] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.401 [2024-10-07 13:35:07.802400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84576 len:8 PRP1 0x0 PRP2 0x0 00:24:23.401 [2024-10-07 13:35:07.802413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.401 [2024-10-07 13:35:07.802426] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802437] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83800 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802474] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802494] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83808 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802534] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802545] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83816 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802586] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802597] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83824 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802634] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802645] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83832 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802681] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802692] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83840 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802729] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802745] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:83848 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802783] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802795] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84584 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802835] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802846] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84592 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802888] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802899] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84600 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802935] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802949] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.802961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84608 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.802974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.802987] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.802998] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.803009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84616 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.803022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.803035] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.803046] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.803057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84624 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.803069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.803082] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:23.402 [2024-10-07 13:35:07.803093] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:23.402 [2024-10-07 13:35:07.803104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:84632 len:8 PRP1 0x0 PRP2 0x0 00:24:23.402 [2024-10-07 13:35:07.803116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:23.402 [2024-10-07 13:35:07.803185] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x68a340 was disconnected and freed. reset controller. 00:24:23.402 [2024-10-07 13:35:07.803266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.402 [2024-10-07 13:35:07.803296] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:23.402 [2024-10-07 13:35:07.804758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.402 [2024-10-07 13:35:07.804795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.402 [2024-10-07 13:35:07.805013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.402 [2024-10-07 13:35:07.805043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.402 [2024-10-07 13:35:07.805062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.402 [2024-10-07 13:35:07.805187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.402 [2024-10-07 13:35:07.805212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.402 [2024-10-07 13:35:07.805227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.402 [2024-10-07 13:35:07.805253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.402 [2024-10-07 13:35:07.805274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.402 [2024-10-07 13:35:07.805564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.402 [2024-10-07 13:35:07.805587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.402 [2024-10-07 13:35:07.805610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.402 [2024-10-07 13:35:07.805629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.402 [2024-10-07 13:35:07.805644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.402 [2024-10-07 13:35:07.805657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.402 [2024-10-07 13:35:07.805897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.402 [2024-10-07 13:35:07.805921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.402 [2024-10-07 13:35:07.814879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.402 [2024-10-07 13:35:07.814952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.402 [2024-10-07 13:35:07.815159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.402 [2024-10-07 13:35:07.815188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.402 [2024-10-07 13:35:07.815205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.402 [2024-10-07 13:35:07.815341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.402 [2024-10-07 13:35:07.815368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.402 [2024-10-07 13:35:07.815384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.402 [2024-10-07 13:35:07.815402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.402 [2024-10-07 13:35:07.815427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.402 [2024-10-07 13:35:07.815445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.402 [2024-10-07 13:35:07.815457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.402 [2024-10-07 13:35:07.815495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.402 [2024-10-07 13:35:07.815541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.402 [2024-10-07 13:35:07.815561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.402 [2024-10-07 13:35:07.815574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.402 [2024-10-07 13:35:07.815588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.402 [2024-10-07 13:35:07.815610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.402 [2024-10-07 13:35:07.824987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.402 [2024-10-07 13:35:07.825318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.402 [2024-10-07 13:35:07.825347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.402 [2024-10-07 13:35:07.825364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.825401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.825448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.825521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.825539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.825552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.825577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.825682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.825709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.403 [2024-10-07 13:35:07.825725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.825750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.825789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.825803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.825816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.825839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.836094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.836140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.836341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.836370] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.403 [2024-10-07 13:35:07.836386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.836528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.836556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.403 [2024-10-07 13:35:07.836572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.836845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.836874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.837111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.837134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.837148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.837165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.837179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.837191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.837241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.837261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.847121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.847157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.847506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.847537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.403 [2024-10-07 13:35:07.847555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.847650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.847677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.403 [2024-10-07 13:35:07.847693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.847821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.847847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.847969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.847990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.848004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.848020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.848035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.848047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.848155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.848185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.857253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.857315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.857513] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.857543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.403 [2024-10-07 13:35:07.857560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.857677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.857705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.403 [2024-10-07 13:35:07.857721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.857739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.857765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.857801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.857814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.857826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.857860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.857878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.857890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.857902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.857924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.869346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.869401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.403 [2024-10-07 13:35:07.869670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.869701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.403 [2024-10-07 13:35:07.869718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.869840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.403 [2024-10-07 13:35:07.869866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.403 [2024-10-07 13:35:07.869881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.403 [2024-10-07 13:35:07.869906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.869926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.403 [2024-10-07 13:35:07.869947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.869961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.869974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.869990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.403 [2024-10-07 13:35:07.870004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.403 [2024-10-07 13:35:07.870017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.403 [2024-10-07 13:35:07.870047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.870063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.403 [2024-10-07 13:35:07.879503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.879552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.879812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.879840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.404 [2024-10-07 13:35:07.879856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.879976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.880002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.404 [2024-10-07 13:35:07.880018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.880041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.882630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.882659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.882695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.882708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.885328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.885355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.885385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.885399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.886235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.889589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.889866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.889895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.404 [2024-10-07 13:35:07.889912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.890057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.890247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.890283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.890300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.890313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.890361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.890517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.890546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.404 [2024-10-07 13:35:07.890562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.890587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.890611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.890627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.890640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.890664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.901559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.901591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.901786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.901830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.404 [2024-10-07 13:35:07.901846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.902003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.902029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.404 [2024-10-07 13:35:07.902045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.902069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.902089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.902109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.902123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.902136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.902153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.902167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.902179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.902202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.902218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.916876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.916923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.917646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.917678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.404 [2024-10-07 13:35:07.917696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.917828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.917855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.404 [2024-10-07 13:35:07.917885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.918313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.918341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.918596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.918621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.918635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.918653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.918674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.918687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.918744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.918779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.928724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.928757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.929075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.929104] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.404 [2024-10-07 13:35:07.929121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.929225] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.929251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.404 [2024-10-07 13:35:07.929267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.929375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.929402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.404 [2024-10-07 13:35:07.929532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.929555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.929569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.929586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.404 [2024-10-07 13:35:07.929601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.404 [2024-10-07 13:35:07.929614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.404 [2024-10-07 13:35:07.929729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.929752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.404 [2024-10-07 13:35:07.938836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.938898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.404 [2024-10-07 13:35:07.939108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.939136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.404 [2024-10-07 13:35:07.939153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.404 [2024-10-07 13:35:07.939261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.404 [2024-10-07 13:35:07.939288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.404 [2024-10-07 13:35:07.939304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.939326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.939352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.939370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.939382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.939395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.939427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.939443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.939456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.939483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.939518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.949093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.949131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.949302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.949330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.405 [2024-10-07 13:35:07.949346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.949494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.949520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.405 [2024-10-07 13:35:07.949535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.949719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.949746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.949809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.949829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.949843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.949861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.949875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.949887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.950062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.950085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.959580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.959614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.959868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.959911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.405 [2024-10-07 13:35:07.959928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.960060] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.960086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.405 [2024-10-07 13:35:07.960101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.962637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.962683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.963528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.963553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.963567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.963585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.963600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.963613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.964076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.964102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.969694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.969769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.970035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.970064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.405 [2024-10-07 13:35:07.970080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.970254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.970283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.405 [2024-10-07 13:35:07.970298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.970316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.970341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.970358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.970372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.970384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.970408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.970425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.970442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.970456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.970506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.979815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.980101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.980130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.405 [2024-10-07 13:35:07.980146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.980183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.980214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.980242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.980257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.980270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.980292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.980532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.980560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.405 [2024-10-07 13:35:07.980577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.980601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.980624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.980639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.980652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.980676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.405 [2024-10-07 13:35:07.992705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.992995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.405 [2024-10-07 13:35:07.993180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.993209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.405 [2024-10-07 13:35:07.993226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.993451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.405 [2024-10-07 13:35:07.993501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.405 [2024-10-07 13:35:07.993520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.405 [2024-10-07 13:35:07.993538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.993570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.405 [2024-10-07 13:35:07.993589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.405 [2024-10-07 13:35:07.993602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.405 [2024-10-07 13:35:07.993614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.405 [2024-10-07 13:35:07.993639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:07.993657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:07.993670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:07.993682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:07.993704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.006277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.006322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.006533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.006563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.406 [2024-10-07 13:35:08.006581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.006724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.006751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.406 [2024-10-07 13:35:08.006768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.006793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.006826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.006847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.006863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.006876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.006894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.006909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.006921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.006946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.006962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.016403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.016470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.016708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.016739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.406 [2024-10-07 13:35:08.016764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.019616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.019648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.406 [2024-10-07 13:35:08.019665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.019684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.021979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.022011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.022028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.022042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.022919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.022948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.022979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.022996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.023395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.026522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.026788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.026818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.406 [2024-10-07 13:35:08.026834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.026876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.026913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.026942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.026958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.026971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.026995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.027254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.027281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.406 [2024-10-07 13:35:08.027297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.027322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.027345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.027361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.027380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.027405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.038479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.038535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.038702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.038733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.406 [2024-10-07 13:35:08.038750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.038943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.038970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.406 [2024-10-07 13:35:08.038986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.039011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.039032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.039052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.039067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.039081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.039099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.039113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.039126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.039150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.039166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.048620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.048669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.048895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.048924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.406 [2024-10-07 13:35:08.048941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.049080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.049107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.406 [2024-10-07 13:35:08.049123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.406 [2024-10-07 13:35:08.049156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.049181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.406 [2024-10-07 13:35:08.049220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.049233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.049246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.049271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.049293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.406 [2024-10-07 13:35:08.049306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.406 [2024-10-07 13:35:08.049319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.406 [2024-10-07 13:35:08.049343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.406 [2024-10-07 13:35:08.058706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.406 [2024-10-07 13:35:08.059023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.406 [2024-10-07 13:35:08.059052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.407 [2024-10-07 13:35:08.059069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.059107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.059140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.059169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.059184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.059197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.059222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.059448] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.059477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.407 [2024-10-07 13:35:08.059507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.059533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.059556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.059571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.059584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.059607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.068798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.069049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.069079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.407 [2024-10-07 13:35:08.069096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.069122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.069152] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.069168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.069181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.071468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.073764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.074410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.074441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.407 [2024-10-07 13:35:08.074458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.074686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.074745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.074768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.074784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.074810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.079761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.080014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.080043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.407 [2024-10-07 13:35:08.080061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.080086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.080110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.080125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.080138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.080164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.086212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.086691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.086730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.407 [2024-10-07 13:35:08.086751] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.087000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.087216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.087241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.087255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.087318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.089851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.090093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.090123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.407 [2024-10-07 13:35:08.090141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.090166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.090189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.090204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.090218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.090242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.096312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.096618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.096648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.407 [2024-10-07 13:35:08.096665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.096691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.099253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.099277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.099307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.101761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.102392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.102649] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.102678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.407 [2024-10-07 13:35:08.102695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.102890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.102946] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.102966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.102980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.103004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.407 [2024-10-07 13:35:08.106407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.407 [2024-10-07 13:35:08.106637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.407 [2024-10-07 13:35:08.106666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.407 [2024-10-07 13:35:08.106688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.407 [2024-10-07 13:35:08.106841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.407 [2024-10-07 13:35:08.106967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.407 [2024-10-07 13:35:08.106988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.407 [2024-10-07 13:35:08.107001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.407 [2024-10-07 13:35:08.107112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.117151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.117213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.117394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.117422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.408 [2024-10-07 13:35:08.117438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.117564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.117592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.408 [2024-10-07 13:35:08.117608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.117626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.117660] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.117678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.117691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.117703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.117728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.117745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.117758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.117770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.117792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.132079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.132116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.132312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.132340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.408 [2024-10-07 13:35:08.132356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.132506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.132538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.408 [2024-10-07 13:35:08.132555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.132580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.132601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.132622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.132636] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.132649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.132666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.132680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.132693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.132717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.132734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.147832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.147879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.148776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.148832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.408 [2024-10-07 13:35:08.148848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.148993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.149017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.408 [2024-10-07 13:35:08.149032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.149683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.149727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.150169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.150192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.150220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.150237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.150251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.150263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.150497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.150535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.158202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.158234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.158536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.158567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.408 [2024-10-07 13:35:08.158585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.158728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.158755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.408 [2024-10-07 13:35:08.158771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.158898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.158925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.159032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.159052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.159065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.159082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.159096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.159109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.162648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.162675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.168681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.168727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.168912] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.168941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.408 [2024-10-07 13:35:08.168957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.169074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.169100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.408 [2024-10-07 13:35:08.169116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.169140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.169160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.169181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.169196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.169209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.169231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.408 [2024-10-07 13:35:08.169246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.408 [2024-10-07 13:35:08.169259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.408 [2024-10-07 13:35:08.169282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.169298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.408 [2024-10-07 13:35:08.178978] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.179009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.408 [2024-10-07 13:35:08.179168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.179197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.408 [2024-10-07 13:35:08.179214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.179326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.408 [2024-10-07 13:35:08.179353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.408 [2024-10-07 13:35:08.179368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.408 [2024-10-07 13:35:08.179579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.408 [2024-10-07 13:35:08.179609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.179658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.179677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.179691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.179708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.179723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.179736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.179928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.179952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.191529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.191573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.192805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.192835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.409 [2024-10-07 13:35:08.192852] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.192974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.193000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.409 [2024-10-07 13:35:08.193020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.193440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.193484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.193741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.193765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.193780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.193798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.193813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.193826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.194111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.194134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.203896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.203927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.204205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.204234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.409 [2024-10-07 13:35:08.204254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.204382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.204407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.409 [2024-10-07 13:35:08.204423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.204559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.204587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.204702] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.204724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.204738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.204756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.204770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.204783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.208022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.208047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.214022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.214082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.214311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.214339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.409 [2024-10-07 13:35:08.214356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.214501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.214528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.409 [2024-10-07 13:35:08.214544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.214562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.214588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.214606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.214619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.214632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.214657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.214674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.214687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.214700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.214722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.224513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.224558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.224732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.224762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.409 [2024-10-07 13:35:08.224779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.224908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.224934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.409 [2024-10-07 13:35:08.224949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.225128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.225156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.225350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.225372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.225386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.225403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.225423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.225436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.225509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.225531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.238819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.238866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.239031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.239060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.409 [2024-10-07 13:35:08.239076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.239225] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.239252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.409 [2024-10-07 13:35:08.239268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.239292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.239313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.409 [2024-10-07 13:35:08.239334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.239348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.239361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.239378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.409 [2024-10-07 13:35:08.239392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.409 [2024-10-07 13:35:08.239405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.409 [2024-10-07 13:35:08.239428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.239445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.409 [2024-10-07 13:35:08.249171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.249203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.409 [2024-10-07 13:35:08.249469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.249524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.409 [2024-10-07 13:35:08.249543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.409 [2024-10-07 13:35:08.249660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.409 [2024-10-07 13:35:08.249687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.410 [2024-10-07 13:35:08.249703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.252245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.252291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.254058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.254083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.254113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.254131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.254145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.254174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.254241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.254262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.259299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.259360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.259530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.259560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.410 [2024-10-07 13:35:08.259577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.259707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.259735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.410 [2024-10-07 13:35:08.259752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.259771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.259797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.259830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.259843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.259855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.259880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.259896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.259908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.259920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.259942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.269397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.269587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.269619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.410 [2024-10-07 13:35:08.269642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.269680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.269713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.269743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.269759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.269773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.269796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.269965] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.270003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.410 [2024-10-07 13:35:08.270019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.271105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.271830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.271855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.271871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.272123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.284847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.284879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.285148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.285178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.410 [2024-10-07 13:35:08.285194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.285317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.285343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.410 [2024-10-07 13:35:08.285358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.285712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.285741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.285815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.285835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.285848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.285865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.285879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.285896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.286074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.286115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.299641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.299672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.299840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.299868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.410 [2024-10-07 13:35:08.299884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.300017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.300043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.410 [2024-10-07 13:35:08.300058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.300082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.300102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.300122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.300137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.300149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.300165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.300179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.300191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.300214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.300230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.315285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.315318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.315634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.315664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.410 [2024-10-07 13:35:08.315681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.315812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.315838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.410 [2024-10-07 13:35:08.315853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.315885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.315911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.315933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.315947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.315960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.315977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.315991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.316003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.410 [2024-10-07 13:35:08.316026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.316042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.410 [2024-10-07 13:35:08.326156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.326202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.410 [2024-10-07 13:35:08.328526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.328557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.410 [2024-10-07 13:35:08.328590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.328755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.410 [2024-10-07 13:35:08.328781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.410 [2024-10-07 13:35:08.328811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.410 [2024-10-07 13:35:08.330669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.330699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.410 [2024-10-07 13:35:08.331347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.410 [2024-10-07 13:35:08.331369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.410 [2024-10-07 13:35:08.331398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.331416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.331430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.331442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.331703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.331728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.336279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.336338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.336588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.336622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.411 [2024-10-07 13:35:08.336644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.336747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.336774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.411 [2024-10-07 13:35:08.336790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.336822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.336847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.336865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.336877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.336889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.336912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.336928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.336940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.336953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.336974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.346375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.346625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.346655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.411 [2024-10-07 13:35:08.346673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.346711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.346744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.346773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.346789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.346817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.346841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.347076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.347102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.411 [2024-10-07 13:35:08.347118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.347143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.347166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.347180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.347199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.347222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.356764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.357152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.357181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.411 [2024-10-07 13:35:08.357198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.357321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.357438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.357497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.357516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.357529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.357642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.357838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.357864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.411 [2024-10-07 13:35:08.357880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.360635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.362210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.362234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.362263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.363139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.366866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.367086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.367114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.411 [2024-10-07 13:35:08.367130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.367559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.367740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.367763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.367777] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.367910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.367936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.368265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.368311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.411 [2024-10-07 13:35:08.368327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.368452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.368590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.368611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.368625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.368737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.377295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.377722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.377752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.411 [2024-10-07 13:35:08.377784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.377850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.377881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.377897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.377910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.377934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.378673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.378893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.378920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.411 [2024-10-07 13:35:08.378936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.379113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.411 [2024-10-07 13:35:08.379179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.411 [2024-10-07 13:35:08.379198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.411 [2024-10-07 13:35:08.379212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.411 [2024-10-07 13:35:08.379236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.411 [2024-10-07 13:35:08.391986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.392031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.411 [2024-10-07 13:35:08.392239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.392267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.411 [2024-10-07 13:35:08.392283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.411 [2024-10-07 13:35:08.392388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.411 [2024-10-07 13:35:08.392413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.411 [2024-10-07 13:35:08.392429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.392453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.392501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.392526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.392541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.392554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.392572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.392587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.392600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.393124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.393147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.406337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.406383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.406587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.406618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.412 [2024-10-07 13:35:08.406636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.406818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.406844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.412 [2024-10-07 13:35:08.406859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.406884] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.406905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.406940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.406959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.406972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.406989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.407003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.407015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.407039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.407060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.416463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.416550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.416800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.416828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.412 [2024-10-07 13:35:08.416845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.421463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.421517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.412 [2024-10-07 13:35:08.421535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.421554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.421874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.421902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.421915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.421928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.422623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.422649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.422663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.422676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.423104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.426572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.426845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.426874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.412 [2024-10-07 13:35:08.426890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.427082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.427292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.427327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.427344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.427356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.427407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.427603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.427632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.412 [2024-10-07 13:35:08.427654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.427851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.427907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.427927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.427940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.427964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.440795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.440842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.441097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.441126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.412 [2024-10-07 13:35:08.441142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.441359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.441385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.412 [2024-10-07 13:35:08.441400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.441424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.441444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.441502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.441523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.441537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.441554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.441568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.441580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.441605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.441622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.451882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.451913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.452179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.452208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.412 [2024-10-07 13:35:08.452224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.452384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.452423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.412 [2024-10-07 13:35:08.452439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.454244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.454288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.454413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.454434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.454447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.454465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.454479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.454521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.454549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.454566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.412 [2024-10-07 13:35:08.462007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.462068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.412 [2024-10-07 13:35:08.462319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.462348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.412 [2024-10-07 13:35:08.462365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.462572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.412 [2024-10-07 13:35:08.462600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.412 [2024-10-07 13:35:08.462616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.412 [2024-10-07 13:35:08.462634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.463337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.412 [2024-10-07 13:35:08.463362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.412 [2024-10-07 13:35:08.463391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.412 [2024-10-07 13:35:08.463404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.412 [2024-10-07 13:35:08.463612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.463637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.463651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.463664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.463818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.472103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.472390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.472419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.413 [2024-10-07 13:35:08.472435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.472472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.472528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.472557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.472573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.472587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.472610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.472855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.472882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.413 [2024-10-07 13:35:08.472897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.472921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.472944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.472958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.472971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.472994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.483852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.483916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.484123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.484151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.413 [2024-10-07 13:35:08.484167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.484325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.484355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.413 [2024-10-07 13:35:08.484370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.484388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.484413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.484430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.484442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.484460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.484509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.484528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.484541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.484554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.484577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.498288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.498319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.498548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.498579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.413 [2024-10-07 13:35:08.498596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.498749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.498789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.413 [2024-10-07 13:35:08.498805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.498829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.498849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.498870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.498884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.498897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.498914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.498928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.498940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.498964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.498980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.508855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.508900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.511006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.511051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.413 [2024-10-07 13:35:08.511068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.511187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.511213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.413 [2024-10-07 13:35:08.511234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.513226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.513258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.513964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.513989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.514018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.514036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.514051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.514064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.514446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.514473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.518979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.519041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.413 [2024-10-07 13:35:08.519307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.519338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.413 [2024-10-07 13:35:08.519355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.519504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.413 [2024-10-07 13:35:08.519532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.413 [2024-10-07 13:35:08.519548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.413 [2024-10-07 13:35:08.519567] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.519594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.413 [2024-10-07 13:35:08.519612] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.519625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.519638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.519663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.413 [2024-10-07 13:35:08.519682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.413 [2024-10-07 13:35:08.519694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.413 [2024-10-07 13:35:08.519707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.413 [2024-10-07 13:35:08.519730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.529079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.529349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.529380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.414 [2024-10-07 13:35:08.529398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.529610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.529682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.529718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.529735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.529748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.529931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.530105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.530134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.414 [2024-10-07 13:35:08.530150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.530202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.530229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.530249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.530263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.530450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.539446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.543503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.543537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.414 [2024-10-07 13:35:08.543554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.544427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.544575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.544610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.544627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.544641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.544666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.544894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.544921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.414 [2024-10-07 13:35:08.544937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.545150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.545291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.545314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.545328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.545515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.549853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.550213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.550242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.414 [2024-10-07 13:35:08.550259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.550398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.550562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.550585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.550600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.550705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.557115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.557357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.557386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.414 [2024-10-07 13:35:08.557402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.557427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.557456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.557495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.557511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.557536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.559936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.560161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.560189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.414 [2024-10-07 13:35:08.560205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.560230] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.560253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.560268] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.560282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.560310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.569163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.571449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.571502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.414 [2024-10-07 13:35:08.571522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.573670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.573813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.573848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.573864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.573877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.573900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.574119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.574146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.414 [2024-10-07 13:35:08.574163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.574187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.574210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.574225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.574237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.574260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.579264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.579519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.414 [2024-10-07 13:35:08.579550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.414 [2024-10-07 13:35:08.579567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.414 [2024-10-07 13:35:08.579607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.414 [2024-10-07 13:35:08.579634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.414 [2024-10-07 13:35:08.579649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.414 [2024-10-07 13:35:08.579662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.414 [2024-10-07 13:35:08.579687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.414 [2024-10-07 13:35:08.586121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.414 [2024-10-07 13:35:08.588456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.588510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.415 [2024-10-07 13:35:08.588547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.589372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.589708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.589733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.589748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.589995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.590023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.590277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.590305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.415 [2024-10-07 13:35:08.590321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.590988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.591269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.591292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.591306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.591532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.597023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.597291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.597321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.415 [2024-10-07 13:35:08.597337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.597562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.599813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.599838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.599867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.600094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.600328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.602286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.602330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.415 [2024-10-07 13:35:08.602347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.603354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.603801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.603830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.603859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.604083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.607118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.607354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.607382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.415 [2024-10-07 13:35:08.607399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.607423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.607446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.607461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.607499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.607526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.610962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.611181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.611209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.415 [2024-10-07 13:35:08.611226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.611250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.611273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.611288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.611300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.611324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.617916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.618192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.618221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.415 [2024-10-07 13:35:08.618238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.618262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.618300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.618318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.618331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.618356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.621060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.621280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.621309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.415 [2024-10-07 13:35:08.621326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.621350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.621372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.621387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.415 [2024-10-07 13:35:08.621400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.415 [2024-10-07 13:35:08.621424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.415 [2024-10-07 13:35:08.631781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.631812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.415 [2024-10-07 13:35:08.632068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.632097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.415 [2024-10-07 13:35:08.632113] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.632297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.415 [2024-10-07 13:35:08.632323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.415 [2024-10-07 13:35:08.632338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.415 [2024-10-07 13:35:08.632363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.632384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.415 [2024-10-07 13:35:08.632404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.415 [2024-10-07 13:35:08.632418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.632431] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.632448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.632461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.632474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.632522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.632541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.647838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.647871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.648516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.648560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.416 [2024-10-07 13:35:08.648583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.648802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.648828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.416 [2024-10-07 13:35:08.648844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.649236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.649278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.649511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.649535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.649549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.649567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.649582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.649594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.649813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.649836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.658239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.658270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.658581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.658613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.416 [2024-10-07 13:35:08.658631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.658806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.658833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.416 [2024-10-07 13:35:08.658848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.658958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.658984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.659105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.659128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.659142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.659159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.659177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.659191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.659309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.659332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.668622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.668660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.668946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.668974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.416 [2024-10-07 13:35:08.668990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.669212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.669238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.416 [2024-10-07 13:35:08.669254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.669278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.669299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.669319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.669333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.669347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.669364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.669379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.669391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.669415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.669431] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.678755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.678820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.679066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.679094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.416 [2024-10-07 13:35:08.679111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.679458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.679509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.416 [2024-10-07 13:35:08.679529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.679548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.679755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.679796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.679826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.679839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.679889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.679910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.416 [2024-10-07 13:35:08.679923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.416 [2024-10-07 13:35:08.679936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.416 [2024-10-07 13:35:08.680111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.416 [2024-10-07 13:35:08.693885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.693919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.416 [2024-10-07 13:35:08.694117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.694145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.416 [2024-10-07 13:35:08.694162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.694362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.416 [2024-10-07 13:35:08.694388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.416 [2024-10-07 13:35:08.694403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.416 [2024-10-07 13:35:08.694427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.416 [2024-10-07 13:35:08.694448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.694484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.694510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.694523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.694540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.694555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.694568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.694592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.694609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.704414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.704446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.708735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.708783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.417 [2024-10-07 13:35:08.708800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.708974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.708999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.417 [2024-10-07 13:35:08.709014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.709089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.709115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.709137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.709151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.709164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.709191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.709206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.709218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.709242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.709258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.714808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.714839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.715179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.715208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.417 [2024-10-07 13:35:08.715224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.715383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.715408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.417 [2024-10-07 13:35:08.715424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.716414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.716457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.716703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.716728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.716742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.716760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.716774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.716787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.716943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.716971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.725378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.725810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.726034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.726062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.417 [2024-10-07 13:35:08.726079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.726517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.726546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.417 [2024-10-07 13:35:08.726563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.726582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.726635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.726657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.726670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.726683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.726709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.726727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.726740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.726752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.726774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.738087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.738119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.738521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.738553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.417 [2024-10-07 13:35:08.738570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.738744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.738771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.417 [2024-10-07 13:35:08.738802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.739003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.739031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.739225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.739253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.739268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.739285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.417 [2024-10-07 13:35:08.739299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.417 [2024-10-07 13:35:08.739312] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.417 [2024-10-07 13:35:08.739361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.739381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.417 [2024-10-07 13:35:08.753205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.753250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.417 [2024-10-07 13:35:08.753547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.753578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.417 [2024-10-07 13:35:08.753596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.753750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.417 [2024-10-07 13:35:08.753777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.417 [2024-10-07 13:35:08.753806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.417 [2024-10-07 13:35:08.753831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.417 [2024-10-07 13:35:08.753851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.753872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.753898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.753911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.753927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.753941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.753953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.753978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.753995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 8543.00 IOPS, 33.37 MiB/s [2024-10-07T11:35:19.351Z] [2024-10-07 13:35:08.763762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.763808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.764108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.764138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.418 [2024-10-07 13:35:08.764155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.764353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.764392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.418 [2024-10-07 13:35:08.764408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.764546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.764574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.764683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.764704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.764718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.764736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.764751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.764764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.764894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.764914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.774730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.774764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.775086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.775118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.418 [2024-10-07 13:35:08.775135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.775284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.775311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.418 [2024-10-07 13:35:08.775337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.775450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.775477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.775604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.775626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.775640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.775657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.775672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.775692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.775809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.775830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.784853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.784903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.785116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.785146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.418 [2024-10-07 13:35:08.785164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.785335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.785374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.418 [2024-10-07 13:35:08.785390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.785408] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.785434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.785453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.785467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.785479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.785516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.785536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.785549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.785561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.785583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.797670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.797704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.798076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.798107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.418 [2024-10-07 13:35:08.798124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.798214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.798240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.418 [2024-10-07 13:35:08.798255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.798452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.798507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.418 [2024-10-07 13:35:08.798710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.798744] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.798764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.798797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.418 [2024-10-07 13:35:08.798812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.418 [2024-10-07 13:35:08.798824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.418 [2024-10-07 13:35:08.798875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.798894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.418 [2024-10-07 13:35:08.812673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.812721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.418 [2024-10-07 13:35:08.813161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.813206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.418 [2024-10-07 13:35:08.813223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.813395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.418 [2024-10-07 13:35:08.813421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.418 [2024-10-07 13:35:08.813436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.418 [2024-10-07 13:35:08.813801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.813845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.814052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.814075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.814089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.814105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.814119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.814132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.814182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.814202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.828022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.828053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.828262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.828292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.419 [2024-10-07 13:35:08.828308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.828521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.828550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.419 [2024-10-07 13:35:08.828571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.828597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.828618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.828639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.828654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.828667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.828685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.828704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.828717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.828741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.828758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.840969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.841012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.841280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.841310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.419 [2024-10-07 13:35:08.841327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.841453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.841502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.419 [2024-10-07 13:35:08.841520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.841634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.841660] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.841769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.841806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.841821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.841837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.841851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.841863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.842101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.842126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.851312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.851348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.851502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.851532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.419 [2024-10-07 13:35:08.851549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.851684] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.851711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.419 [2024-10-07 13:35:08.851728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.851753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.851789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.851810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.851825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.851837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.851855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.851869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.851881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.851905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.851921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.861440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.861683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.861874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.861903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.419 [2024-10-07 13:35:08.861919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.862259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.862302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.419 [2024-10-07 13:35:08.862319] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.862351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.862402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.419 [2024-10-07 13:35:08.862422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.862435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.862448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.862504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.862525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.419 [2024-10-07 13:35:08.862538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.419 [2024-10-07 13:35:08.862550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.419 [2024-10-07 13:35:08.862574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.419 [2024-10-07 13:35:08.874767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.874817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.419 [2024-10-07 13:35:08.875155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.875185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.419 [2024-10-07 13:35:08.875202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.419 [2024-10-07 13:35:08.875328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.419 [2024-10-07 13:35:08.875353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.419 [2024-10-07 13:35:08.875368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.875633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.875663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.875880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.875904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.875918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.875935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.875949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.875961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.876160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.876183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.889606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.889654] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.889938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.889968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.420 [2024-10-07 13:35:08.889985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.890146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.890171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.420 [2024-10-07 13:35:08.890187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.890216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.890237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.890272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.890290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.890304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.890321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.890335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.890347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.890370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.890386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.903325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.903372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.903759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.903805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.420 [2024-10-07 13:35:08.903822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.903960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.903986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.420 [2024-10-07 13:35:08.904001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.904198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.904226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.904446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.904494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.904521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.904542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.904556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.904570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.904622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.904642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.917838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.917869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.918053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.918081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.420 [2024-10-07 13:35:08.918098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.918231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.918256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.420 [2024-10-07 13:35:08.918272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.918297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.918317] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.918337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.918352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.918364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.918381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.420 [2024-10-07 13:35:08.918395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.420 [2024-10-07 13:35:08.918407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.420 [2024-10-07 13:35:08.918430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.918446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.420 [2024-10-07 13:35:08.928241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.928287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.420 [2024-10-07 13:35:08.928515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.928546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.420 [2024-10-07 13:35:08.928564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.928693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.420 [2024-10-07 13:35:08.928719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.420 [2024-10-07 13:35:08.928735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.420 [2024-10-07 13:35:08.932120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.932149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.420 [2024-10-07 13:35:08.933010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.933052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.933067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.933084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.933103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.933117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.933215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.933235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.939293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.939323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.939534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.939564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.421 [2024-10-07 13:35:08.939581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.939692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.939719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.421 [2024-10-07 13:35:08.939735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.939760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.939781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.939818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.939833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.939845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.939861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.939875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.939888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.939911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.939927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.949419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.949481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.949662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.949690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.421 [2024-10-07 13:35:08.949707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.950036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.950064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.421 [2024-10-07 13:35:08.950081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.950099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.950169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.950191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.950204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.950216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.950240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.950257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.950269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.950282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.950304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.963521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.963570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.963705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.963735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.421 [2024-10-07 13:35:08.963752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.963894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.963920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.421 [2024-10-07 13:35:08.963936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.963960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.963981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.964001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.964016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.964029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.964046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.964060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.964073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.964096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.964113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.978850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.978882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.979316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.979346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.421 [2024-10-07 13:35:08.979382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.979535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.979562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.421 [2024-10-07 13:35:08.979578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.979836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.979872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.980070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.980092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.980106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.980123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.980137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.980150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.980199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.980219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.421 [2024-10-07 13:35:08.989240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.989287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.421 [2024-10-07 13:35:08.989556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.989589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.421 [2024-10-07 13:35:08.989606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.989704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.421 [2024-10-07 13:35:08.989730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.421 [2024-10-07 13:35:08.989746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.421 [2024-10-07 13:35:08.992685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.992732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.421 [2024-10-07 13:35:08.993645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.993670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.993699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.993717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.421 [2024-10-07 13:35:08.993732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.421 [2024-10-07 13:35:08.993764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.421 [2024-10-07 13:35:08.994171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:08.994195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:08.999368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:08.999429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:08.999613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:08.999642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.422 [2024-10-07 13:35:08.999659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:08.999777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:08.999818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.422 [2024-10-07 13:35:08.999834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:08.999852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:08.999876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:08.999893] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:08.999905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:08.999918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:08.999942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:08.999958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:08.999970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:08.999982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.000003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.009480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.009652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.009682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.422 [2024-10-07 13:35:09.009699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.009909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.009970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.010003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.010020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.010033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.010057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.010193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.010219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.422 [2024-10-07 13:35:09.010235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.010412] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.010482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.010514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.010529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.010555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.023905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.023952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.024121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.024151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.422 [2024-10-07 13:35:09.024168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.024297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.024322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.422 [2024-10-07 13:35:09.024338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.024363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.024383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.024404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.024420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.024433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.024450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.024465] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.024478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.024516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.024534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.034916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.034950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.039395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.039427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.422 [2024-10-07 13:35:09.039445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.039552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.039577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.422 [2024-10-07 13:35:09.039593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.039671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.039698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.039720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.039735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.039748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.039766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.039781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.039794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.039827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.039843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.045480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.045520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.045727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.045757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.422 [2024-10-07 13:35:09.045774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.045950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.045975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.422 [2024-10-07 13:35:09.045991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.046015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.046035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.422 [2024-10-07 13:35:09.046055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.046070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.046083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.046099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.422 [2024-10-07 13:35:09.046113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.422 [2024-10-07 13:35:09.046126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.422 [2024-10-07 13:35:09.047090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.047115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.422 [2024-10-07 13:35:09.055606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.055656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.422 [2024-10-07 13:35:09.055836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.422 [2024-10-07 13:35:09.055864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.422 [2024-10-07 13:35:09.055881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.422 [2024-10-07 13:35:09.056177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.056205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.423 [2024-10-07 13:35:09.056221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.056239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.056290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.056311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.056324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.056336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.056544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.056570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.056584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.056598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.056648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.068597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.068628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.068811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.068838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.423 [2024-10-07 13:35:09.068855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.069002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.069027] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.423 [2024-10-07 13:35:09.069042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.069067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.069087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.069108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.069127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.069140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.069157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.069171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.069184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.069207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.069223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.081437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.081483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.082636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.082682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.423 [2024-10-07 13:35:09.082700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.082828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.082855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.423 [2024-10-07 13:35:09.082870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.084311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.084354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.085076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.085100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.085128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.085145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.085160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.085172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.085562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.085587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.091574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.091621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.091762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.091805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.423 [2024-10-07 13:35:09.091822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.094144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.094188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.423 [2024-10-07 13:35:09.094206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.094224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.098227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.098269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.098283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.098297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.099016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.099041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.099071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.099085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.099509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.101660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.101869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.101897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.423 [2024-10-07 13:35:09.101914] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.101950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.101982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.102009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.102025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.102037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.102060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.102187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.102213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.423 [2024-10-07 13:35:09.102229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.102253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.102291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.102309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.102322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.102346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.423 [2024-10-07 13:35:09.114224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.114271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.423 [2024-10-07 13:35:09.114484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.114521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.423 [2024-10-07 13:35:09.114538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.114694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.423 [2024-10-07 13:35:09.114721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.423 [2024-10-07 13:35:09.114737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.423 [2024-10-07 13:35:09.114946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.114974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.423 [2024-10-07 13:35:09.115162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.423 [2024-10-07 13:35:09.115186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.423 [2024-10-07 13:35:09.115200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.423 [2024-10-07 13:35:09.115217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.115232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.115244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.115287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.115307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.128004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.128036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.128441] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.128494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.424 [2024-10-07 13:35:09.128512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.128612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.128637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.424 [2024-10-07 13:35:09.128653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.128933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.128961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.129155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.129178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.129197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.129215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.129230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.129242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.129291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.129311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.141702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.141734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.142126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.142170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.424 [2024-10-07 13:35:09.142186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.142320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.142345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.424 [2024-10-07 13:35:09.142360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.142586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.142616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.142870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.142894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.142907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.142924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.142939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.142951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.143004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.143024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.153208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.153253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.153513] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.153545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.424 [2024-10-07 13:35:09.153562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.153655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.153680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.424 [2024-10-07 13:35:09.153702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.153843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.153870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.156644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.156669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.156699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.156717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.156732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.156745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.157577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.157601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.163333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.163394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.163561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.163591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.424 [2024-10-07 13:35:09.163608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.163735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.163762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.424 [2024-10-07 13:35:09.163778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.163796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.163851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.163871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.163884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.163896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.163920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.163937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.163949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.163961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.163983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.424 [2024-10-07 13:35:09.173430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.173640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.424 [2024-10-07 13:35:09.173670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.424 [2024-10-07 13:35:09.173687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.424 [2024-10-07 13:35:09.173723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.424 [2024-10-07 13:35:09.173783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.424 [2024-10-07 13:35:09.173814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.424 [2024-10-07 13:35:09.173829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.424 [2024-10-07 13:35:09.173842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.424 [2024-10-07 13:35:09.173865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.174014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.174040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.425 [2024-10-07 13:35:09.174056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.174080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.174102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.174117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.174130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.174153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.186067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.186113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.186429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.186459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.425 [2024-10-07 13:35:09.186501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.186595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.186621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.425 [2024-10-07 13:35:09.186637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.186687] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.186712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.186733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.186749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.186762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.186799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.186815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.186828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.186852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.186868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.197345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.197392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.197626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.197656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.425 [2024-10-07 13:35:09.197673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.197834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.197858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.425 [2024-10-07 13:35:09.197873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.197984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.198010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.200155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.200180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.200209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.200226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.200241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.200253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.201088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.201112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.207470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.207652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.207772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.207815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.425 [2024-10-07 13:35:09.207832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.208030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.208057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.425 [2024-10-07 13:35:09.208073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.208096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.208214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.208237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.208250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.208263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.208371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.208393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.208406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.208418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.208555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.217575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.217788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.217817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.425 [2024-10-07 13:35:09.217833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.217857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.217894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.217913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.217926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.217951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.217970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.218105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.218132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.425 [2024-10-07 13:35:09.218148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.218171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.218194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.218209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.218221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.218245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.229873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.229905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.425 [2024-10-07 13:35:09.230121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.230150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.425 [2024-10-07 13:35:09.230167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.230297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.425 [2024-10-07 13:35:09.230322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.425 [2024-10-07 13:35:09.230337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.425 [2024-10-07 13:35:09.230361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.230382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.425 [2024-10-07 13:35:09.230403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.230417] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.230430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.230447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.425 [2024-10-07 13:35:09.230461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.425 [2024-10-07 13:35:09.230500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.425 [2024-10-07 13:35:09.230528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.425 [2024-10-07 13:35:09.230545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.242090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.242121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.243900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.243945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.426 [2024-10-07 13:35:09.243963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.244052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.244076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.426 [2024-10-07 13:35:09.244091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.244775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.244820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.245065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.245089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.245103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.245120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.245140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.245154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.245352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.245375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.252953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.252999] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.253259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.253289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.426 [2024-10-07 13:35:09.253306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.253446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.253495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.426 [2024-10-07 13:35:09.253514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.253625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.253652] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.253774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.253797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.253826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.253843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.253857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.253869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.253979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.254001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.263349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.263379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.263570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.263601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.426 [2024-10-07 13:35:09.263618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.263715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.263741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.426 [2024-10-07 13:35:09.263758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.263797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.263824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.263846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.263861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.263873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.263890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.263903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.263915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.263939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.263955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.273610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.273642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.274094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.274123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.426 [2024-10-07 13:35:09.274155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.274256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.274282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.426 [2024-10-07 13:35:09.274298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.274512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.274541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.274605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.274628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.274643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.274660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.274675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.274688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.275141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.275166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.289103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.289149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.289647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.289687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.426 [2024-10-07 13:35:09.289705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.289865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.289892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.426 [2024-10-07 13:35:09.289907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.290406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.290435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.426 [2024-10-07 13:35:09.290712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.290737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.290751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.290769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.426 [2024-10-07 13:35:09.290784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.426 [2024-10-07 13:35:09.290797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.426 [2024-10-07 13:35:09.291010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.291033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.426 [2024-10-07 13:35:09.299817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.299864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.426 [2024-10-07 13:35:09.300138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.300167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.426 [2024-10-07 13:35:09.300182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.426 [2024-10-07 13:35:09.300302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.426 [2024-10-07 13:35:09.300327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.427 [2024-10-07 13:35:09.300342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.300481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.300523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.300644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.300666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.300680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.300698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.300712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.300731] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.300857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.300880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.309943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.310005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.310116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.310144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.427 [2024-10-07 13:35:09.310160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.310503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.310549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.427 [2024-10-07 13:35:09.310566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.310584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.310736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.310760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.310790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.310804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.310927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.310950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.310963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.310976] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.311084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.320041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.320365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.320396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.427 [2024-10-07 13:35:09.320413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.320503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.320538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.320568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.320584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.320598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.320833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.320973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.321001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.427 [2024-10-07 13:35:09.321017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.321234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.321290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.321311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.321324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.321348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.330320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.333683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.333728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.427 [2024-10-07 13:35:09.333747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.334702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.335145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.335202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.335219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.335233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.335504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.335620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.335648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.427 [2024-10-07 13:35:09.335665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.335886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.336097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.336124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.336138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.336188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.340418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.340660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.340689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.427 [2024-10-07 13:35:09.340706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.340736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.340761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.340776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.340789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.340813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.349989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.350189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.350218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.427 [2024-10-07 13:35:09.350235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.350259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.350283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.350297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.350310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.350334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.350531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.350668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.350695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.427 [2024-10-07 13:35:09.350711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.350736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.350760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.427 [2024-10-07 13:35:09.350774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.427 [2024-10-07 13:35:09.350788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.427 [2024-10-07 13:35:09.350827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.427 [2024-10-07 13:35:09.360088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.427 [2024-10-07 13:35:09.360301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.427 [2024-10-07 13:35:09.360330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.427 [2024-10-07 13:35:09.360346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.427 [2024-10-07 13:35:09.362874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.427 [2024-10-07 13:35:09.365706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.365733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.365768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.366652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.366682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.367315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.367357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.428 [2024-10-07 13:35:09.367374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.367453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.367481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.367532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.367547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.367810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.370195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.370372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.370399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.428 [2024-10-07 13:35:09.370415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.370439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.370463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.370514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.370529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.370554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.382923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.383203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.383352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.383380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.428 [2024-10-07 13:35:09.383397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.383799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.383828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.428 [2024-10-07 13:35:09.383844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.383877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.384077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.384103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.384130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.384143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.384360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.384385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.384399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.384412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.384463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.398066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.398099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.398446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.398498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.428 [2024-10-07 13:35:09.398518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.398613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.398639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.428 [2024-10-07 13:35:09.398654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.398995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.399023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.399080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.399099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.399112] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.399129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.399143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.399155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.399325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.399347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.412333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.412364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.412539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.412568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.428 [2024-10-07 13:35:09.412585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.412713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.412739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.428 [2024-10-07 13:35:09.412756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.412795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.412815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.412836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.412851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.412864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.412881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.412895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.412907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.412930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.412946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.428 [2024-10-07 13:35:09.427547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.427582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.428 [2024-10-07 13:35:09.428643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.428685] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.428 [2024-10-07 13:35:09.428702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.428833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.428 [2024-10-07 13:35:09.428858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.428 [2024-10-07 13:35:09.428873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.428 [2024-10-07 13:35:09.429406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.429434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.428 [2024-10-07 13:35:09.429546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.428 [2024-10-07 13:35:09.429567] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.428 [2024-10-07 13:35:09.429581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.428 [2024-10-07 13:35:09.429599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.429614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.429627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.429651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.429668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.442925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.442956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.443152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.443181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.429 [2024-10-07 13:35:09.443197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.443314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.443339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.429 [2024-10-07 13:35:09.443354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.443378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.443399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.443429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.443443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.443456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.443498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.443516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.443530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.443556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.443573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.456744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.456777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.457031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.457059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.429 [2024-10-07 13:35:09.457076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.457189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.457215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.429 [2024-10-07 13:35:09.457231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.457256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.457276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.457297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.457311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.457330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.457348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.457362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.457374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.457398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.457414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.470452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.470513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.472693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.472725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.429 [2024-10-07 13:35:09.472743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.472884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.472920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.429 [2024-10-07 13:35:09.472935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.473607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.473644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.474048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.474075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.474088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.474105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.474120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.474133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.474195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.474215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.482573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.482606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.483019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.483049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.429 [2024-10-07 13:35:09.483073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.483168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.483193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.429 [2024-10-07 13:35:09.483213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.487065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.487102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.487922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.487947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.487962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.487980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.487994] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.488006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.488468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.488520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.492920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.492951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.493208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.493237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.429 [2024-10-07 13:35:09.493253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.493387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.493413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.429 [2024-10-07 13:35:09.493428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.429 [2024-10-07 13:35:09.493452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.493500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.429 [2024-10-07 13:35:09.493525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.493541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.493554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.493570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.429 [2024-10-07 13:35:09.493585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.429 [2024-10-07 13:35:09.493599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.429 [2024-10-07 13:35:09.493623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.493640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.429 [2024-10-07 13:35:09.503077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.503119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.429 [2024-10-07 13:35:09.503322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.429 [2024-10-07 13:35:09.503359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.430 [2024-10-07 13:35:09.503375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.503533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.503561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.430 [2024-10-07 13:35:09.503577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.503770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.503814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.504011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.504034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.504048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.504065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.504080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.504093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.504156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.504177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.518466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.518530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.518868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.518899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.430 [2024-10-07 13:35:09.518916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.519042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.519066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.430 [2024-10-07 13:35:09.519082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.519274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.519302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.519526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.519566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.519581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.519606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.519622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.519636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.519876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.519900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.533597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.533631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.533936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.533968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.430 [2024-10-07 13:35:09.533985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.534107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.534133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.430 [2024-10-07 13:35:09.534150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.534176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.534197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.534234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.534253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.534267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.534285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.534311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.534324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.534348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.534365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.544243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.544284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.544576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.544608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.430 [2024-10-07 13:35:09.544627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.544740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.544768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.430 [2024-10-07 13:35:09.544785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.544904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.544937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.547166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.547192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.547206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.547224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.547238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.547251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.548126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.548151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.554381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.554427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.554611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.554641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.430 [2024-10-07 13:35:09.554657] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.554755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.554782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.430 [2024-10-07 13:35:09.554798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.554832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.554857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.554875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.554895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.554908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.554931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.554948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.430 [2024-10-07 13:35:09.554960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.430 [2024-10-07 13:35:09.554973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.430 [2024-10-07 13:35:09.555001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.430 [2024-10-07 13:35:09.564914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.564945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.430 [2024-10-07 13:35:09.565294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.565324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.430 [2024-10-07 13:35:09.565341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.565425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.430 [2024-10-07 13:35:09.565451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.430 [2024-10-07 13:35:09.565467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.430 [2024-10-07 13:35:09.565700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.430 [2024-10-07 13:35:09.565730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.565777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.565803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.565832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.565849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.565863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.565876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.565900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.565916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.576316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.576350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.576813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.576843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.431 [2024-10-07 13:35:09.576865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.576968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.576992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.431 [2024-10-07 13:35:09.577008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.577203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.577238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.577748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.577790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.577805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.577822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.577843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.577856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.578072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.578094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.592304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.592341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.592768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.592813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.431 [2024-10-07 13:35:09.592830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.592949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.592975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.431 [2024-10-07 13:35:09.592991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.593335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.593368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.593597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.593622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.593636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.593654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.593676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.593689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.593739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.593760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.607350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.607383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.608024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.608054] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.431 [2024-10-07 13:35:09.608070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.608220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.608246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.431 [2024-10-07 13:35:09.608261] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.608502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.608553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.608749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.608787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.608802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.608819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.608834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.608846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.609037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.609060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.622551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.622584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.622734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.622762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.431 [2024-10-07 13:35:09.622794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.622888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.622914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.431 [2024-10-07 13:35:09.622930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.622954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.622975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.622995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.623018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.623032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.623048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.623062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.623075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.623098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.623115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.431 [2024-10-07 13:35:09.633143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.633183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.431 [2024-10-07 13:35:09.637505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.637543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.431 [2024-10-07 13:35:09.637561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.637682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.431 [2024-10-07 13:35:09.637707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.431 [2024-10-07 13:35:09.637723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.431 [2024-10-07 13:35:09.637823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.637851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.431 [2024-10-07 13:35:09.637873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.637888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.637901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.431 [2024-10-07 13:35:09.637928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.431 [2024-10-07 13:35:09.637942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.431 [2024-10-07 13:35:09.637955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.637984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.638000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.643410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.643441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.643670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.643701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.432 [2024-10-07 13:35:09.643718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.643877] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.643903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.432 [2024-10-07 13:35:09.643918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.643954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.643974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.643995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.644009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.644023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.644039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.644058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.644075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.645080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.645105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.653647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.653680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.653910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.653938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.432 [2024-10-07 13:35:09.653955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.654045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.654070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.432 [2024-10-07 13:35:09.654085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.654257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.654285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.654510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.654534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.654549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.654566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.654580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.654594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.654644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.654664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.666827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.666860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.667260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.667290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.432 [2024-10-07 13:35:09.667307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.667429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.667455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.432 [2024-10-07 13:35:09.667494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.667548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.667575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.667859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.667894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.667908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.667925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.667939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.667952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.668024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.668045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.677995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.678028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.678221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.678250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.432 [2024-10-07 13:35:09.678267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.678378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.678404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.432 [2024-10-07 13:35:09.678419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.681244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.681276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.682228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.682270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.682293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.682311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.682326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.682340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.682917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.682943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.688105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.688150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.688325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.688354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.432 [2024-10-07 13:35:09.688375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.688516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.688544] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.432 [2024-10-07 13:35:09.688560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.432 [2024-10-07 13:35:09.688579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.688605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.432 [2024-10-07 13:35:09.688623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.688636] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.688649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.688673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.688691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.432 [2024-10-07 13:35:09.688704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.432 [2024-10-07 13:35:09.688717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.432 [2024-10-07 13:35:09.688739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.432 [2024-10-07 13:35:09.698459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.698524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.432 [2024-10-07 13:35:09.698735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.432 [2024-10-07 13:35:09.698764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.433 [2024-10-07 13:35:09.698781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.699006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.699031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.433 [2024-10-07 13:35:09.699058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.699082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.699102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.699127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.699142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.699155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.699172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.699186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.699199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.699228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.699249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.710938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.710974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.711337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.711366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.433 [2024-10-07 13:35:09.711384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.711495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.711524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.433 [2024-10-07 13:35:09.711540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.711918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.711947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.712158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.712181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.712195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.712212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.712226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.712239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.712288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.712307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.725682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.725715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.725925] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.725953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.433 [2024-10-07 13:35:09.725970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.726051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.726075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.433 [2024-10-07 13:35:09.726090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.726547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.726576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.726807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.726846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.726861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.726878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.726893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.726905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.727096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.727120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.740264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.740296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.740446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.740498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.433 [2024-10-07 13:35:09.740518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.740688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.740716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.433 [2024-10-07 13:35:09.740733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.740758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.740797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.433 [2024-10-07 13:35:09.740819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.740834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.740867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.740884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.433 [2024-10-07 13:35:09.740898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.433 [2024-10-07 13:35:09.740911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.433 [2024-10-07 13:35:09.740944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.740960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.433 [2024-10-07 13:35:09.756023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.756056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.433 [2024-10-07 13:35:09.756305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.756335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.433 [2024-10-07 13:35:09.756352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.756549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.433 [2024-10-07 13:35:09.756577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.433 [2024-10-07 13:35:09.756593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.433 [2024-10-07 13:35:09.757044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.757072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.757294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.757316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.757330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.757347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.757361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.757374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.757422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.757441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 8558.57 IOPS, 33.43 MiB/s [2024-10-07T11:35:19.367Z] [2024-10-07 13:35:09.771081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.771113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.771358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.771387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.434 [2024-10-07 13:35:09.771403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.771552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.771580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.434 [2024-10-07 13:35:09.771597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.771789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.771818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.772014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.772037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.772051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.772068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.772082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.772095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.772162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.772188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.787468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.787524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.787905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.787936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.434 [2024-10-07 13:35:09.787954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.788125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.788151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.434 [2024-10-07 13:35:09.788168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.788372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.788402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.788640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.788666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.788682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.788700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.788715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.788729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.788785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.788806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.802748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.802797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.802959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.802989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.434 [2024-10-07 13:35:09.803006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.803092] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.803118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.434 [2024-10-07 13:35:09.803134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.803158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.803179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.803199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.803219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.803244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.803260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.803275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.803287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.803311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.803332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.813255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.813288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.816080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.816112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.434 [2024-10-07 13:35:09.816130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.816306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.816332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.434 [2024-10-07 13:35:09.816347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.817911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.817942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.817999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.818018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.818031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.818049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.818064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.818078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.818101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.818117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.434 [2024-10-07 13:35:09.823367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.823414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.434 [2024-10-07 13:35:09.823590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.823618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.434 [2024-10-07 13:35:09.823636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.823773] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.434 [2024-10-07 13:35:09.823819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.434 [2024-10-07 13:35:09.823836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.434 [2024-10-07 13:35:09.823854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.823894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.434 [2024-10-07 13:35:09.823914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.434 [2024-10-07 13:35:09.823927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.434 [2024-10-07 13:35:09.823940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.434 [2024-10-07 13:35:09.823965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.823983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.823997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.824009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.824047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.833452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.833676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.833707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.435 [2024-10-07 13:35:09.833724] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.833927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.833990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.834023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.834039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.834052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.834075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.834303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.834328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.435 [2024-10-07 13:35:09.834344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.834544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.834607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.834627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.834641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.834666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.846954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.846988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.847210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.847238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.435 [2024-10-07 13:35:09.847254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.847373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.847410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.435 [2024-10-07 13:35:09.847426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.847450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.847500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.847525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.847540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.847553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.847571] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.847586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.847599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.847623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.847640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.860721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.860764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.861039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.861068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.435 [2024-10-07 13:35:09.861085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.861216] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.861242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.435 [2024-10-07 13:35:09.861258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.861283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.861304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.861324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.861339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.861358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.861375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.861391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.861403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.861426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.861443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.871856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.871889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.872181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.872212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.435 [2024-10-07 13:35:09.872230] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.872413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.872439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.435 [2024-10-07 13:35:09.872454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.874267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.874298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.874382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.874402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.874417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.874434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.874448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.874476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.874511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.874529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.881966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.882013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.435 [2024-10-07 13:35:09.882211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.882238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.435 [2024-10-07 13:35:09.882254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.884422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.435 [2024-10-07 13:35:09.884453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.435 [2024-10-07 13:35:09.884500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.435 [2024-10-07 13:35:09.884523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.888127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.435 [2024-10-07 13:35:09.888157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.888172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.888185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.435 [2024-10-07 13:35:09.889334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.435 [2024-10-07 13:35:09.889361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.435 [2024-10-07 13:35:09.889375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.435 [2024-10-07 13:35:09.889388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.890075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.892167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.892196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.892439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.892481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.436 [2024-10-07 13:35:09.892507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.892737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.892765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.436 [2024-10-07 13:35:09.892797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.892823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.892844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.892892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.892907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.892920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.892937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.892951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.892963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.892987] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.893003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.904329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.904368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.904906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.904954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.436 [2024-10-07 13:35:09.904973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.905110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.905136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.436 [2024-10-07 13:35:09.905154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.905389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.905417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.905643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.905667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.905682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.905699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.905715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.905728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.905778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.905814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.914448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.914521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.914708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.914737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.436 [2024-10-07 13:35:09.914755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.917416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.917446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.436 [2024-10-07 13:35:09.917478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.917506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.920832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.920861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.920876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.920889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.921390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.921426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.921441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.921455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.921744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.924536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.924732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.924761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.436 [2024-10-07 13:35:09.924778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.924830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.924860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.924888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.924905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.924918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.924940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.925160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.925186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.436 [2024-10-07 13:35:09.925201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.925226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.925249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.925264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.925277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.925300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.936324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.936358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.436 [2024-10-07 13:35:09.936521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.936552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.436 [2024-10-07 13:35:09.936569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.936657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.436 [2024-10-07 13:35:09.936683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.436 [2024-10-07 13:35:09.936699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.436 [2024-10-07 13:35:09.936729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.936751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.436 [2024-10-07 13:35:09.936772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.936801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.936815] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.936832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.436 [2024-10-07 13:35:09.936846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.436 [2024-10-07 13:35:09.936860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.436 [2024-10-07 13:35:09.936883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.436 [2024-10-07 13:35:09.936899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.947005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.947038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.951149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.951182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.437 [2024-10-07 13:35:09.951199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.951391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.951416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.437 [2024-10-07 13:35:09.951432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.952197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.952229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.952319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.952339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.952353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.952370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.952385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.952398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.952422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.952438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.957761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.957807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.958079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.958113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.437 [2024-10-07 13:35:09.958131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.958263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.958301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.437 [2024-10-07 13:35:09.958317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.958341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.958362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.958382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.958397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.958410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.958426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.958441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.958454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.958477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.958531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.967886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.967934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.968178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.968206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.437 [2024-10-07 13:35:09.968223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.968387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.968413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.437 [2024-10-07 13:35:09.968429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.968447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.968473] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.968515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.968531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.968545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.968570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.968588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.968606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.968620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.968655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.979846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.979879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.980228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.980260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.437 [2024-10-07 13:35:09.980277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.980411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.980437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.437 [2024-10-07 13:35:09.980453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.980676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.980705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.980753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.980772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.980786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.980819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.980834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.437 [2024-10-07 13:35:09.980846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.437 [2024-10-07 13:35:09.981018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.981040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.437 [2024-10-07 13:35:09.994147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.994180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.437 [2024-10-07 13:35:09.994336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.994365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.437 [2024-10-07 13:35:09.994382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.994509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.437 [2024-10-07 13:35:09.994535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.437 [2024-10-07 13:35:09.994552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.437 [2024-10-07 13:35:09.994577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.994604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.437 [2024-10-07 13:35:09.994626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.437 [2024-10-07 13:35:09.994641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:09.994654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:09.994671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:09.994686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:09.994700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:09.994724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:09.994741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.004260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.004314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.004565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.004595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.438 [2024-10-07 13:35:10.004613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.004727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.004756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.438 [2024-10-07 13:35:10.004773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.004793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.004820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.004839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.004853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.004867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.004892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.004911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.004925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.004940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.007415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.014664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.014699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.014897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.014927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.438 [2024-10-07 13:35:10.014951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.015093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.015121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.438 [2024-10-07 13:35:10.015152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.015180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.015203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.015225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.015241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.015255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.015273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.015289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.015303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.015328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.015346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.028126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.028173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.028361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.028392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.438 [2024-10-07 13:35:10.028411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.028560] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.028589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.438 [2024-10-07 13:35:10.028623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.028668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.028696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.028846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.028873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.028891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.028910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.028928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.028944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.029139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.029170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.038461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.038519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.038824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.038870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.438 [2024-10-07 13:35:10.038889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.039002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.039045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.438 [2024-10-07 13:35:10.039073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.043107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.043143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.044156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.044183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.044197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.044230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.044249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.044264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.438 [2024-10-07 13:35:10.044723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.044764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.438 [2024-10-07 13:35:10.048603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.048652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.438 [2024-10-07 13:35:10.048810] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.048841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.438 [2024-10-07 13:35:10.048859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.048980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.438 [2024-10-07 13:35:10.049008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.438 [2024-10-07 13:35:10.049038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.438 [2024-10-07 13:35:10.049072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.049098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.438 [2024-10-07 13:35:10.049122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.438 [2024-10-07 13:35:10.049137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.438 [2024-10-07 13:35:10.049150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.049180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.049200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.049217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.049231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.049255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.060889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.060926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.061111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.061140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.439 [2024-10-07 13:35:10.061166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.061270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.061306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.439 [2024-10-07 13:35:10.061323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.061349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.061387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.061409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.061424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.061438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.061455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.061497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.061514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.061541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.061559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.071795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.071846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.074797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.074829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.439 [2024-10-07 13:35:10.074847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.074980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.075005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.439 [2024-10-07 13:35:10.075021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.076552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.076585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.076644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.076665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.076679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.076698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.076713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.076727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.076753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.076784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.081927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.081973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.082134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.082162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.439 [2024-10-07 13:35:10.082179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.082313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.082340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.439 [2024-10-07 13:35:10.082356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.082374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.082399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.082416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.082430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.082443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.083145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.083171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.083185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.083198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.083653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.092134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.092166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.092292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.092319] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.439 [2024-10-07 13:35:10.092335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.092469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.092515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.439 [2024-10-07 13:35:10.092534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.092713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.092741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.092789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.092822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.092835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.092853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.092867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.092879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.093071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.093094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.105282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.105313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.105482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.105520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.439 [2024-10-07 13:35:10.105537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.105633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.439 [2024-10-07 13:35:10.105658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.439 [2024-10-07 13:35:10.105673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.439 [2024-10-07 13:35:10.105699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.105720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.439 [2024-10-07 13:35:10.105742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.105763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.105792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.105809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.439 [2024-10-07 13:35:10.105827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.439 [2024-10-07 13:35:10.105840] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.439 [2024-10-07 13:35:10.105864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.105880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.439 [2024-10-07 13:35:10.116032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.439 [2024-10-07 13:35:10.116064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.116355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.116386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.440 [2024-10-07 13:35:10.116404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.116600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.116628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.440 [2024-10-07 13:35:10.116645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.116757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.116807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.116919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.116940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.116954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.116971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.116992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.117005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.119872] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.119899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.126307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.126434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.126588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.126618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.440 [2024-10-07 13:35:10.126636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.126850] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.126883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.440 [2024-10-07 13:35:10.126900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.126918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.129889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.129918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.129932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.129945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.130098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.130121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.130135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.130148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.130254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.136519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.136680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.136711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.440 [2024-10-07 13:35:10.136729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.136932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.136995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.137027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.137046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.137059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.137081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.137329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.137355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.440 [2024-10-07 13:35:10.137371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.137837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.137922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.137941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.137954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.138203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.148664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.148696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.148872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.148901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.440 [2024-10-07 13:35:10.148918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.149010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.149037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.440 [2024-10-07 13:35:10.149052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.149077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.149097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.149118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.149132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.149145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.149162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.149176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.149189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.149212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.149228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.163391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.163424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.164409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.164440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.440 [2024-10-07 13:35:10.164457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.164645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.440 [2024-10-07 13:35:10.164672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.440 [2024-10-07 13:35:10.164689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.440 [2024-10-07 13:35:10.164946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.164974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.440 [2024-10-07 13:35:10.165227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.165250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.165270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.165290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.440 [2024-10-07 13:35:10.165305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.440 [2024-10-07 13:35:10.165318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.440 [2024-10-07 13:35:10.165551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.165574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.440 [2024-10-07 13:35:10.175448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.175503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.440 [2024-10-07 13:35:10.175840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.175871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.441 [2024-10-07 13:35:10.175888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.175993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.176018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.441 [2024-10-07 13:35:10.176033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.176150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.176175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.179090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.179116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.179131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.179149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.179163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.179175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.180019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.180045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.185587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.185636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.185892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.185919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.441 [2024-10-07 13:35:10.185935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.186063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.186096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.441 [2024-10-07 13:35:10.186116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.186135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.186160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.186178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.186191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.186204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.186227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.186244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.186257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.186270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.186292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.195708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.195757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.196008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.196038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.441 [2024-10-07 13:35:10.196055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.196437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.196467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.441 [2024-10-07 13:35:10.196483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.196529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.196730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.196756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.196771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.196784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.196864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.196887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.196901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.196913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.196937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.210483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.210534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.210724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.210752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.441 [2024-10-07 13:35:10.210768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.210880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.210914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.441 [2024-10-07 13:35:10.210930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.210955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.210976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.210996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.211011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.211024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.211041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.211056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.211068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.211092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.211108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.225524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.225559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.226005] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.226034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.441 [2024-10-07 13:35:10.226051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.226201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.226227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.441 [2024-10-07 13:35:10.226243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.226497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.226531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.226731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.226754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.226782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.226806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.441 [2024-10-07 13:35:10.226821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.441 [2024-10-07 13:35:10.226834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.441 [2024-10-07 13:35:10.226885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.226905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.441 [2024-10-07 13:35:10.239725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.239759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.441 [2024-10-07 13:35:10.240204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.240235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.441 [2024-10-07 13:35:10.240252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.240410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.441 [2024-10-07 13:35:10.240437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.441 [2024-10-07 13:35:10.240453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.441 [2024-10-07 13:35:10.240712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.441 [2024-10-07 13:35:10.240754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.240963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.240986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.241000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.241018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.241033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.241046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.241096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.241116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.254268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.254300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.255025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.255056] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.442 [2024-10-07 13:35:10.255073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.255202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.255227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.442 [2024-10-07 13:35:10.255242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.255622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.255654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.255874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.255899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.255913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.255930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.255945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.255958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.256007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.256026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.264380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.264426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.264678] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.264705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.442 [2024-10-07 13:35:10.264722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.264883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.264909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.442 [2024-10-07 13:35:10.264924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.264942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.267424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.267453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.267468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.267480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.270554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.270583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.270598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.270611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.271115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.274665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.274696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.274949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.274978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.442 [2024-10-07 13:35:10.274995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.275120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.275144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.442 [2024-10-07 13:35:10.275159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.275183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.275204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.275224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.275238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.275251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.275267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.275281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.275294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.275316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.275332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.285790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.285823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.286066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.286096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.442 [2024-10-07 13:35:10.286112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.286282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.286307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.442 [2024-10-07 13:35:10.286323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.286346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.286368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.442 [2024-10-07 13:35:10.286389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.286404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.286417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.286434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.442 [2024-10-07 13:35:10.286449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.442 [2024-10-07 13:35:10.286483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.442 [2024-10-07 13:35:10.286522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.286540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.442 [2024-10-07 13:35:10.301296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.301328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.442 [2024-10-07 13:35:10.302459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.442 [2024-10-07 13:35:10.302515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.442 [2024-10-07 13:35:10.302533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.442 [2024-10-07 13:35:10.302639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.302665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.443 [2024-10-07 13:35:10.302680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.303363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.303396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.303640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.303665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.303681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.303699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.303715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.303727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.304008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.304034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.313794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.313829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.315248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.315280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.443 [2024-10-07 13:35:10.315297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.315497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.315525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.443 [2024-10-07 13:35:10.315545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.317116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.317154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.318296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.318324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.318339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.318357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.318375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.318389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.319087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.319114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.324319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.324352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.324596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.324626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.443 [2024-10-07 13:35:10.324643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.324859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.324884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.443 [2024-10-07 13:35:10.324901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.324926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.324947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.324969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.324984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.324998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.325016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.325030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.325043] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.325068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.325085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.334455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.334511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.334758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.334802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.443 [2024-10-07 13:35:10.334825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.335006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.335032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.443 [2024-10-07 13:35:10.335047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.335219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.335248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.335295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.335314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.335327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.335343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.335358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.335371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.335395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.335411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.346816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.346863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.347099] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.347127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.443 [2024-10-07 13:35:10.347144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.347353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.347378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.443 [2024-10-07 13:35:10.347393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.347418] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.347439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.347459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.347500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.347516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.347534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.347549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.443 [2024-10-07 13:35:10.347568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.443 [2024-10-07 13:35:10.347595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.347611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.443 [2024-10-07 13:35:10.357005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.357036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.443 [2024-10-07 13:35:10.357349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.357378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.443 [2024-10-07 13:35:10.357395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.357523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.443 [2024-10-07 13:35:10.357549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.443 [2024-10-07 13:35:10.357565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.443 [2024-10-07 13:35:10.358046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.358073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.443 [2024-10-07 13:35:10.358095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.443 [2024-10-07 13:35:10.358110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.358123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.358139] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.358153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.358166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.358190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.358206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.367113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.367159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.367368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.367394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.444 [2024-10-07 13:35:10.367410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.367989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.368018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.444 [2024-10-07 13:35:10.368034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.368053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.368946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.368978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.368992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.369005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.369724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.369750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.369765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.369778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.369958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.379896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.379928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.380204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.380231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.444 [2024-10-07 13:35:10.380248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.380457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.380507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.444 [2024-10-07 13:35:10.380526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.380564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.380588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.380609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.380629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.380642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.380659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.380673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.380687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.380711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.380727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.393635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.393669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.393936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.393965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.444 [2024-10-07 13:35:10.393981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.394211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.394238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.444 [2024-10-07 13:35:10.394253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.394278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.394299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.394320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.394335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.394348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.394365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.394379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.394391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.394414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.394429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.404094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.404127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.404436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.404482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.444 [2024-10-07 13:35:10.404511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.404669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.404696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.444 [2024-10-07 13:35:10.404712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.404835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.404861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.408604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.408632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.408647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.408666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.408681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.408695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.409372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.409403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.414523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.414556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.414811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.414838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.444 [2024-10-07 13:35:10.414854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.415028] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.444 [2024-10-07 13:35:10.415053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.444 [2024-10-07 13:35:10.415068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.444 [2024-10-07 13:35:10.415093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.415114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.444 [2024-10-07 13:35:10.415135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.415149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.415163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.415179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.444 [2024-10-07 13:35:10.415194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.444 [2024-10-07 13:35:10.415206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.444 [2024-10-07 13:35:10.415229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.415246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.444 [2024-10-07 13:35:10.425432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.444 [2024-10-07 13:35:10.425478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.425712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.425742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.445 [2024-10-07 13:35:10.425759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.425904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.425930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.445 [2024-10-07 13:35:10.425945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.425969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.425989] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.426009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.426030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.426044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.426061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.426075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.426087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.426110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.426132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.441425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.441458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.442240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.442271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.445 [2024-10-07 13:35:10.442288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.442385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.442410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.445 [2024-10-07 13:35:10.442425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.442851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.442883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.443087] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.443111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.443126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.443143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.443158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.443171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.443221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.443240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.455696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.455730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.456133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.456163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.445 [2024-10-07 13:35:10.456179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.456305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.456334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.445 [2024-10-07 13:35:10.456350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.456719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.456749] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.456970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.456993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.457007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.457025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.457039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.457052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.457100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.457120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.471918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.471950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.472277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.472307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.445 [2024-10-07 13:35:10.472324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.472430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.472456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.445 [2024-10-07 13:35:10.472495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.472842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.472869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.472927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.472945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.472958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.472974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.472988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.473001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.473171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.473193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.486551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.486583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.486710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.486750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.445 [2024-10-07 13:35:10.486767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.486923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.486948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.445 [2024-10-07 13:35:10.486963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.486987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.487007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.487028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.487043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.487055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.487072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.445 [2024-10-07 13:35:10.487086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.445 [2024-10-07 13:35:10.487098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.445 [2024-10-07 13:35:10.487121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.487148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.445 [2024-10-07 13:35:10.497031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.497063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.445 [2024-10-07 13:35:10.499705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.499737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.445 [2024-10-07 13:35:10.499755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.499904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.445 [2024-10-07 13:35:10.499930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.445 [2024-10-07 13:35:10.499946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.445 [2024-10-07 13:35:10.501440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.445 [2024-10-07 13:35:10.501470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.501558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.501578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.501597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.501615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.501630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.501643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.501668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.501685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.507143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.507188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.507422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.507450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.446 [2024-10-07 13:35:10.507481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.507610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.507637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.446 [2024-10-07 13:35:10.507654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.507672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.507698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.507717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.507730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.507743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.507797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.507817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.507829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.507841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.507863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.517226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.517566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.517597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.446 [2024-10-07 13:35:10.517614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.517738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.517950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.517986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.518011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.518027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.518085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.518180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.518206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.446 [2024-10-07 13:35:10.518222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.518246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.518269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.518285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.518298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.518321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.530045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.530078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.530428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.530458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.446 [2024-10-07 13:35:10.530499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.530584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.530626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.446 [2024-10-07 13:35:10.530643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.530868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.530898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.531127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.531151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.531182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.531200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.531216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.531228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.531294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.531314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.544918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.544956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.545436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.545466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.446 [2024-10-07 13:35:10.545483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.545607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.545633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.446 [2024-10-07 13:35:10.545649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.545874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.545902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.446 [2024-10-07 13:35:10.546110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.546134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.546149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.546166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.446 [2024-10-07 13:35:10.546181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.446 [2024-10-07 13:35:10.546193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.446 [2024-10-07 13:35:10.546254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.546274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.446 [2024-10-07 13:35:10.559617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.559651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.446 [2024-10-07 13:35:10.559932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.559961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.446 [2024-10-07 13:35:10.559979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.446 [2024-10-07 13:35:10.560111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.446 [2024-10-07 13:35:10.560137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.446 [2024-10-07 13:35:10.560153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.560501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.560534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.560597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.560617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.560631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.560655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.560671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.560686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.560711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.560728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.575663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.575699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.576325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.576356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.447 [2024-10-07 13:35:10.576374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.576527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.576557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.447 [2024-10-07 13:35:10.576574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.577037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.577068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.577291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.577317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.577332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.577351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.577367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.577380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.577433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.577454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.590095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.590127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.590300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.590329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.447 [2024-10-07 13:35:10.590346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.590461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.590510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.447 [2024-10-07 13:35:10.590528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.590559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.590581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.590603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.590618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.590632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.590649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.590665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.590678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.590703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.590719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.601445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.601504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.601897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.601926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.447 [2024-10-07 13:35:10.601944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.602037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.602063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.447 [2024-10-07 13:35:10.602078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.602190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.602216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.602339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.602362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.602377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.602395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.602410] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.602423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.602592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.602617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.611613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.611663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.611914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.611941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.447 [2024-10-07 13:35:10.611957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.612164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.612191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.447 [2024-10-07 13:35:10.612207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.612224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.612249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.612266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.612280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.612293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.612316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.612333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.612357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.612370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.612391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.447 [2024-10-07 13:35:10.621872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.621905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.447 [2024-10-07 13:35:10.622390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.622420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.447 [2024-10-07 13:35:10.622437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.622647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.447 [2024-10-07 13:35:10.622673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.447 [2024-10-07 13:35:10.622698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.447 [2024-10-07 13:35:10.622912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.622940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.447 [2024-10-07 13:35:10.623131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.623156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.447 [2024-10-07 13:35:10.623170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.447 [2024-10-07 13:35:10.623187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.447 [2024-10-07 13:35:10.623207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.623221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.623413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.623436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.637014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.637047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.637242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.637270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.448 [2024-10-07 13:35:10.637286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.637418] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.637445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.448 [2024-10-07 13:35:10.637460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.637520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.637543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.637564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.637579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.637593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.637610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.637633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.637646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.637669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.637687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.647786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.647819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.648100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.648128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.448 [2024-10-07 13:35:10.648145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.648341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.648366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.448 [2024-10-07 13:35:10.648381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.651958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.651994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.653074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.653100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.653115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.653133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.653148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.653161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.653260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.653281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.658417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.658448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.658675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.658706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.448 [2024-10-07 13:35:10.658723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.658893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.658918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.448 [2024-10-07 13:35:10.658934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.658959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.658979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.658999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.659014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.659027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.659043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.659058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.659071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.659094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.659116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.669553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.669587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.669813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.669854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.448 [2024-10-07 13:35:10.669876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.670102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.670127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.448 [2024-10-07 13:35:10.670143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.670640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.670673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.670930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.670955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.670970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.670988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.671003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.671016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.671210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.671233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.685195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.685228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.685492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.685528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.448 [2024-10-07 13:35:10.685545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.685670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.685695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.448 [2024-10-07 13:35:10.685711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.686170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.686199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.448 [2024-10-07 13:35:10.686410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.686434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.686448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.686480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.448 [2024-10-07 13:35:10.686509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.448 [2024-10-07 13:35:10.686533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.448 [2024-10-07 13:35:10.686821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.686848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.448 [2024-10-07 13:35:10.699883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.699917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.448 [2024-10-07 13:35:10.700272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.448 [2024-10-07 13:35:10.700304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.448 [2024-10-07 13:35:10.700321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.448 [2024-10-07 13:35:10.700501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.700527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.449 [2024-10-07 13:35:10.700543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.700886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.700916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.701117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.701141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.701156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.701174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.701188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.701202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.701250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.701269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.714447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.714502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.714926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.714957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.449 [2024-10-07 13:35:10.714974] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.715169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.715193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.449 [2024-10-07 13:35:10.715209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.715555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.715585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.715812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.715836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.715850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.715868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.715882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.715895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.715958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.715980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.729721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.729755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.729927] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.729954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.449 [2024-10-07 13:35:10.729970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.730149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.730174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.449 [2024-10-07 13:35:10.730190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.730214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.730234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.730254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.730269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.730282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.730298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.730312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.730325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.730354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.730370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.739936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.739968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.740223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.740250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.449 [2024-10-07 13:35:10.740266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.740414] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.740445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.449 [2024-10-07 13:35:10.740460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.740510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.740532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.743041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.743068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.743083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.743100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.743115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.743128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.745214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.745240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.750046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.750092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.750288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.750315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.449 [2024-10-07 13:35:10.750331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.750501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.750537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.449 [2024-10-07 13:35:10.750552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.750571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.750597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.750615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.750629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.750642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.750666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.750684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.449 [2024-10-07 13:35:10.750697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.449 [2024-10-07 13:35:10.750720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.449 [2024-10-07 13:35:10.750749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.449 [2024-10-07 13:35:10.760942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.760974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.449 [2024-10-07 13:35:10.761173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.761202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.449 [2024-10-07 13:35:10.761218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.761417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.449 [2024-10-07 13:35:10.761443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.449 [2024-10-07 13:35:10.761459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.449 [2024-10-07 13:35:10.761506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.761529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.449 [2024-10-07 13:35:10.761551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.761565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.761589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.761607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.761621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.761633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.761667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.761683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 8554.00 IOPS, 33.41 MiB/s [2024-10-07T11:35:19.383Z] [2024-10-07 13:35:10.771050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.771097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.771326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.771353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.450 [2024-10-07 13:35:10.771369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.771587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.771613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.450 [2024-10-07 13:35:10.771629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.771647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.771673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.771691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.771709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.771723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.771747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.771765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.771793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.771806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.771841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.781167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.781232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.781492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.781521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.450 [2024-10-07 13:35:10.781539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.781931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.781960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.450 [2024-10-07 13:35:10.781976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.781994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.782188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.782215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.782230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.782243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.782292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.782313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.782326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.782340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.782363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.794308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.794341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.794811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.794843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.450 [2024-10-07 13:35:10.794860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.795051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.795076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.450 [2024-10-07 13:35:10.795092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.795287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.795316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.795535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.795561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.795575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.795594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.795609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.795622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.795673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.795693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.808543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.808579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.808961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.808992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.450 [2024-10-07 13:35:10.809009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.809111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.809136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.450 [2024-10-07 13:35:10.809151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.809343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.809372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.450 [2024-10-07 13:35:10.809590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.809615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.809630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.809648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.450 [2024-10-07 13:35:10.809663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.450 [2024-10-07 13:35:10.809677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.450 [2024-10-07 13:35:10.809728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.809748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.450 [2024-10-07 13:35:10.825123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.825158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.450 [2024-10-07 13:35:10.825346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.825376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.450 [2024-10-07 13:35:10.825394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.450 [2024-10-07 13:35:10.825507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.450 [2024-10-07 13:35:10.825548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.451 [2024-10-07 13:35:10.825565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.825591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.825615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.825637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.825653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.825668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.825688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.825705] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.825719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.825756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.825793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.839446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.839504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.839627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.839658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.451 [2024-10-07 13:35:10.839675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.839787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.839814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.451 [2024-10-07 13:35:10.839843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.839868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.839889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.839909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.839925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.839947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.839965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.839980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.839992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.840015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.840032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.854346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.854377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.854565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.854595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.451 [2024-10-07 13:35:10.854612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.854756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.854798] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.451 [2024-10-07 13:35:10.854814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.854838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.854858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.854879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.854894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.854907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.854924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.854939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.854951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.854974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.855001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.867053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.867086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.867286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.867326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.451 [2024-10-07 13:35:10.867343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.867494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.867522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.451 [2024-10-07 13:35:10.867543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.867653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.867680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.867799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.867820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.867834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.867851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.867865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.867878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.870769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.870823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.877165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.877211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.877321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.877352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.451 [2024-10-07 13:35:10.877368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.877565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.877592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.451 [2024-10-07 13:35:10.877609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.877627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.877764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.877790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.877819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.877841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.877973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.877997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.878010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.878022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.878128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.887249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.887390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.887420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.451 [2024-10-07 13:35:10.887437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.887653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.887721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.451 [2024-10-07 13:35:10.887755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.451 [2024-10-07 13:35:10.887786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.451 [2024-10-07 13:35:10.887799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.451 [2024-10-07 13:35:10.887823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.451 [2024-10-07 13:35:10.887959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.451 [2024-10-07 13:35:10.887986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.451 [2024-10-07 13:35:10.888003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.451 [2024-10-07 13:35:10.888175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.451 [2024-10-07 13:35:10.888230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.888250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.888263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.888287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.900723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.900756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.900921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.900949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.452 [2024-10-07 13:35:10.900966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.901079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.901105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.452 [2024-10-07 13:35:10.901121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.901146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.901167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.901188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.901202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.901216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.901237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.901252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.901266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.901289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.901306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.916807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.916840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.917453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.917509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.452 [2024-10-07 13:35:10.917529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.917647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.917674] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.452 [2024-10-07 13:35:10.917690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.917973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.918003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.918201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.918225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.918239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.918256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.918282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.918295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.918343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.918374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.929103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.929145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.929376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.929405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.452 [2024-10-07 13:35:10.929421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.929576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.929604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.452 [2024-10-07 13:35:10.929621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.929737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.929764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.931886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.931912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.931926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.931943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.931957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.931970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.932764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.932796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.939225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.939271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.939501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.939530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.452 [2024-10-07 13:35:10.939547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.939670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.939698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.452 [2024-10-07 13:35:10.939714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.939732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.939758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.939776] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.939790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.939803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.939827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.939844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.939858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.939881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.939903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.949310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.949460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.949532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.452 [2024-10-07 13:35:10.949551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.949589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.949621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.949649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.949665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.949679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.949703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.949860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.949887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.452 [2024-10-07 13:35:10.949903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.452 [2024-10-07 13:35:10.949926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.452 [2024-10-07 13:35:10.949949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.452 [2024-10-07 13:35:10.949964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.452 [2024-10-07 13:35:10.949977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.452 [2024-10-07 13:35:10.950000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.452 [2024-10-07 13:35:10.961367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.961400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.452 [2024-10-07 13:35:10.961751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.452 [2024-10-07 13:35:10.961795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.453 [2024-10-07 13:35:10.961813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.961953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:10.961979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.453 [2024-10-07 13:35:10.961994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.962187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.962215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.962261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.962279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.962293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.962310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.962331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.962344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.962543] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:10.962567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:10.975158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:10.975190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:10.975321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:10.975350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.453 [2024-10-07 13:35:10.975368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.975482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:10.975533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.453 [2024-10-07 13:35:10.975549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.975574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.975595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.975616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.975632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.975645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.975662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.975676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.975689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.975714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:10.975731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:10.985268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:10.985324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:10.985478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:10.985526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.453 [2024-10-07 13:35:10.985544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.986652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:10.986682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.453 [2024-10-07 13:35:10.986699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.986718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.986908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.986934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.986948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.986960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.987068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:10.987103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.987116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.987128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.987244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:10.995360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:10.995579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:10.995609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.453 [2024-10-07 13:35:10.995627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.996872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.997424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:10.997460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.997500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.997516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.997673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:10.997839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:10.997866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.453 [2024-10-07 13:35:10.997882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:10.997990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:10.998137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:10.998159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:10.998173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:10.999693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:11.006373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:11.006552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:11.006583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.453 [2024-10-07 13:35:11.006606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:11.006632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:11.006657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:11.006672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:11.006685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:11.006709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:11.007514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:11.007680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:11.007708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.453 [2024-10-07 13:35:11.007726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:11.007751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:11.007775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:11.007791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:11.007819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:11.008688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:11.020437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:11.021134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.453 [2024-10-07 13:35:11.021308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:11.021337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.453 [2024-10-07 13:35:11.021359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:11.021892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.453 [2024-10-07 13:35:11.021921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.453 [2024-10-07 13:35:11.021938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.453 [2024-10-07 13:35:11.021956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:11.022162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.453 [2024-10-07 13:35:11.022188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:11.022202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:11.022222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:11.022271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:11.022302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.453 [2024-10-07 13:35:11.022321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.453 [2024-10-07 13:35:11.022335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.453 [2024-10-07 13:35:11.022358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.453 [2024-10-07 13:35:11.035505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.035556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.035705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.035734] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.454 [2024-10-07 13:35:11.035752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.035858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.035884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.454 [2024-10-07 13:35:11.035901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.035919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.035944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.035963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.035982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.035995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.036020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.036037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.036050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.036063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.036085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.050952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.050985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.051395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.051424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.454 [2024-10-07 13:35:11.051441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.051572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.051599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.454 [2024-10-07 13:35:11.051616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.051827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.051858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.051904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.051925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.051938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.051956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.051982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.051995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.052166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.052190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.065598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.065632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.065759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.065803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.454 [2024-10-07 13:35:11.065820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.065936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.065963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.454 [2024-10-07 13:35:11.065980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.066005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.066027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.066048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.066064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.066079] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.066096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.066111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.066124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.066148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.066176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.075713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.075765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.075949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.075981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.454 [2024-10-07 13:35:11.076004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.078832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.078863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.454 [2024-10-07 13:35:11.078881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.078900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.081557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.081588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.081603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.081617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.082115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.082140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.082159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.082171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.082386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.086117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.086147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.086340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.086368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x667cc0 with addr=10.0.0.2, port=4420 00:24:23.454 [2024-10-07 13:35:11.086385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x667cc0 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.086515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.086543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.454 [2024-10-07 13:35:11.086560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.086585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x667cc0 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.086606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.086628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.086643] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.086656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.086674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.454 [2024-10-07 13:35:11.086689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.454 [2024-10-07 13:35:11.086701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.454 [2024-10-07 13:35:11.086730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.086758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.454 [2024-10-07 13:35:11.097589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.097624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.454 [2024-10-07 13:35:11.097815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.454 [2024-10-07 13:35:11.097845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.454 [2024-10-07 13:35:11.097874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.454 [2024-10-07 13:35:11.098178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.454 [2024-10-07 13:35:11.098253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.098275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.098289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.098473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.112341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.112511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.112544] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.112562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.112596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.112629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.112648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.112662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.112697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.122437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.122651] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.122682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.122701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.122734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.122782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.122799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.122813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.122844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.132559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.132714] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.132746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.132764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.132811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.132842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.132859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.132872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.132903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.144286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.144626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.144657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.144675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.144739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.144774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.144792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.144823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.144855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.152038] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:23.455 [2024-10-07 13:35:11.157032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.160432] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.160464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.160540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.160996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.161239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.161264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.161295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.161346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.167119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.167318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.167347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.167369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.167395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.167419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.167434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.167447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.167497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.177205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.177350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.177379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.177397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.177599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.177657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.177679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.177694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.177719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.190214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.190549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.190581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.190598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.190811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.455 [2024-10-07 13:35:11.190874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.455 [2024-10-07 13:35:11.190897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.455 [2024-10-07 13:35:11.190912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.455 [2024-10-07 13:35:11.191153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.455 [2024-10-07 13:35:11.204142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.455 [2024-10-07 13:35:11.204321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.455 [2024-10-07 13:35:11.204350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.455 [2024-10-07 13:35:11.204367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.455 [2024-10-07 13:35:11.204392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.204416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.204431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.204450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.204501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.216394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.216655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.216688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.216706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.216847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.216968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.216989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.217003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.219728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.226502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.226634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.226664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.226681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.226707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.226731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.226747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.226760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.226798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.236712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.236954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.236983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.237000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.237174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.237235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.237256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.237270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.237295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.249983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.250300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.250330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.250347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.250396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.250423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.250439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.250452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.250654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.263879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.264037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.264066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.264083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.264108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.264132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.264147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.264159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.264183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.279368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.279613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.279644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.279661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.279687] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.279712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.279727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.279741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.279766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.291333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.291606] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.291638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.291656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.294387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.295333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.295359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.295373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.295941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.301433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.301658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.301688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.301705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.301730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.301754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.301784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.301797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.301820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.311534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.311752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.456 [2024-10-07 13:35:11.311781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.456 [2024-10-07 13:35:11.311813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.456 [2024-10-07 13:35:11.311992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.456 [2024-10-07 13:35:11.312126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.456 [2024-10-07 13:35:11.312148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.456 [2024-10-07 13:35:11.312162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.456 [2024-10-07 13:35:11.312272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.456 [2024-10-07 13:35:11.323966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.456 [2024-10-07 13:35:11.324148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.324177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.324194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.324562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.324810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.324834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.324870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.325069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.336732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.338746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.338794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.338812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.339429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.339713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.339739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.339754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.339962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.346820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.347110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.347139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.347155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.347180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.347204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.347219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.347232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.347255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.356918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.357074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.357103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.357120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.357144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.357168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.357184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.357209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.357233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.370727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.370923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.370957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.370975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.371149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.371209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.371241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.371255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.371279] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.384768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.384932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.384961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.384978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.385003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.385027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.385042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.385056] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.385079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.399536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.400665] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.400699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.400727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.401306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.401567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.401593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.401616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.401829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.410260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.410496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.410525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.410543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.410568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.410631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.410651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.410665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.410689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.423192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.423412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.423442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.423459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.423507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.423533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.423549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.423562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.423698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.433600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.433776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.433820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.433837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.434011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.434065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.434097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.434111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.434281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.457 [2024-10-07 13:35:11.447130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.457 [2024-10-07 13:35:11.447442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.457 [2024-10-07 13:35:11.447496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.457 [2024-10-07 13:35:11.447517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.457 [2024-10-07 13:35:11.447715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.457 [2024-10-07 13:35:11.447784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.457 [2024-10-07 13:35:11.447820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.457 [2024-10-07 13:35:11.447846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.457 [2024-10-07 13:35:11.447871] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.460890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.461433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.461477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.461506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.461766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.461984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.462007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.462021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.462070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.471272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.471522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.471553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.471572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.471681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.471805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.471841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.471855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.471960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.481356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.481570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.481601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.481618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.481644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.481668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.481684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.481697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.481721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.491440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.491734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.491765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.491787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.491828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.491852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.491867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.491880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.491903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.504724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.504884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.504913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.504930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.504954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.505398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.505421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.505441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.506225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.519731] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.520264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.520294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.520311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.520760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.521033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.521056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.521070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.521266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.530078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.531973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.532004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.532021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.534448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.535534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.535564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.535589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.535986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.540164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.540351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.540380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.540397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.540422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.540446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.540477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.540503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.540530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.550247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.550459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.550511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.550532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.550557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.550582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.550598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.550611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.550636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.561256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.561443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.561494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.561515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.561541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.561565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.561580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.458 [2024-10-07 13:35:11.561594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.458 [2024-10-07 13:35:11.561618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.458 [2024-10-07 13:35:11.572388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.458 [2024-10-07 13:35:11.572530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.458 [2024-10-07 13:35:11.572561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.458 [2024-10-07 13:35:11.572578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.458 [2024-10-07 13:35:11.572603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.458 [2024-10-07 13:35:11.572674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.458 [2024-10-07 13:35:11.572697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.572712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.572960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.583204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.583389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.583419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.583437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.583497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.583525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.583542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.583555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.583581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.593368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.593506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.593538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.593556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.593582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.593608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.593623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.593638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.593836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.607212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.607428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.607456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.607498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.607532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.607557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.607572] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.607586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.607610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.620902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.621065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.621094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.621111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.621136] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.621159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.621175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.621188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.621222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.635365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.635517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.635547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.635564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.635590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.635614] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.635629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.635643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.635667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.650820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.651030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.651057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.651073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.651098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.651121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.651137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.651155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.651179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.665237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.665410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.665440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.665458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.665505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.665544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.665559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.665574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.665598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.680762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.681653] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.681686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.681704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.682298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.682586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.682612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.682627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.682843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.695881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.459 [2024-10-07 13:35:11.696090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.459 [2024-10-07 13:35:11.696120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.459 [2024-10-07 13:35:11.696138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.459 [2024-10-07 13:35:11.696310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.459 [2024-10-07 13:35:11.696370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.459 [2024-10-07 13:35:11.696390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.459 [2024-10-07 13:35:11.696413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.459 [2024-10-07 13:35:11.696438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.459 [2024-10-07 13:35:11.710602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.710998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.711035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.711053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.711249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.711321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.711353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.711367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.711572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.725418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.725622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.725652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.725670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.725696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.725720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.725736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.725749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.725773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.735509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.736608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.736639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.736656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.740533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.741271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.741297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.741311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.741427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.747348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.747630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.747661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.747678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.747787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.747859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.747878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.747894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.747919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.757433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.757691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.757721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.757739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.757930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.757987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.758007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.758021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.758045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 8563.56 IOPS, 33.45 MiB/s [2024-10-07T11:35:19.393Z] [2024-10-07 13:35:11.771957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.772110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.772139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.772156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.772180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.772204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.772219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.772232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.772256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.786910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.787141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.787170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.787187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.787212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.787236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.787250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.787263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.787292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.800604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.800828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.800858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.800875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.800900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.800923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.800938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.800951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.800975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.816680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.816976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.817007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.817024] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.817371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.817613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.817639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.817655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.817707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.831678] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.831934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.831964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.831981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.832008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.832031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.832046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.460 [2024-10-07 13:35:11.832060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.460 [2024-10-07 13:35:11.832481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.460 [2024-10-07 13:35:11.846342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.460 [2024-10-07 13:35:11.846561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.460 [2024-10-07 13:35:11.846592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.460 [2024-10-07 13:35:11.846615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.460 [2024-10-07 13:35:11.846643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.460 [2024-10-07 13:35:11.846691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.460 [2024-10-07 13:35:11.846711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.846726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.846752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.861417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.861645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.861676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.861694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.861720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.861745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.861761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.861789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.861814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.871826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.872038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.872079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.872096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.872202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.872311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.872333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.872347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.872456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.881917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.882166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.882196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.882212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.882237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.882260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.882280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.882294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.882317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.892070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.892261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.892290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.892308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.892332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.892355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.892370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.892383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.892406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.906178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.906384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.906413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.906430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.906454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.906504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.906522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.906535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.906559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.919844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.921782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.921828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.921845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.921917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.921944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.921959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.921972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.921996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.929932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.930201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.930231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.930247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.932577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.932878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.932904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.932919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.933038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.940102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.940319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.940348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.940365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.940390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.940412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.940427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.940440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.940463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.951602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.951787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.951830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.951847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.951872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.951895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.951909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.951924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.951947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.966984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.967498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.967529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.967546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.967804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.967860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.461 [2024-10-07 13:35:11.967880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.461 [2024-10-07 13:35:11.967893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.461 [2024-10-07 13:35:11.967918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.461 [2024-10-07 13:35:11.977695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.461 [2024-10-07 13:35:11.978071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.461 [2024-10-07 13:35:11.978103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.461 [2024-10-07 13:35:11.978120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.461 [2024-10-07 13:35:11.981109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.461 [2024-10-07 13:35:11.981906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:11.981932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:11.981946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:11.982333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:11.987795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:11.988055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:11.988083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:11.988099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:11.988123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:11.988146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:11.988160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:11.988173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:11.988196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:11.997878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:11.998144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:11.998174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:11.998190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:11.998216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:11.998240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:11.998254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:11.998272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:11.998297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.011874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.012124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.012154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.012171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.012196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.012220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.012234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.012248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.012271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.025012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.026187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.026217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.026234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.026338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.026366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.026381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.026395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.026418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.035705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.036063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.036093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.036111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.036231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.036341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.036361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.036375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.036508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.045794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.046029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.046075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.046093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.046118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.046141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.046155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.046168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.046191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.055894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.056095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.056133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.056150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.056174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.056197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.056212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.056225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.056248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.068203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.068768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.068814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.068831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.069022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.069457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.069508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.069524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.069740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.083456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.084040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.084070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.084087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.084328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.084556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.084595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.084611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.084664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.097105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.097536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.097569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.097588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.097806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.462 [2024-10-07 13:35:12.097888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.462 [2024-10-07 13:35:12.097908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.462 [2024-10-07 13:35:12.097922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.462 [2024-10-07 13:35:12.097948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.462 [2024-10-07 13:35:12.113184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.462 [2024-10-07 13:35:12.113434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.462 [2024-10-07 13:35:12.113479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.462 [2024-10-07 13:35:12.113506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.462 [2024-10-07 13:35:12.113533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.113558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.113574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.113588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.113612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.128407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.128812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.128843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.128877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.129132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.129330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.129353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.129368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.129422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.143331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.143476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.143514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.143532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.143558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.143581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.143597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.143611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.143635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.157996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.158347] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.158377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.158394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.158635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.158693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.158713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.158727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.158915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.172443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.172691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.172721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.172739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.172765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.172803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.172817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.172830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.172853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.185750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.185934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.185963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.185984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.186010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.186033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.186047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.186061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.186084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.199868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.200238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.200268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.200285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.200354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.200382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.200398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.200411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.200434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.215124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.215280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.215308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.215325] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.215349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.215372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.215386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.215399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.215750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.230030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.230539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.230571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.230589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.230813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.230870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.230896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.230912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.230936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.463 [2024-10-07 13:35:12.241981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.463 [2024-10-07 13:35:12.243928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.463 [2024-10-07 13:35:12.243960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.463 [2024-10-07 13:35:12.243977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.463 [2024-10-07 13:35:12.244813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.463 [2024-10-07 13:35:12.245058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.463 [2024-10-07 13:35:12.245082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.463 [2024-10-07 13:35:12.245096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.463 [2024-10-07 13:35:12.245287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.253085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.253319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.253349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.253368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.253501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.253617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.253639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.253653] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.257990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.263169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.263346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.263375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.263392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.263416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.263440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.263455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.263484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.263521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.273568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.273919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.273949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.273968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.274016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.274045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.274061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.274076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.274100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.283942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.287746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.287778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.287812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.288274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.288483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.288532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.288548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.288600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.294143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.294306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.294334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.294352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.294832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.294886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.294906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.294920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.294945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.304228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.304409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.304439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.304456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.304512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.304539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.304554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.304568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.304593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.317543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.317706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.317737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.317755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.317781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.317821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.317837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.317850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.317873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.330943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.331097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.331125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.331143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.331168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.331192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.331207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.331220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.331244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.344886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.345016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.345044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.345061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.345086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.345110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.345126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.345145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.345169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.358305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.359187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.359220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.359258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.359666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.359739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.359760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.464 [2024-10-07 13:35:12.359775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.464 [2024-10-07 13:35:12.359802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.464 [2024-10-07 13:35:12.373319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.464 [2024-10-07 13:35:12.373908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.464 [2024-10-07 13:35:12.373939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.464 [2024-10-07 13:35:12.373957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.464 [2024-10-07 13:35:12.374591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.464 [2024-10-07 13:35:12.374845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.464 [2024-10-07 13:35:12.374868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.374882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.375075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.388999] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.389242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.389271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.465 [2024-10-07 13:35:12.389288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.389314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.389337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.389352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.389366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.389389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.399366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.399627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.399662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.465 [2024-10-07 13:35:12.399681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.399805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.399916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.399938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.399953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.402714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.409453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.409641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.409670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.465 [2024-10-07 13:35:12.409687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.409903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.410059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.410082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.410096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.410215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.419566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.419761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.419791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.465 [2024-10-07 13:35:12.419823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.419848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.419871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.419886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.419899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.419922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.423506] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7c0690 was disconnected and freed. reset controller. 00:24:23.465 [2024-10-07 13:35:12.423554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.423625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.432832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.433646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.433693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.433711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.433727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.434059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.434283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.434313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.465 [2024-10-07 13:35:12.434330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.434581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.435064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.435103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.435120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.435134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.435347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.435545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.435574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.465 [2024-10-07 13:35:12.435591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.435810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.435870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.435890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.435904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.435929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.445039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.445353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.445384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.465 [2024-10-07 13:35:12.445402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.445551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.448556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.448597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.448616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.448630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.449460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.449729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.449760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.465 [2024-10-07 13:35:12.449792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.450378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.450651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.450677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.450703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.450934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.455148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.455390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.455419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.465 [2024-10-07 13:35:12.455436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.455460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.455513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.455545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.465 [2024-10-07 13:35:12.455559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.465 [2024-10-07 13:35:12.455584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.465 [2024-10-07 13:35:12.459862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.465 [2024-10-07 13:35:12.460176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.465 [2024-10-07 13:35:12.460206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.465 [2024-10-07 13:35:12.460223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.465 [2024-10-07 13:35:12.460330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.465 [2024-10-07 13:35:12.460451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.465 [2024-10-07 13:35:12.460498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.460516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.460634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.465307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.465578] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.465610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.466 [2024-10-07 13:35:12.465628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.465849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.465905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.465925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.465938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.465962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.469947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.470150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.470178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.466 [2024-10-07 13:35:12.470195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.470406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.470599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.470626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.470641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.470786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.479739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.480008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.480037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.466 [2024-10-07 13:35:12.480064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.480530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.480790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.480832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.480847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.480916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.480941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.481181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.481222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.466 [2024-10-07 13:35:12.481238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.481410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.481482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.481531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.481553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.481753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.491484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.491648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.491849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.491878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.466 [2024-10-07 13:35:12.491895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.495972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.496003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.466 [2024-10-07 13:35:12.496020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.496039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.496540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.496569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.496584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.496598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.496965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.496990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.497004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.497018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.497221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.501580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.501837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.501865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.466 [2024-10-07 13:35:12.501882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.501906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.501942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.501961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.501975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.502000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.502020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.502232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.502268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.466 [2024-10-07 13:35:12.502284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.502418] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.502572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.502594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.502609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.502752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.466 [2024-10-07 13:35:12.511662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.466 [2024-10-07 13:35:12.511919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.466 [2024-10-07 13:35:12.511947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.466 [2024-10-07 13:35:12.511963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.466 [2024-10-07 13:35:12.511987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.466 [2024-10-07 13:35:12.512014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.466 [2024-10-07 13:35:12.512030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.466 [2024-10-07 13:35:12.512044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.466 [2024-10-07 13:35:12.512068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.512106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.512342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.512368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.467 [2024-10-07 13:35:12.512383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.512407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.512430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.512444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.512457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.512505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.525979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.526092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.526338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.526366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.467 [2024-10-07 13:35:12.526382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.526570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.526599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.467 [2024-10-07 13:35:12.526616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.526636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.526662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.526680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.526693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.526706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.526731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.526748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.526763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.526776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.526798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.536745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.536779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.537119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.537160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.467 [2024-10-07 13:35:12.537176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.537330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.537366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.467 [2024-10-07 13:35:12.537382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.537516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.537552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.537660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.537681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.537695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.537712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.537727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.537740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.537863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.537889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.546858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.546904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.547150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.547177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.467 [2024-10-07 13:35:12.547193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.547368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.547394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.467 [2024-10-07 13:35:12.547409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.547427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.547587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.547613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.547627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.547641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.547765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.547801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.547815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.547828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.547947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.556942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.557194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.557223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.467 [2024-10-07 13:35:12.557240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.557698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.558073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.558111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.558128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.558141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.558341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.558591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.558621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.467 [2024-10-07 13:35:12.558644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.558695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.467 [2024-10-07 13:35:12.558723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.467 [2024-10-07 13:35:12.558739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.467 [2024-10-07 13:35:12.558752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.467 [2024-10-07 13:35:12.558791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.467 [2024-10-07 13:35:12.569260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.569294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.467 [2024-10-07 13:35:12.569543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.569576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.467 [2024-10-07 13:35:12.569593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.467 [2024-10-07 13:35:12.569839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.467 [2024-10-07 13:35:12.569866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.468 [2024-10-07 13:35:12.569881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.569906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.569926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.569947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.569961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.569974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.569990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.570004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.570016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.570039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.570055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.584519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.584571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.584899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.584944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.468 [2024-10-07 13:35:12.584961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.585086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.585115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.468 [2024-10-07 13:35:12.585131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.585155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.585176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.585197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.585212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.585225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.585241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.585255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.585268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.585291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.585307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.596834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.596867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.597212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.597242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.468 [2024-10-07 13:35:12.597259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.597463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.597513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.468 [2024-10-07 13:35:12.597530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.600430] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.600461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.601229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.601254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.601269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.601285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.601300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.601312] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.601764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.601803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.607601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.607633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.607937] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.607966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.468 [2024-10-07 13:35:12.607983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.608063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.608088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.468 [2024-10-07 13:35:12.608103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.608142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.608166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.608187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.608202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.608214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.608231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.608245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.608258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.608280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.608296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.617718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.618162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.618309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.618338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.468 [2024-10-07 13:35:12.618356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.618564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.468 [2024-10-07 13:35:12.618594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.468 [2024-10-07 13:35:12.618612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.468 [2024-10-07 13:35:12.618631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.618659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.468 [2024-10-07 13:35:12.618678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.618692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.618711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.618738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.618756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.468 [2024-10-07 13:35:12.618770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.468 [2024-10-07 13:35:12.618783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.468 [2024-10-07 13:35:12.618822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.468 [2024-10-07 13:35:12.628141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.468 [2024-10-07 13:35:12.628386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.628415] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.469 [2024-10-07 13:35:12.628431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.631129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.632008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.632046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.632063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.632076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.632531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.469 [2024-10-07 13:35:12.632680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.632708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.469 [2024-10-07 13:35:12.632725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.632947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.633181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.633204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.633218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.633270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.469 [2024-10-07 13:35:12.638224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.638405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.638432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.469 [2024-10-07 13:35:12.638449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.638607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.638739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.638762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.638784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.638918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.469 [2024-10-07 13:35:12.646693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.647063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.647094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.469 [2024-10-07 13:35:12.647111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.647303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.647358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.647378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.647391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.647416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.469 [2024-10-07 13:35:12.648307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.648498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.648527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.469 [2024-10-07 13:35:12.648560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.648754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.648812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.648834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.648863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.648888] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.469 [2024-10-07 13:35:12.661072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.661103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.661276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.661304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.469 [2024-10-07 13:35:12.661321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.661406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.661432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.469 [2024-10-07 13:35:12.661447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.661471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.661520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.661551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.661568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.661581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.661597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.661612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.661625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.661649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.469 [2024-10-07 13:35:12.661666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.469 [2024-10-07 13:35:12.674966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.674998] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.469 [2024-10-07 13:35:12.675138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.675166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.469 [2024-10-07 13:35:12.675183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.675326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.469 [2024-10-07 13:35:12.675351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.469 [2024-10-07 13:35:12.675366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.469 [2024-10-07 13:35:12.675390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.675411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.469 [2024-10-07 13:35:12.675432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.675446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.675459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.469 [2024-10-07 13:35:12.675500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.469 [2024-10-07 13:35:12.675517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.469 [2024-10-07 13:35:12.675530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.676798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.676823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.689568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.689600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.689737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.689765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.470 [2024-10-07 13:35:12.689782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.689950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.689975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.470 [2024-10-07 13:35:12.689990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.690015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.690035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.690055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.690070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.690083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.690099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.690113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.690125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.690150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.690166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.704723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.704756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.704921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.704948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.470 [2024-10-07 13:35:12.704965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.705107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.705133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.470 [2024-10-07 13:35:12.705149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.705173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.705193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.705213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.705228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.705241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.705258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.705272] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.705284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.705308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.705329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.719363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.719395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.719535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.719563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.470 [2024-10-07 13:35:12.719580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.719702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.719728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.470 [2024-10-07 13:35:12.719744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.719783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.719803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.719823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.719838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.719851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.719867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.719881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.719893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.719915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.719931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.733712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.733746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.733940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.733968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.470 [2024-10-07 13:35:12.733984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.734129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.734155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.470 [2024-10-07 13:35:12.734170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.734194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.734215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.734235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.734255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.734270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.734287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.734302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.734314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.734337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.734352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.744417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.744449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.744621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.744650] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.470 [2024-10-07 13:35:12.744668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.744766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.744793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.470 [2024-10-07 13:35:12.744809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.470 [2024-10-07 13:35:12.747272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.747302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.470 [2024-10-07 13:35:12.748456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.748502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.748518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.748536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.470 [2024-10-07 13:35:12.748551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.470 [2024-10-07 13:35:12.748564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.470 [2024-10-07 13:35:12.749998] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.750022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.470 [2024-10-07 13:35:12.754554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.754600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.470 [2024-10-07 13:35:12.754716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.470 [2024-10-07 13:35:12.754744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.470 [2024-10-07 13:35:12.754761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.754905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.754937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.471 [2024-10-07 13:35:12.754953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.754971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.755238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.755264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.755278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.755291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.755419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 [2024-10-07 13:35:12.755442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.755456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.755484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.755540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 [2024-10-07 13:35:12.765367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.765398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.765823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.765852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.471 [2024-10-07 13:35:12.765869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.765987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.766012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.471 [2024-10-07 13:35:12.766027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.766219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.766247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.766296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.766316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.766341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.766358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.766372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.766384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.766584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 [2024-10-07 13:35:12.766608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 8576.00 IOPS, 33.50 MiB/s [2024-10-07T11:35:19.404Z] [2024-10-07 13:35:12.780672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.780708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.780836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.780865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.471 [2024-10-07 13:35:12.780881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.781024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.781050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.471 [2024-10-07 13:35:12.781065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.781104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.781127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.781148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.781163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.781176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.781193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.781207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.781220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.781244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 [2024-10-07 13:35:12.781272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 [2024-10-07 13:35:12.796034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.796066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.796219] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.796246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.471 [2024-10-07 13:35:12.796263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.796434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.796467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.471 [2024-10-07 13:35:12.796483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.796535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.796557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.796577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.796592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.796611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.796629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.471 [2024-10-07 13:35:12.796643] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.471 [2024-10-07 13:35:12.796656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.471 [2024-10-07 13:35:12.796680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 [2024-10-07 13:35:12.796696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.471 [2024-10-07 13:35:12.808138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.808170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.471 [2024-10-07 13:35:12.808391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.808421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.471 [2024-10-07 13:35:12.808438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.808587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.471 [2024-10-07 13:35:12.808614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.471 [2024-10-07 13:35:12.808630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.471 [2024-10-07 13:35:12.808752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.471 [2024-10-07 13:35:12.808803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.811054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.811080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.811095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.811112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.811126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.811139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.812089] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.812114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.818250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.818297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.818437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.818479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.472 [2024-10-07 13:35:12.818507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.818613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.818640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.472 [2024-10-07 13:35:12.818666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.818685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.820815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.820843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.820858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.820871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.821372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.821397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.821411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.821426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.821602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.828662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.828694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.828932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.828961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.472 [2024-10-07 13:35:12.828977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.829067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.829090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.472 [2024-10-07 13:35:12.829105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.829140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.829161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.829181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.829206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.829219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.829236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.829250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.829263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.829286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.829302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.839878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.839915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.840121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.840149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.472 [2024-10-07 13:35:12.840166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.840309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.840335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.472 [2024-10-07 13:35:12.840350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.840809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.840839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.841063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.841086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.841100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.841117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.841132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.841145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.841346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.841370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.851036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.851069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.851302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.851331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.472 [2024-10-07 13:35:12.851348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.851459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.851507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.472 [2024-10-07 13:35:12.851524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.851647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.851674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.472 [2024-10-07 13:35:12.854658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.854684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.854699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.854722] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.472 [2024-10-07 13:35:12.854737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.472 [2024-10-07 13:35:12.854750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.472 [2024-10-07 13:35:12.855495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.855519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.472 [2024-10-07 13:35:12.861146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.861193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.472 [2024-10-07 13:35:12.861389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.472 [2024-10-07 13:35:12.861417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.472 [2024-10-07 13:35:12.861433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.472 [2024-10-07 13:35:12.861563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.861590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.473 [2024-10-07 13:35:12.861606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.861625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.861650] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.861668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.861681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.861695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.861719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.861736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.861748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.861761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.861814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.871687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.871721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.871876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.871905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.473 [2024-10-07 13:35:12.871923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.872044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.872073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.473 [2024-10-07 13:35:12.872089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.872320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.872350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.872411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.872433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.872447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.872481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.872513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.872527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.872747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.872797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.886226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.886259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.886389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.886418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.473 [2024-10-07 13:35:12.886435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.886541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.886584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.473 [2024-10-07 13:35:12.886601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.886628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.886649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.886669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.886684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.886698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.886714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.886729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.886741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.886765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.886782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.896709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.896742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.900727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.900759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.473 [2024-10-07 13:35:12.900777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.900910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.900936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.473 [2024-10-07 13:35:12.900951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.901603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.901633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.902004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.902027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.902042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.902068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.902083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.902095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.902300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.902323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.906825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.906871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.473 [2024-10-07 13:35:12.907050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.907077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.473 [2024-10-07 13:35:12.907094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.907220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.473 [2024-10-07 13:35:12.907246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.473 [2024-10-07 13:35:12.907261] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.473 [2024-10-07 13:35:12.907279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.907304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.473 [2024-10-07 13:35:12.907321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.907334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.907347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.907371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.473 [2024-10-07 13:35:12.907392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.473 [2024-10-07 13:35:12.907406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.473 [2024-10-07 13:35:12.907424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.473 [2024-10-07 13:35:12.907445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.916909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.917125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.917153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.474 [2024-10-07 13:35:12.917170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.917207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.917237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.917264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.917280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.917294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.917318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.917448] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.917507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.474 [2024-10-07 13:35:12.917526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.917551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.917574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.917589] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.917602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.917626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.931707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.931741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.932268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.932298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.474 [2024-10-07 13:35:12.932315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.932407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.932432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.474 [2024-10-07 13:35:12.932447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.932680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.932714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.932928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.932951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.932965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.932983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.932997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.933010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.933058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.933078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.942604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.942637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.942916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.942945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.474 [2024-10-07 13:35:12.942962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.943081] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.943106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.474 [2024-10-07 13:35:12.943122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.943236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.943262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.943377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.943399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.943413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.943430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.943446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.943459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.943594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.943615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.952719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.952775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.953026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.953061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.474 [2024-10-07 13:35:12.953079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.953206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.953234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.474 [2024-10-07 13:35:12.953250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.953269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.953295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.953314] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.953327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.953340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.953366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.953383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.953397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.953412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.953434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.962823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.963030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.963058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.474 [2024-10-07 13:35:12.963076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.963112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.963143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.474 [2024-10-07 13:35:12.963171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.963187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.963200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.963224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.474 [2024-10-07 13:35:12.963397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.474 [2024-10-07 13:35:12.963423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.474 [2024-10-07 13:35:12.963439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.474 [2024-10-07 13:35:12.963478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.474 [2024-10-07 13:35:12.963513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.474 [2024-10-07 13:35:12.963535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.474 [2024-10-07 13:35:12.963549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.474 [2024-10-07 13:35:12.963574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:12.977638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:12.977671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:12.977864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:12.977892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.475 [2024-10-07 13:35:12.977908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:12.978027] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:12.978052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.475 [2024-10-07 13:35:12.978066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:12.978090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:12.978111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:12.978131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:12.978146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:12.978159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:12.978175] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:12.978195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:12.978207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:12.978230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:12.978246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:12.988737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:12.988770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:12.992572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:12.992604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.475 [2024-10-07 13:35:12.992622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:12.992740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:12.992782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.475 [2024-10-07 13:35:12.992798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:12.993550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:12.993581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:12.994009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:12.994043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:12.994057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:12.994073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:12.994088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:12.994105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:12.994321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:12.994342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:12.998868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:12.998913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:12.999130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:12.999158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.475 [2024-10-07 13:35:12.999174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:12.999267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:12.999292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.475 [2024-10-07 13:35:12.999307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:12.999325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:12.999349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:12.999372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:12.999385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:12.999397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:12.999421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:12.999444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:12.999457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:12.999496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:12.999522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:13.010157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:13.010189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:13.010563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:13.010595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.475 [2024-10-07 13:35:13.010618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:13.010736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:13.010763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.475 [2024-10-07 13:35:13.010794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:13.010991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:13.011019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:13.011207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:13.011230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:13.011244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:13.011262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:13.011276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:13.011288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:13.011337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:13.011356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:13.024152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:13.024184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:13.024334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:13.024363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.475 [2024-10-07 13:35:13.024379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:13.024479] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.475 [2024-10-07 13:35:13.024529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.475 [2024-10-07 13:35:13.024546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.475 [2024-10-07 13:35:13.024571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:13.024592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.475 [2024-10-07 13:35:13.024613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:13.024639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:13.024652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:13.024669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.475 [2024-10-07 13:35:13.024683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.475 [2024-10-07 13:35:13.024695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.475 [2024-10-07 13:35:13.024725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:13.024754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.475 [2024-10-07 13:35:13.034767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:13.034818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.475 [2024-10-07 13:35:13.034979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.035008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.476 [2024-10-07 13:35:13.035025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.035161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.035187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.476 [2024-10-07 13:35:13.035203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.035880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.035910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.039682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.039709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.039724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.039742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.039757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.039785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.040318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.040342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.046327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.046359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.046601] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.046631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.476 [2024-10-07 13:35:13.046649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.046766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.046807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.476 [2024-10-07 13:35:13.046823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.046848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.046895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.046916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.046937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.046951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.046968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.046983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.046995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.047019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.047051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.056611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.056645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.056859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.056888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.476 [2024-10-07 13:35:13.056904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.057009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.057034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.476 [2024-10-07 13:35:13.057050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.057074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.057095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.057115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.057130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.057143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.057159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.057174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.057187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.057695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.057720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.071768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.071815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.072114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.072143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.476 [2024-10-07 13:35:13.072160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.072260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.072285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.476 [2024-10-07 13:35:13.072301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.072325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.072346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.072367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.072392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.072406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.072422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.072436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.072449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.072500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.072529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.085755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.085788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.085979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.086008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.476 [2024-10-07 13:35:13.086025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.086173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.086199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.476 [2024-10-07 13:35:13.086215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.086240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.086261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.086281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.086296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.086309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.086326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.476 [2024-10-07 13:35:13.086340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.476 [2024-10-07 13:35:13.086353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.476 [2024-10-07 13:35:13.086376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.086392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.476 [2024-10-07 13:35:13.096816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.096859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.476 [2024-10-07 13:35:13.097100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.097129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.476 [2024-10-07 13:35:13.097146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.097236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.476 [2024-10-07 13:35:13.097261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.476 [2024-10-07 13:35:13.097277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.476 [2024-10-07 13:35:13.097388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.476 [2024-10-07 13:35:13.097415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.097546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.097569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.097584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.097602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.097616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.097629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.097745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.097767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.106936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.106983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.107165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.107194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.477 [2024-10-07 13:35:13.107211] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.107378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.107405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.477 [2024-10-07 13:35:13.107420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.107439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.107714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.107741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.107756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.107793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.107933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.107956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.107970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.107983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.108088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.117383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.117415] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.117671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.117700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.477 [2024-10-07 13:35:13.117718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.117815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.117840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.477 [2024-10-07 13:35:13.117856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.117880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.117900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.117921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.117937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.117950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.117966] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.117981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.117993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.118019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.118034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.129673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.129723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.129933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.129963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.477 [2024-10-07 13:35:13.129980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.130087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.130114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.477 [2024-10-07 13:35:13.130136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.130338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.130366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.130596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.130631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.130646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.130664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.130679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.130692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.130742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.130779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.141079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.141122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.141380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.141409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.477 [2024-10-07 13:35:13.141426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.141573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.141601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.477 [2024-10-07 13:35:13.141618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.477 [2024-10-07 13:35:13.141729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.141756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.477 [2024-10-07 13:35:13.141887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.141908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.141921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.141938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.477 [2024-10-07 13:35:13.141953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.477 [2024-10-07 13:35:13.141965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.477 [2024-10-07 13:35:13.142085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.142107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.477 [2024-10-07 13:35:13.151202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.151255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.477 [2024-10-07 13:35:13.151507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.477 [2024-10-07 13:35:13.151537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.478 [2024-10-07 13:35:13.151554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.151679] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.151706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.478 [2024-10-07 13:35:13.151722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.151741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.151766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.151799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.151812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.151824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.151848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.151865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.151878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.151890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.151911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.161291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.161543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.161574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.478 [2024-10-07 13:35:13.161592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.161798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.161863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.161897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.161913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.161926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.161949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.162065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.162090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.478 [2024-10-07 13:35:13.162105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.162282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.162337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.162357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.162371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.162395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.175987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.176242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.176395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.176434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.478 [2024-10-07 13:35:13.176450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.176840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.176879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.478 [2024-10-07 13:35:13.176896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.176914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.177119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.177149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.177162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.177176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.177372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.177396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.177409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.177422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.177506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.191045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.191152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.191368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.191397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.478 [2024-10-07 13:35:13.191414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.191541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.191569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.478 [2024-10-07 13:35:13.191585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.191609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.191635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.191664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.191676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.191690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.191714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.191731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.191745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.191758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.191795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.205991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.206024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.206373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.206403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.478 [2024-10-07 13:35:13.206419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.206555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.206583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.478 [2024-10-07 13:35:13.206599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.206939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.206967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.207171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.207193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.207207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.207224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.478 [2024-10-07 13:35:13.207238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.478 [2024-10-07 13:35:13.207251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.478 [2024-10-07 13:35:13.207311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.207341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.478 [2024-10-07 13:35:13.220853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.220886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.478 [2024-10-07 13:35:13.221180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.221209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.478 [2024-10-07 13:35:13.221226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.221341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.478 [2024-10-07 13:35:13.221367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.478 [2024-10-07 13:35:13.221382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.478 [2024-10-07 13:35:13.221407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.478 [2024-10-07 13:35:13.221428] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.221462] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.221504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.221519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.221537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.221553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.221565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.221590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.221618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.233710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.233743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.234374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.234403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.479 [2024-10-07 13:35:13.234420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.234553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.234580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.479 [2024-10-07 13:35:13.234596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.234835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.234863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.234910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.234930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.234944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.234960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.234980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.234993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.235018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.235034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.247208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.247247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.247792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.247822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.479 [2024-10-07 13:35:13.247839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.247967] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.247993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.479 [2024-10-07 13:35:13.248009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.248257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.248286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.248503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.248528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.248543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.248560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.248575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.248588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.248648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.248668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.257527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.257560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.257872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.257901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.479 [2024-10-07 13:35:13.257918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.258054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.258079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.479 [2024-10-07 13:35:13.258095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.258200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.258231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.261285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.261311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.261326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.261343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.261366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.261378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.262751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.262797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.267662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.267703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.267913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.267941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.479 [2024-10-07 13:35:13.267958] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.268052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.268076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.479 [2024-10-07 13:35:13.268092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.268116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.268148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.268169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.268184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.268207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.268223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.479 [2024-10-07 13:35:13.268237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.479 [2024-10-07 13:35:13.268250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.479 [2024-10-07 13:35:13.268273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.268289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.479 [2024-10-07 13:35:13.279623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.279657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.479 [2024-10-07 13:35:13.279860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.279894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.479 [2024-10-07 13:35:13.279911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.280024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.479 [2024-10-07 13:35:13.280050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.479 [2024-10-07 13:35:13.280066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.479 [2024-10-07 13:35:13.280238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.280268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.479 [2024-10-07 13:35:13.280462] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.280509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.280536] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.280554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.280569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.280583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.280633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.280657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.294418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.294451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.294864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.294894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.480 [2024-10-07 13:35:13.294911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.295016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.295042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.480 [2024-10-07 13:35:13.295057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.295249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.295277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.295481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.295514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.295529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.295546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.295561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.295588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.295639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.295659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.310015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.310048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.310428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.310459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.480 [2024-10-07 13:35:13.310500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.310616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.310643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.480 [2024-10-07 13:35:13.310659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.310882] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.310916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.311105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.311127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.311141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.311158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.311172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.311185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.311397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.311421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.324174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.324205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.324420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.324449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.480 [2024-10-07 13:35:13.324480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.324609] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.324636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.480 [2024-10-07 13:35:13.324652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.324677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.324699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.324726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.324741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.324755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.324772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.324787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.324823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.324847] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.324864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.334283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.334341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.334589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.334619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.480 [2024-10-07 13:35:13.334637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.337238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.337269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.480 [2024-10-07 13:35:13.337286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.337304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.339501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.339531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.339545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.339559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.339662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.339696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.339709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.339723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.339747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.344376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.344557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.344588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.480 [2024-10-07 13:35:13.344613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.344657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.344689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.480 [2024-10-07 13:35:13.344717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.344740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.344754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.344793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.344990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.480 [2024-10-07 13:35:13.345017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.480 [2024-10-07 13:35:13.345033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.480 [2024-10-07 13:35:13.345058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.480 [2024-10-07 13:35:13.345080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.480 [2024-10-07 13:35:13.345095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.480 [2024-10-07 13:35:13.345108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.480 [2024-10-07 13:35:13.345131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.480 [2024-10-07 13:35:13.355815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.355919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.356023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.356052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.481 [2024-10-07 13:35:13.356070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.356359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.356388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.481 [2024-10-07 13:35:13.356405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.356423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.356870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.356897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.356911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.356923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.357134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.357158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.357171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.357190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.357240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.366694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.366859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.367107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.367135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.481 [2024-10-07 13:35:13.367152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.367361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.367396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.481 [2024-10-07 13:35:13.367413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.367431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.367573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.367601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.367615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.367628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.367737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.367758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.367773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.367805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.370885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.376798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.376930] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.376959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.481 [2024-10-07 13:35:13.376981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.377008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.377049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.377069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.377083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.377111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.377131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.377342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.377376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.481 [2024-10-07 13:35:13.377395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.377420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.377444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.377459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.377505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.377536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.387689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.387766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.387923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.387951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.481 [2024-10-07 13:35:13.387968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.388496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.388537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.481 [2024-10-07 13:35:13.388555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.388574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.388804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.388830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.388845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.388859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.388920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.388940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.388967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.388980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.389151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.481 [2024-10-07 13:35:13.400897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.400929] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.481 [2024-10-07 13:35:13.401063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.401092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.481 [2024-10-07 13:35:13.401109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.401229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.481 [2024-10-07 13:35:13.401255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.481 [2024-10-07 13:35:13.401272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.481 [2024-10-07 13:35:13.401298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.401319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.481 [2024-10-07 13:35:13.401340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.401355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.481 [2024-10-07 13:35:13.401368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.481 [2024-10-07 13:35:13.401385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.481 [2024-10-07 13:35:13.401399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.401411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.401434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.401450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.416982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.417028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.417407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.417438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.482 [2024-10-07 13:35:13.417455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.417575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.417602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.482 [2024-10-07 13:35:13.417618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.417924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.417957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.418009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.418028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.418041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.418058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.418073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.418086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.418256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.418288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.431841] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.431873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.432046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.432079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.482 [2024-10-07 13:35:13.432095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.432214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.432240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.482 [2024-10-07 13:35:13.432257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.432722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.432751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.432988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.433012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.433026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.433053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.433068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.433080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.433349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.433373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.443402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.443435] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.443702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.443733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.482 [2024-10-07 13:35:13.443750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.443903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.443937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.482 [2024-10-07 13:35:13.443953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.446844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.446875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.447579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.447604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.447624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.447642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.447658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.447670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.448093] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.448118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.453518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.453565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.453682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.453709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.482 [2024-10-07 13:35:13.453726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.453987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.454021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.482 [2024-10-07 13:35:13.454038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.454057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.454194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.454219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.454233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.454245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.454384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.454408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.454422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.454435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.454582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.463601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.463805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.463835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.482 [2024-10-07 13:35:13.463851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.463887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.463918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.463951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.463967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.463992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.464014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.464185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.464211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.482 [2024-10-07 13:35:13.464228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.482 [2024-10-07 13:35:13.464252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.482 [2024-10-07 13:35:13.464275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.482 [2024-10-07 13:35:13.464290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.482 [2024-10-07 13:35:13.464304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.482 [2024-10-07 13:35:13.464327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.482 [2024-10-07 13:35:13.475763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.475812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.482 [2024-10-07 13:35:13.475956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.482 [2024-10-07 13:35:13.475983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.482 [2024-10-07 13:35:13.476008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.476162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.476189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.483 [2024-10-07 13:35:13.476205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.476239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.476259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.476279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.476294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.476307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.476323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.476337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.476350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.476373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.476389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.490216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.490255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.490583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.490614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.483 [2024-10-07 13:35:13.490632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.490750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.490791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.483 [2024-10-07 13:35:13.490818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.491018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.491046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.491235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.491258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.491272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.491290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.491304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.491317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.491537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.491562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.504482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.504524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.504718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.504749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.483 [2024-10-07 13:35:13.504767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.504921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.504947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.483 [2024-10-07 13:35:13.504963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.504988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.505009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.505043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.505072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.505086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.505108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.505123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.505136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.505159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.505176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.518884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.518916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.519041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.519068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.483 [2024-10-07 13:35:13.519085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.519199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.519225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.483 [2024-10-07 13:35:13.519241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.519265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.519286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.519307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.519321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.519335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.519351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.519365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.519378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.519401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.519418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.530096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.530128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.530464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.530519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.483 [2024-10-07 13:35:13.530536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.530794] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.530819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.483 [2024-10-07 13:35:13.530840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.530955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.530980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.531111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.531133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.531147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.531165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.531180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.483 [2024-10-07 13:35:13.531193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.483 [2024-10-07 13:35:13.531301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.531323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.483 [2024-10-07 13:35:13.540207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.540255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.483 [2024-10-07 13:35:13.540492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.540533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.483 [2024-10-07 13:35:13.540550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.540746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.483 [2024-10-07 13:35:13.540797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.483 [2024-10-07 13:35:13.540815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.483 [2024-10-07 13:35:13.540833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.540857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.483 [2024-10-07 13:35:13.540875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.483 [2024-10-07 13:35:13.540888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.540901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.540925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.540945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.540958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.540971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.540992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.550294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.550525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.550561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.484 [2024-10-07 13:35:13.550579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.550618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.550650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.550678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.550695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.550708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.550731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.550915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.550941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.484 [2024-10-07 13:35:13.550956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.550979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.551002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.551017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.551030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.551053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.562497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.562531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.562852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.562881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.484 [2024-10-07 13:35:13.562897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.563107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.563131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.484 [2024-10-07 13:35:13.563146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.564858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.564889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.565502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.565528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.565542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.565560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.565583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.565597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.565845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.565868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.573077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.573109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.573384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.573412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.484 [2024-10-07 13:35:13.573429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.573636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.573662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.484 [2024-10-07 13:35:13.573679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.575289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.575320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.575463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.575491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.575524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.575543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.575558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.575571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.578500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.578527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.583188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.583233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.583426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.583453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.484 [2024-10-07 13:35:13.583483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.584940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.584969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.484 [2024-10-07 13:35:13.584985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.585009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.585222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.585247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.585261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.585274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.585434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.585458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.585473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.585498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.585614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.593270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.593465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.593517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.484 [2024-10-07 13:35:13.593538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.593730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.593809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.593841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.593857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.593871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.593894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.594120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.484 [2024-10-07 13:35:13.594145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.484 [2024-10-07 13:35:13.594161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.484 [2024-10-07 13:35:13.594333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.484 [2024-10-07 13:35:13.594403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.484 [2024-10-07 13:35:13.594423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.484 [2024-10-07 13:35:13.594437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.484 [2024-10-07 13:35:13.594461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.484 [2024-10-07 13:35:13.604925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.605057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.484 [2024-10-07 13:35:13.605287] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.605320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.485 [2024-10-07 13:35:13.605337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.608481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.608529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.485 [2024-10-07 13:35:13.608546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.608566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.609320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.609348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.609362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.609375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.609779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.609803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.609816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.609829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.610067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.615012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.615228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.615256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.485 [2024-10-07 13:35:13.615273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.615297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.615336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.615355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.615369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.615394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.615413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.615628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.615665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.485 [2024-10-07 13:35:13.615680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.615704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.615729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.615749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.615763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.615801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.625094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.625321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.625349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.485 [2024-10-07 13:35:13.625366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.625390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.625416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.625433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.625447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.625494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.625534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.625738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.625765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.485 [2024-10-07 13:35:13.625781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.625820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.625842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.625857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.625871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.625893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.639099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.639133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.639289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.639334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.485 [2024-10-07 13:35:13.639351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.639445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.639470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.485 [2024-10-07 13:35:13.639508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.640382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.640420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.640636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.640662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.640678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.640697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.640712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.640726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.640980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.641003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.485 [2024-10-07 13:35:13.653723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.653759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.485 [2024-10-07 13:35:13.654209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.654240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.485 [2024-10-07 13:35:13.654273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.654429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.485 [2024-10-07 13:35:13.654456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.485 [2024-10-07 13:35:13.654498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.485 [2024-10-07 13:35:13.654805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.654839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.485 [2024-10-07 13:35:13.654973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.654997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.485 [2024-10-07 13:35:13.655012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.485 [2024-10-07 13:35:13.655029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.485 [2024-10-07 13:35:13.655045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.655059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.655289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.655312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.667827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.667876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.668170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.668200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.486 [2024-10-07 13:35:13.668223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.668443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.668482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.486 [2024-10-07 13:35:13.668514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.668558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.668583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.668605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.668621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.668634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.668651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.668667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.668680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.668704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.668720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.681533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.681568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.681895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.681926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.486 [2024-10-07 13:35:13.681944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.682117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.682143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.486 [2024-10-07 13:35:13.682159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.682201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.682225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.682247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.682262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.682275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.682291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.682316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.682329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.682358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.682383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.693162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.693195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.695198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.695229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.486 [2024-10-07 13:35:13.695247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.695417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.695441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.486 [2024-10-07 13:35:13.695476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.696270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.696300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.696566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.696590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.696604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.696623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.696638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.696651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.696702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.696724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.703276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.703323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.703585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.703620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.486 [2024-10-07 13:35:13.703637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.706276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.706306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.486 [2024-10-07 13:35:13.706323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.706352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.707118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.707151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.707166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.707180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.707339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.707362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.707387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.707399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.707532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.713360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.713589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.713620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.486 [2024-10-07 13:35:13.713637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.713674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.713706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.713735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.713751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.713776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.713815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.713990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.714015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.486 [2024-10-07 13:35:13.714030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.486 [2024-10-07 13:35:13.714054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.486 [2024-10-07 13:35:13.714078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.486 [2024-10-07 13:35:13.714092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.486 [2024-10-07 13:35:13.714105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.486 [2024-10-07 13:35:13.714128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.486 [2024-10-07 13:35:13.724886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.724919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.486 [2024-10-07 13:35:13.725104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.486 [2024-10-07 13:35:13.725133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.487 [2024-10-07 13:35:13.725150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.725265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.725291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.487 [2024-10-07 13:35:13.725307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.725332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.725353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.725374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.725389] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.725403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.725420] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.725436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.725448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.725497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.725516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.740342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.740378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.740599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.740628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.487 [2024-10-07 13:35:13.740645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.740766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.740818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.487 [2024-10-07 13:35:13.740834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.740858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.740879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.740899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.740914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.740927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.740943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.740958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.740970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.740993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.741017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.755074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.755108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.755463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.755517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.487 [2024-10-07 13:35:13.755538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.755640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.755667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.487 [2024-10-07 13:35:13.755683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.755904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.755933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.756128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.756153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.756167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.756186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.756200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.756213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.756261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.756281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.770054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.770088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.770690] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.770722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.487 [2024-10-07 13:35:13.770739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.770952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.770976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.487 [2024-10-07 13:35:13.770992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.771259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.771289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.771349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.771369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.771388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.771407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.771422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.771435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.771638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.771662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 8581.00 IOPS, 33.52 MiB/s [2024-10-07T11:35:19.420Z] [2024-10-07 13:35:13.784685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.784719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.784881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.784917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.487 [2024-10-07 13:35:13.784933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.785051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.785076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.487 [2024-10-07 13:35:13.785092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.785116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.785137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.785158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.785173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.785186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.785203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.785218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.785231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.785255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.785271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.800012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.800047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.487 [2024-10-07 13:35:13.800613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.800645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.487 [2024-10-07 13:35:13.800663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.800782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.487 [2024-10-07 13:35:13.800811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.487 [2024-10-07 13:35:13.800827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.487 [2024-10-07 13:35:13.801205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.801235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.487 [2024-10-07 13:35:13.801439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.801463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.801477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.801520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.487 [2024-10-07 13:35:13.801538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.487 [2024-10-07 13:35:13.801551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.487 [2024-10-07 13:35:13.801602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.487 [2024-10-07 13:35:13.801622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.815388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.815420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.815706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.815733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.488 [2024-10-07 13:35:13.815750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.815892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.815919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.488 [2024-10-07 13:35:13.815934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.815958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.815978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.815998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.816013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.816025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.816041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.816056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.816068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.816091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.816107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.827396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.827429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.829621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.829653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.488 [2024-10-07 13:35:13.829671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.829922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.829946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.488 [2024-10-07 13:35:13.829961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.830656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.830687] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.831070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.831095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.831109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.831127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.831142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.831154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.831215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.831235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.837707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.837740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.838429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.838458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.488 [2024-10-07 13:35:13.838500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.838597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.838621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.488 [2024-10-07 13:35:13.838644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.838692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.838717] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.838739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.838754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.838788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.838805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.838820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.838833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.838856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.838873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.847821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.847868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.848084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.848112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.488 [2024-10-07 13:35:13.848128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.848557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.848586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.488 [2024-10-07 13:35:13.848604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.848622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.848673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.848695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.848708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.848721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.848746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.848763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.848802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.848816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.848838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.859671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.859706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.859888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.859915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.488 [2024-10-07 13:35:13.859948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.860074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.860102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.488 [2024-10-07 13:35:13.860124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.860150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.860172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.860194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.860210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.860239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.860257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.860271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.860284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.860309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.860325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.869802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.869849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.488 [2024-10-07 13:35:13.870103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.870132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.488 [2024-10-07 13:35:13.870148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.870311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.488 [2024-10-07 13:35:13.870337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.488 [2024-10-07 13:35:13.870353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.488 [2024-10-07 13:35:13.870371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.875108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.488 [2024-10-07 13:35:13.875138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.875152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.488 [2024-10-07 13:35:13.875165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.488 [2024-10-07 13:35:13.875802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.488 [2024-10-07 13:35:13.875831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.488 [2024-10-07 13:35:13.875860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.875876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.876084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.879886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.880254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.880283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.489 [2024-10-07 13:35:13.880301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.880575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.880644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.880679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.880697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.880712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.880738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.880869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.880897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.489 [2024-10-07 13:35:13.880915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.881104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.881163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.881185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.881199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.881223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.894655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.894705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.894858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.894885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.489 [2024-10-07 13:35:13.894902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.895063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.895088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.489 [2024-10-07 13:35:13.895105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.895123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.895148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.895166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.895180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.895192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.895222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.895239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.895252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.895264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.895286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.905200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.905232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.905430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.905458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.489 [2024-10-07 13:35:13.905499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.905621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.905648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.489 [2024-10-07 13:35:13.905664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.905790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.905817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.905918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.905939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.905953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.905970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.905984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.905997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.908894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.908920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.917920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.917952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.918776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.918820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.489 [2024-10-07 13:35:13.918837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.918981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.919007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.489 [2024-10-07 13:35:13.919023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.921551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.921582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.922335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.922371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.922386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.922403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.922418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.922431] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.922855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.922880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.928031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.928077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.928293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.928321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.489 [2024-10-07 13:35:13.928337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.928553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.928579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.489 [2024-10-07 13:35:13.928604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.489 [2024-10-07 13:35:13.928622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.928648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.489 [2024-10-07 13:35:13.928666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.928680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.928693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.928716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.928733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.489 [2024-10-07 13:35:13.928746] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.489 [2024-10-07 13:35:13.928759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.489 [2024-10-07 13:35:13.928796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.489 [2024-10-07 13:35:13.938601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.938634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.489 [2024-10-07 13:35:13.938849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.489 [2024-10-07 13:35:13.938876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.490 [2024-10-07 13:35:13.938901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.939086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.939110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.490 [2024-10-07 13:35:13.939125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.939298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.939326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.939545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.939581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.939595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.939613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.939627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.939648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.939875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.939900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.952580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.952614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.953146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.953176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.490 [2024-10-07 13:35:13.953192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.953279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.953303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.490 [2024-10-07 13:35:13.953318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.953552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.953582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.953807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.953830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.953844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.953862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.953877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.953895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.953945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.953965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.967861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.967894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.968262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.968292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.490 [2024-10-07 13:35:13.968309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.968443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.968483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.490 [2024-10-07 13:35:13.968511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.968857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.968885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.969084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.969107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.969121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.969138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.969152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.969166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.969214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.969234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.982134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.982181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.982332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.982360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.490 [2024-10-07 13:35:13.982378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.982480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.982512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.490 [2024-10-07 13:35:13.982528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.982553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.982580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.982602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.982617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.982630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.982647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.982663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.982677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.982701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.982717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.997600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.997635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:13.997961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.997991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.490 [2024-10-07 13:35:13.998008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.998183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:13.998207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.490 [2024-10-07 13:35:13.998222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:13.998247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.998268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:13.998289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.998304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.998317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.998333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:13.998348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:13.998361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:13.998385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:13.998401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:14.013012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:14.013046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.490 [2024-10-07 13:35:14.013420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:14.013451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.490 [2024-10-07 13:35:14.013498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:14.013608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.490 [2024-10-07 13:35:14.013633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.490 [2024-10-07 13:35:14.013649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.490 [2024-10-07 13:35:14.013860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:14.013889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.490 [2024-10-07 13:35:14.013937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:14.013956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:14.013969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:14.013986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.490 [2024-10-07 13:35:14.014000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.490 [2024-10-07 13:35:14.014013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.490 [2024-10-07 13:35:14.014184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.490 [2024-10-07 13:35:14.014206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.027737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.027785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.028043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.028071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.491 [2024-10-07 13:35:14.028088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.028325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.028351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.491 [2024-10-07 13:35:14.028366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.028390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.028410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.028432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.028447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.028460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.028501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.028518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.028537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.028562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.028579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.042722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.042757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.043035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.043064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.491 [2024-10-07 13:35:14.043081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.043300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.043327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.491 [2024-10-07 13:35:14.043343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.043367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.043388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.043408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.043423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.043436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.043453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.043481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.043504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.043531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.043547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.055971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.056004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.056393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.056429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.491 [2024-10-07 13:35:14.056446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.056564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.056592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.491 [2024-10-07 13:35:14.056608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.056824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.056854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.056910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.056929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.056943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.056959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.056973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.056987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.057011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.057027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.068349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.068381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.068716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.068746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.491 [2024-10-07 13:35:14.068763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.068873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.068905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.491 [2024-10-07 13:35:14.068920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.071409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.071440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.072120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.072145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.072159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.072177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.072191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.072204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.072827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.072853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.078458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.078529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.078693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.078721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.491 [2024-10-07 13:35:14.078738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.078923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.078959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.491 [2024-10-07 13:35:14.078975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.078993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.079017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.079035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.079048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.079060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.079083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.079100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.079112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.079125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.081603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.491 [2024-10-07 13:35:14.088698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.088730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.491 [2024-10-07 13:35:14.088962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.088990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.491 [2024-10-07 13:35:14.089006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.089169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.491 [2024-10-07 13:35:14.089194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.491 [2024-10-07 13:35:14.089210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.491 [2024-10-07 13:35:14.089234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.089255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.491 [2024-10-07 13:35:14.089275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.089290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.089303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.491 [2024-10-07 13:35:14.089319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.491 [2024-10-07 13:35:14.089333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.491 [2024-10-07 13:35:14.089346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.089370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.089391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.100475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.100532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.100978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.101008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.492 [2024-10-07 13:35:14.101025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.101143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.101169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.492 [2024-10-07 13:35:14.101186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.101381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.101410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.101630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.101655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.101671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.101690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.101706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.101719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.101769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.101790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.110615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.111981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.112188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.112215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.492 [2024-10-07 13:35:14.112231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.116813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.116844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.492 [2024-10-07 13:35:14.116862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.116881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.116975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.116999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.117017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.117031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.117056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.117072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.117085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.117098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.117120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.122297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.122667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.122708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.492 [2024-10-07 13:35:14.122726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.122860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.122898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.123199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.123226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.492 [2024-10-07 13:35:14.123242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.123257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.123269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.123282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.123320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.123343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.123366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.123381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.123394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.123416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.132383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.132641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.132672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.492 [2024-10-07 13:35:14.132690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.132721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.132749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.132774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.132803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.132828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.132945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.133166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.133193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.492 [2024-10-07 13:35:14.133209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.133235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.133259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.133274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.133287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.133312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.146093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.146127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.146346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.146374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.492 [2024-10-07 13:35:14.146391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.146589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.146616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.492 [2024-10-07 13:35:14.146632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.146986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.147017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.147077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.147098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.147113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.147131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.147146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.147159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.147350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.147372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.161080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.161114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.161303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.161330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.492 [2024-10-07 13:35:14.161346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.161454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.492 [2024-10-07 13:35:14.161479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.492 [2024-10-07 13:35:14.161518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.492 [2024-10-07 13:35:14.161545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.161566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.492 [2024-10-07 13:35:14.161588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.161603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.161616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.161632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.492 [2024-10-07 13:35:14.161652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.492 [2024-10-07 13:35:14.161665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.492 [2024-10-07 13:35:14.161690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.161707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.492 [2024-10-07 13:35:14.175444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.492 [2024-10-07 13:35:14.175502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.176553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.176586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.493 [2024-10-07 13:35:14.176604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.176742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.176783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.493 [2024-10-07 13:35:14.176800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.177221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.177252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.177452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.177501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.177523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.177542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.177558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.177571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.178023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.178049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.190974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.191008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.191209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.191237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.493 [2024-10-07 13:35:14.191254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.191491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.191526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.493 [2024-10-07 13:35:14.191542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.191870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.191900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.191958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.191977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.191991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.192009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.192023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.192036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.192207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.192229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.205290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.205323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.205531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.205560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.493 [2024-10-07 13:35:14.205577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.205763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.205804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.493 [2024-10-07 13:35:14.205826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.205851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.205872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.205892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.205908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.205921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.205937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.205954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.205967] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.205991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.206007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.219202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.220069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.220220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.220247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.493 [2024-10-07 13:35:14.220263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.220503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.220529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.493 [2024-10-07 13:35:14.220545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.220563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.220589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.220607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.220621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.220634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.220659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.220676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.220689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.220703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.220724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.230078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.230377] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.230409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.493 [2024-10-07 13:35:14.230426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.230581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.230703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.230736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.230752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.230765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.230889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.231075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.231101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.493 [2024-10-07 13:35:14.231116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.231225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.231335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.493 [2024-10-07 13:35:14.231355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.493 [2024-10-07 13:35:14.231368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.493 [2024-10-07 13:35:14.231501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.493 [2024-10-07 13:35:14.240168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.493 [2024-10-07 13:35:14.240389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.493 [2024-10-07 13:35:14.240416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.493 [2024-10-07 13:35:14.240433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.493 [2024-10-07 13:35:14.240457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.493 [2024-10-07 13:35:14.240514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.240533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.240546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.240571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.240794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.241042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.241069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.494 [2024-10-07 13:35:14.241084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.241108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.241137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.241152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.241165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.241189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.250251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.250453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.250504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.494 [2024-10-07 13:35:14.250524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.250549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.250573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.250588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.250601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.250625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.250868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.251074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.251113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.494 [2024-10-07 13:35:14.251129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.251153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.251291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.251314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.251330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.251481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.264418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.264449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.264645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.264673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.494 [2024-10-07 13:35:14.264690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.264823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.264849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.494 [2024-10-07 13:35:14.264865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.264895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.264917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.264937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.264952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.264965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.264982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.264996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.265008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.265031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.265058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.274803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.274837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.277205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.277245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.494 [2024-10-07 13:35:14.277262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.277422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.277459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.494 [2024-10-07 13:35:14.277502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.278451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.278480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.278759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.278782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.278812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.278830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.278844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.278856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.279115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.279138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.285129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.285161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.285484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.285520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.494 [2024-10-07 13:35:14.285538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.285662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.285688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.494 [2024-10-07 13:35:14.285704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.285833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.285859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.285892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.285925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.285939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.285958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.285988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.286003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.286029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.286045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.295300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.295332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.295503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.295532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.494 [2024-10-07 13:35:14.295549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.295696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.295722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.494 [2024-10-07 13:35:14.295738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.295927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.295954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.296000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.296019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.296033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.296050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.296070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.494 [2024-10-07 13:35:14.296083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.494 [2024-10-07 13:35:14.296107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.296124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.494 [2024-10-07 13:35:14.308179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.308447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.494 [2024-10-07 13:35:14.308685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.308713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.494 [2024-10-07 13:35:14.308730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.308952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.494 [2024-10-07 13:35:14.308980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.494 [2024-10-07 13:35:14.308996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.494 [2024-10-07 13:35:14.309015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.309199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.494 [2024-10-07 13:35:14.309224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.494 [2024-10-07 13:35:14.309238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.309251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.309439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.309463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.309502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.309517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.309562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.318927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.318960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.321114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.321145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.495 [2024-10-07 13:35:14.321162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.321388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.321412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.495 [2024-10-07 13:35:14.321427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.322362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.322397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.322672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.322695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.322710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.322727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.322742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.322755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.323028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.323052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.329449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.329503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.329703] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.329731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.495 [2024-10-07 13:35:14.329748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.329950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.329975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.495 [2024-10-07 13:35:14.329990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.330015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.330034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.330056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.330072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.330086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.330102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.330116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.330129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.330153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.330170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.339588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.339637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.339890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.339918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.495 [2024-10-07 13:35:14.339940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.340116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.340141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.495 [2024-10-07 13:35:14.340156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.340174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.340199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.340217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.340231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.340244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.340282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.340312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.340326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.340339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.340362] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.350640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.350674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.350869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.350897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.495 [2024-10-07 13:35:14.350913] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.351069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.351094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.495 [2024-10-07 13:35:14.351110] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.351135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.351156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.351177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.351192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.351205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.351221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.351236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.351259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.351284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.351300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.361035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.361068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.364413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.364445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.495 [2024-10-07 13:35:14.364462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.364576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.364601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.495 [2024-10-07 13:35:14.364618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.366073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.366104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.366616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.366642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.366658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.366676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.366691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.366705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.366939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.366961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.371146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.371193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.371396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.371425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.495 [2024-10-07 13:35:14.371441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.371563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.371597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.495 [2024-10-07 13:35:14.371613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.371633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.371659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.495 [2024-10-07 13:35:14.371683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.371698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.371711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.371736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.371753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.495 [2024-10-07 13:35:14.371782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.495 [2024-10-07 13:35:14.371795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.495 [2024-10-07 13:35:14.371818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.495 [2024-10-07 13:35:14.382458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.382499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.495 [2024-10-07 13:35:14.382725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.382754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.495 [2024-10-07 13:35:14.382771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.495 [2024-10-07 13:35:14.383006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.495 [2024-10-07 13:35:14.383030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.496 [2024-10-07 13:35:14.383046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.383070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.383108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.383131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.383145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.383159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.383176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.383191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.383204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.383228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.383254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.397815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.397863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.398089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.398118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.496 [2024-10-07 13:35:14.398134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.398325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.398350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.496 [2024-10-07 13:35:14.398367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.398392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.398413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.398435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.398450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.398463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.398480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.398524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.398540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.398566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.398583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.412416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.412450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.413456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.413513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.496 [2024-10-07 13:35:14.413533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.413725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.413751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.496 [2024-10-07 13:35:14.413768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.414173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.414203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.414408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.414432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.414447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.414465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.414480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.414518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.414721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.414750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.422545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.422577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.423126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.423155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.496 [2024-10-07 13:35:14.423172] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.423336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.423360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.496 [2024-10-07 13:35:14.423375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.423629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.423657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.423680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.423696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.423710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.423727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.423741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.423755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.426221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.426247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.432692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.432724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.432862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.432888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.496 [2024-10-07 13:35:14.432905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.433018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.433044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.496 [2024-10-07 13:35:14.433060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.433234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.433262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.433309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.433333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.433347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.433365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.433379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.433392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.433416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.433432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.445906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.445938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.446134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.446165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.496 [2024-10-07 13:35:14.446182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.446303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.446329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.496 [2024-10-07 13:35:14.446345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.496 [2024-10-07 13:35:14.446545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.446574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.496 [2024-10-07 13:35:14.446784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.446807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.446822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.446838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.496 [2024-10-07 13:35:14.446853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.496 [2024-10-07 13:35:14.446865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.496 [2024-10-07 13:35:14.446914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.446933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.496 [2024-10-07 13:35:14.460569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.460603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.496 [2024-10-07 13:35:14.460956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.496 [2024-10-07 13:35:14.460986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.497 [2024-10-07 13:35:14.461003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.461145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.461176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.497 [2024-10-07 13:35:14.461192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.461386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.461414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.461460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.461506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.461521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.461540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.461555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.461568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.461745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.461769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.475301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.475332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.475495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.475525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.497 [2024-10-07 13:35:14.475542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.475664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.475691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.497 [2024-10-07 13:35:14.475707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.475732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.475753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.475775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.475790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.475818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.475835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.475850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.475862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.475886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.475903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.488213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.488246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.489878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.489909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.497 [2024-10-07 13:35:14.489926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.490042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.490066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.497 [2024-10-07 13:35:14.490082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.490140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.490165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.490186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.490202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.490214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.490231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.490246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.490259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.490282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.490299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.499821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.499853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.500106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.500135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.497 [2024-10-07 13:35:14.500153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.500313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.500338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.497 [2024-10-07 13:35:14.500354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.500475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.500516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.497 [2024-10-07 13:35:14.500625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.500646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.500666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.500685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.497 [2024-10-07 13:35:14.500700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.497 [2024-10-07 13:35:14.500713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.497 [2024-10-07 13:35:14.504322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.504348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.497 [2024-10-07 13:35:14.509933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.509979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.497 [2024-10-07 13:35:14.510093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.497 [2024-10-07 13:35:14.510122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.497 [2024-10-07 13:35:14.510139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.497 [2024-10-07 13:35:14.510275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.510301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.498 [2024-10-07 13:35:14.510317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.510334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.511825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.511853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.511870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.511883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.512004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.512026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.512040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.512053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.512159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.520018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.520172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.520201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.498 [2024-10-07 13:35:14.520219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.520256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.520287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.520315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.520336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.520350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.520374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.521250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.521283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.498 [2024-10-07 13:35:14.521301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.521576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.521724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.521748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.521763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.521804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.531791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.531824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.531975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.532004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.498 [2024-10-07 13:35:14.532022] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.532112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.532136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.498 [2024-10-07 13:35:14.532152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.532176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.532197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.532216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.532231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.532245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.532261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.532275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.532288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.532311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.532326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.542314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.542352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.546520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.546553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.498 [2024-10-07 13:35:14.546571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.546674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.546699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.498 [2024-10-07 13:35:14.546716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.546807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.546834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.546856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.546871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.546885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.546902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.546916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.546929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.546952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.546969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.553290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.553321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.553494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.553524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.498 [2024-10-07 13:35:14.553542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.553668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.553695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.498 [2024-10-07 13:35:14.553711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.554231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.554258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.498 [2024-10-07 13:35:14.554280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.554295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.554309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.554330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.498 [2024-10-07 13:35:14.554345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.498 [2024-10-07 13:35:14.554357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.498 [2024-10-07 13:35:14.554381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.554397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.498 [2024-10-07 13:35:14.563790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.563838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.498 [2024-10-07 13:35:14.563973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.564002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.498 [2024-10-07 13:35:14.564019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.498 [2024-10-07 13:35:14.564139] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.498 [2024-10-07 13:35:14.564166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.498 [2024-10-07 13:35:14.564182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.564205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.564226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.564247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.564262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.564275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.564291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.564306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.564318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.564342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.564358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.574549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.574582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.574708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.574754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.499 [2024-10-07 13:35:14.574772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.574910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.574936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.499 [2024-10-07 13:35:14.574952] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.574982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.575003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.575023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.575037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.575050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.575067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.575082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.575094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.575117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.575133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.590004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.590038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.590240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.590269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.499 [2024-10-07 13:35:14.590286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.590411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.590436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.499 [2024-10-07 13:35:14.590452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.590500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.590524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.590545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.590560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.590574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.590591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.590606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.590619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.590954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.590978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.601464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.601521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.601739] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.601769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.499 [2024-10-07 13:35:14.601802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.601899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.601926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.499 [2024-10-07 13:35:14.601941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.602048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.602074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.604796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.604822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.604837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.604854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.604869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.604881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.605907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.605933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.611608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.611655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.611813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.611841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.499 [2024-10-07 13:35:14.611858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.611985] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.612012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.499 [2024-10-07 13:35:14.612028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.612046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.612072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.612089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.612102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.612115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.612139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.612160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.499 [2024-10-07 13:35:14.612174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.499 [2024-10-07 13:35:14.612187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.499 [2024-10-07 13:35:14.612209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.499 [2024-10-07 13:35:14.621693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.621860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.499 [2024-10-07 13:35:14.621889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.499 [2024-10-07 13:35:14.621906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.499 [2024-10-07 13:35:14.621943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.499 [2024-10-07 13:35:14.621974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.499 [2024-10-07 13:35:14.622001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.622017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.622030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.622053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.622174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.622199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.500 [2024-10-07 13:35:14.622215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.622239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.622262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.622277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.622289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.622312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.633904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.634216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.634388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.634417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.500 [2024-10-07 13:35:14.634434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.634741] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.634785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.500 [2024-10-07 13:35:14.634802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.634822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.635098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.635125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.635139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.635151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.635216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.635252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.635271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.635285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.635483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.647222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.647255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.647512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.647542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.500 [2024-10-07 13:35:14.647560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.647704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.647732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.500 [2024-10-07 13:35:14.647748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.647773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.647795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.647832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.647847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.647861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.647877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.647892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.647904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.647928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.647945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.658437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.658492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.658619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.658649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.500 [2024-10-07 13:35:14.658673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.658797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.658839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.500 [2024-10-07 13:35:14.658855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.658879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.658901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.658922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.658936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.658950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.658967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.658981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.658995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.659019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.659034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.668589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.668622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.668763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.668806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.500 [2024-10-07 13:35:14.668823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.668969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.668995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.500 [2024-10-07 13:35:14.669011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.669035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.669057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.669078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.669092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.669105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.669121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.669135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.500 [2024-10-07 13:35:14.669153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.500 [2024-10-07 13:35:14.669178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.669194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.500 [2024-10-07 13:35:14.678704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.678752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.500 [2024-10-07 13:35:14.678933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.678961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.500 [2024-10-07 13:35:14.678978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.679133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.500 [2024-10-07 13:35:14.679159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.500 [2024-10-07 13:35:14.679175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.500 [2024-10-07 13:35:14.679193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.679218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.500 [2024-10-07 13:35:14.679236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.500 [2024-10-07 13:35:14.679249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.679261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.679286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.679303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.679316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.679329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.679350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.688804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.688957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.688986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.501 [2024-10-07 13:35:14.689004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.689041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.689071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.689099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.689114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.689128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.689151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.689301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.689328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.501 [2024-10-07 13:35:14.689345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.689369] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.689392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.689406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.689420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.689443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.700761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.700809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.701408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.701438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.501 [2024-10-07 13:35:14.701454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.701625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.701652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.501 [2024-10-07 13:35:14.701669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.701959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.701987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.702034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.702053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.702066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.702083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.702097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.702109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.702148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.702167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.712571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.712605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.712937] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.712967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.501 [2024-10-07 13:35:14.712990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.713115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.713142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.501 [2024-10-07 13:35:14.713158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.713350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.713378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.713424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.713443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.713456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.713474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.713510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.713527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.713554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.713572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.722903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.722935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.723106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.723135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.501 [2024-10-07 13:35:14.723153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.723270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.723296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.501 [2024-10-07 13:35:14.723312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.726060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.726090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.727079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.727104] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.727118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.727135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.727149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.727162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.727860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.727885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.733239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.733268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.733413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.733441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.501 [2024-10-07 13:35:14.733458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.733602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.501 [2024-10-07 13:35:14.733629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.501 [2024-10-07 13:35:14.733646] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.501 [2024-10-07 13:35:14.733671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.733692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.501 [2024-10-07 13:35:14.733723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.733741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.733755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.733772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.501 [2024-10-07 13:35:14.733786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.501 [2024-10-07 13:35:14.733814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.501 [2024-10-07 13:35:14.733839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.733855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.501 [2024-10-07 13:35:14.743545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.501 [2024-10-07 13:35:14.743594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.743712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.743742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.502 [2024-10-07 13:35:14.743759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.743896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.743922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.502 [2024-10-07 13:35:14.743937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.743955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.744366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.744393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.744412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.744426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.744683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.744710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.744724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.744738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.744950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.756449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.756506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.756825] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.756855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.502 [2024-10-07 13:35:14.756872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.756958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.756981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.502 [2024-10-07 13:35:14.756997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.757189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.757217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.757440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.757463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.757477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.757522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.757540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.757553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.757607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.757628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.769325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.769357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.769992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.770021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.502 [2024-10-07 13:35:14.770038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.770189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.770216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.502 [2024-10-07 13:35:14.770232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.770599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.770629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.770860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.770883] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.770897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.770914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.770928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.770940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.770989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.771009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 8598.58 IOPS, 33.59 MiB/s [2024-10-07T11:35:19.435Z] [2024-10-07 13:35:14.780214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.780244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.780512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.780542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.502 [2024-10-07 13:35:14.780559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.780655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.780680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.502 [2024-10-07 13:35:14.780695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.781957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.781985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.784265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.784290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.784304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.784321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.784335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.784348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.784721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.784752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.790320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.790365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.502 [2024-10-07 13:35:14.790541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.790570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.502 [2024-10-07 13:35:14.790587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.790715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.502 [2024-10-07 13:35:14.790742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.502 [2024-10-07 13:35:14.790758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.502 [2024-10-07 13:35:14.790791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.792008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.502 [2024-10-07 13:35:14.792035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.502 [2024-10-07 13:35:14.792049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.502 [2024-10-07 13:35:14.792061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.502 [2024-10-07 13:35:14.792253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.502 [2024-10-07 13:35:14.792276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.792290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.792303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.792434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.800402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.800572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.800601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.503 [2024-10-07 13:35:14.800619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.800825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.800886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.800919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.800935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.800948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.800971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.801066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.801091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.503 [2024-10-07 13:35:14.801116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.801142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.801165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.801180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.801193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.801216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.812802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.812834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.813003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.813032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.503 [2024-10-07 13:35:14.813048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.813141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.813167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.503 [2024-10-07 13:35:14.813182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.813571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.813600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.813821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.813844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.813858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.813875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.813889] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.813902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.814330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.814354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.823478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.823519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.823761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.823792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.503 [2024-10-07 13:35:14.823823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.823943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.823968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.503 [2024-10-07 13:35:14.823990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.827092] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.827122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.827921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.827946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.827960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.827977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.827992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.828004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.828398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.828421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.833600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.833648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.833829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.833857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.503 [2024-10-07 13:35:14.833873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.833968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.833994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.503 [2024-10-07 13:35:14.834010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.834027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.834052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.834070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.834082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.834095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.834128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.834147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.834160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.834172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.834194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.843685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.844019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.844050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.503 [2024-10-07 13:35:14.844067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.844144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.844179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.844206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.844223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.844236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.844679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.844831] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.844858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.503 [2024-10-07 13:35:14.844874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.845080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.503 [2024-10-07 13:35:14.845135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.503 [2024-10-07 13:35:14.845155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.503 [2024-10-07 13:35:14.845169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.503 [2024-10-07 13:35:14.845193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.503 [2024-10-07 13:35:14.856209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.856242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.503 [2024-10-07 13:35:14.856798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.503 [2024-10-07 13:35:14.856828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.503 [2024-10-07 13:35:14.856844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.503 [2024-10-07 13:35:14.856960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.856984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.504 [2024-10-07 13:35:14.856999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.857203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.857231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.857442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.857465] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.857480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.857529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.857545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.857558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.857770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.857809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.866961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.866994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.870812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.870844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.504 [2024-10-07 13:35:14.870861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.871007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.871033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.504 [2024-10-07 13:35:14.871048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.872063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.872094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.872456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.872504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.872520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.872539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.872553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.872566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.872930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.872955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.877092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.877138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.877273] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.877301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.504 [2024-10-07 13:35:14.877318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.877860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.877888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.504 [2024-10-07 13:35:14.877909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.877928] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.877996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.878018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.878031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.878044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.878069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.878085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.878098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.878110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.878132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.887175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.887354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.887383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.504 [2024-10-07 13:35:14.887400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.887622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.887687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.887721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.887738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.887752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.887939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.888096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.888124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.504 [2024-10-07 13:35:14.888140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.888361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.888419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.888440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.888454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.888480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.901781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.901817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.902171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.902201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.504 [2024-10-07 13:35:14.902219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.902339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.902364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.504 [2024-10-07 13:35:14.902379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.902601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.902630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.902679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.902698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.902712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.902730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.902745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.902758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.504 [2024-10-07 13:35:14.902945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.902968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.504 [2024-10-07 13:35:14.915349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.915381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.504 [2024-10-07 13:35:14.915536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.915567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.504 [2024-10-07 13:35:14.915585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.915731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.504 [2024-10-07 13:35:14.915757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.504 [2024-10-07 13:35:14.915774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.504 [2024-10-07 13:35:14.915812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.915833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.504 [2024-10-07 13:35:14.915854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.504 [2024-10-07 13:35:14.915869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.504 [2024-10-07 13:35:14.915882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.915898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.915917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.915931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.915954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.915971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.927460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.927515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.927776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.927821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.505 [2024-10-07 13:35:14.927839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.927954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.927980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.505 [2024-10-07 13:35:14.927996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.928105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.928131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.928232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.928253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.928266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.928283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.928297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.928310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.928415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.928435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.937986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.938019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.938220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.938249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.505 [2024-10-07 13:35:14.938266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.938379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.938404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.505 [2024-10-07 13:35:14.938420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.938558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.938586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.938691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.938712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.938727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.938744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.938759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.938772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.938823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.938843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.948158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.948190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.948519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.948550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.505 [2024-10-07 13:35:14.948567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.948687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.948714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.505 [2024-10-07 13:35:14.948731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.948939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.948968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.949013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.949032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.949046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.949063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.949077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.949089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.949261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.949284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.961412] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.961445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.961842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.961877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.505 [2024-10-07 13:35:14.961894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.962016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.962040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.505 [2024-10-07 13:35:14.962056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.962318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.962347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.962569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.962594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.962609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.962626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.962641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.962654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.962704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.962724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.972220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.972252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.972511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.972541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.505 [2024-10-07 13:35:14.972560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.972685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.505 [2024-10-07 13:35:14.972712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.505 [2024-10-07 13:35:14.972728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.505 [2024-10-07 13:35:14.972852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.972879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.505 [2024-10-07 13:35:14.972981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.973002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.973016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.973033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.505 [2024-10-07 13:35:14.973048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.505 [2024-10-07 13:35:14.973066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.505 [2024-10-07 13:35:14.976248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.976274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.505 [2024-10-07 13:35:14.982331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.982376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.505 [2024-10-07 13:35:14.982527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:14.982555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.506 [2024-10-07 13:35:14.982572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:14.982667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:14.982693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.506 [2024-10-07 13:35:14.982709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:14.982728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:14.982753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:14.982771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:14.982784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:14.982797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:14.982822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:14.982839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:14.982867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:14.982880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:14.982902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:14.992413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:14.992591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:14.992622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.506 [2024-10-07 13:35:14.992639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:14.992677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:14.992709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:14.992737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:14.992753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:14.992767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:14.992811] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:14.992957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:14.992984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.506 [2024-10-07 13:35:14.993000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:14.993024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:14.993047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:14.993061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:14.993075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:14.993097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:15.004859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:15.004892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:15.005172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:15.005202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.506 [2024-10-07 13:35:15.005219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:15.005336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:15.005362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.506 [2024-10-07 13:35:15.005377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:15.005425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:15.005449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:15.005470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:15.005510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:15.005528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:15.005546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:15.005561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:15.005573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:15.005830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:15.005854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:15.016568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:15.016601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:15.016818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:15.016863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.506 [2024-10-07 13:35:15.016886] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:15.017037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:15.017065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.506 [2024-10-07 13:35:15.017097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:15.017225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:15.017253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:15.017373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:15.017394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:15.017407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:15.017425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:15.017439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:15.017451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:15.020558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:15.020585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.506 [2024-10-07 13:35:15.026682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:15.026728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.506 [2024-10-07 13:35:15.026906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:15.026934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.506 [2024-10-07 13:35:15.026950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:15.027101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.506 [2024-10-07 13:35:15.027126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.506 [2024-10-07 13:35:15.027141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.506 [2024-10-07 13:35:15.027159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:15.027184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.506 [2024-10-07 13:35:15.027201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.506 [2024-10-07 13:35:15.027215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.506 [2024-10-07 13:35:15.027227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.506 [2024-10-07 13:35:15.027251] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.027268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.027280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.027298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.027320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.036767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.036940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.036970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.507 [2024-10-07 13:35:15.036987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.037023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.037054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.037082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.037097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.037111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.037134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.037258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.037283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.507 [2024-10-07 13:35:15.037299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.037323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.037346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.037360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.037373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.037396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.048191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.048223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.048430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.048458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.507 [2024-10-07 13:35:15.048500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.048604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.048631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.507 [2024-10-07 13:35:15.048647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.048757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.048799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.048907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.048929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.048943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.048960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.048975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.048988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.051552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.051579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.058868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.058903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.059047] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.059074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.507 [2024-10-07 13:35:15.059091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.059210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.059237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.507 [2024-10-07 13:35:15.059253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.059277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.059297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.059317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.059332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.059345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.059361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.059375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.059388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.059411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.059426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.068982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.069035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.069238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.069266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.507 [2024-10-07 13:35:15.069283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.069755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.069785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.507 [2024-10-07 13:35:15.069818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.069837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.069887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.069908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.069921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.069934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.069981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.070000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.070014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.070026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.070049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.081595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.081635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.082013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.082042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.507 [2024-10-07 13:35:15.082060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.082208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.082233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.507 [2024-10-07 13:35:15.082249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.507 [2024-10-07 13:35:15.082439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.082467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.507 [2024-10-07 13:35:15.082683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.082717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.082731] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.082750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.507 [2024-10-07 13:35:15.082765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.507 [2024-10-07 13:35:15.082778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.507 [2024-10-07 13:35:15.082836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.082864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.507 [2024-10-07 13:35:15.096123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.096155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.507 [2024-10-07 13:35:15.096323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.507 [2024-10-07 13:35:15.096351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.508 [2024-10-07 13:35:15.096368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.096447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.096473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.508 [2024-10-07 13:35:15.096512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.096540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.096561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.096582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.096597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.096610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.096627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.096642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.096655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.096678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.096706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.106641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.106674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.110834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.110865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.508 [2024-10-07 13:35:15.110882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.110970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.110994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.508 [2024-10-07 13:35:15.111010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.111093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.111123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.111145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.111159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.111178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.111195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.111209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.111222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.111246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.111262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.117923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.117955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.118157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.118186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.508 [2024-10-07 13:35:15.118203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.118398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.118424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.508 [2024-10-07 13:35:15.118439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.118463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.118508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.118541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.118556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.118569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.118585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.118606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.118618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.118643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.118664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.128149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.128180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.128416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.128444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.508 [2024-10-07 13:35:15.128461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.128597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.128630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.508 [2024-10-07 13:35:15.128648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.128673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.128694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.128715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.128730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.128744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.128761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.128776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.128789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.128840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.128856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.139926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.139960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.140260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.140290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.508 [2024-10-07 13:35:15.140308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.140403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.140429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.508 [2024-10-07 13:35:15.140445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.140519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.140545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.140820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.140845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.140860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.140878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.508 [2024-10-07 13:35:15.140908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.508 [2024-10-07 13:35:15.140922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.508 [2024-10-07 13:35:15.140977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.141000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.508 [2024-10-07 13:35:15.153347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.153380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.508 [2024-10-07 13:35:15.155419] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.155451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.508 [2024-10-07 13:35:15.155468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.155633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.508 [2024-10-07 13:35:15.155660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.508 [2024-10-07 13:35:15.155677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.508 [2024-10-07 13:35:15.156308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.508 [2024-10-07 13:35:15.156337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.156735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.156760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.156774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.156817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.156831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.156844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.157049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.157072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.163530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.163561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.163733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.163762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.509 [2024-10-07 13:35:15.163779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.163929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.163955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.509 [2024-10-07 13:35:15.163971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.163994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.164015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.164035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.164049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.164068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.164085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.164099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.164119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.164142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.164158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.173642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.173691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.173833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.173862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.509 [2024-10-07 13:35:15.173878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.174047] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.174073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.509 [2024-10-07 13:35:15.174089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.174107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.174132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.174150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.174163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.174175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.174199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.174216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.174229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.174241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.174262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.185844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.185876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.186021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.186048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.509 [2024-10-07 13:35:15.186065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.186178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.186204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.509 [2024-10-07 13:35:15.186224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.186398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.186425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.186699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.186724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.186747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.186766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.186781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.186794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.187031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.187055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.200687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.200721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.200976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.201005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.509 [2024-10-07 13:35:15.201021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.201136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.201161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.509 [2024-10-07 13:35:15.201176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.201201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.201222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.201242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.201263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.201276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.201292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.201307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.201319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.201343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.201358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.509 [2024-10-07 13:35:15.211677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.211711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.509 [2024-10-07 13:35:15.213498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.213529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.509 [2024-10-07 13:35:15.213547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.213657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.509 [2024-10-07 13:35:15.213683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.509 [2024-10-07 13:35:15.213699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.509 [2024-10-07 13:35:15.215762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.215793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.509 [2024-10-07 13:35:15.216549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.216575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.216597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.216615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.509 [2024-10-07 13:35:15.216630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.509 [2024-10-07 13:35:15.216643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.509 [2024-10-07 13:35:15.217029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.217053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.221810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.221857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.222041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.222069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.510 [2024-10-07 13:35:15.222085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.222208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.222234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.510 [2024-10-07 13:35:15.222250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.222268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.222293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.222317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.222330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.222343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.222367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.222388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.222401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.222417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.222440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.231895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.232104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.232134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.510 [2024-10-07 13:35:15.232151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.232188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.232219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.232246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.232264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.232277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.232300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.232511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.232539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.510 [2024-10-07 13:35:15.232556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.232690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.232887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.232911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.232925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.232973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.243755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.243789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.244169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.244199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.510 [2024-10-07 13:35:15.244216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.244333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.244359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.510 [2024-10-07 13:35:15.244375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.244621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.244651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.244709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.244728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.244743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.244760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.244775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.244787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.244974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.245003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.254404] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.254436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.254668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.254699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.510 [2024-10-07 13:35:15.254717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.254864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.510 [2024-10-07 13:35:15.254890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.510 [2024-10-07 13:35:15.254906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.510 [2024-10-07 13:35:15.255012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.255039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.510 [2024-10-07 13:35:15.255156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.255188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.255202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.255219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.510 [2024-10-07 13:35:15.255236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.510 [2024-10-07 13:35:15.255248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.510 [2024-10-07 13:35:15.259412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.259439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.510 [2024-10-07 13:35:15.264520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.264569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.510 [2024-10-07 13:35:15.264739] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.264787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.511 [2024-10-07 13:35:15.264805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.265000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.265026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.511 [2024-10-07 13:35:15.265042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.265060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.265085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.265102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.265115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.265127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.265152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.265168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.265181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.265194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.265215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.274607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.274873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.274903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.511 [2024-10-07 13:35:15.274920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.274957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.274988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.275016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.275032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.275045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.275068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.275281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.275306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.511 [2024-10-07 13:35:15.275322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.275346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.275371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.275391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.275405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.275429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.285075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.285437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.285483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.511 [2024-10-07 13:35:15.285512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.285626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.285664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.290096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.290127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.511 [2024-10-07 13:35:15.290144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.290159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.290171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.290184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.290846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.290876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.290958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.290978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.290992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.291017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.295161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.295387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.295416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.511 [2024-10-07 13:35:15.295433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.295457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.295508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.295525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.295539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.295563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.295707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.295941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.295969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.511 [2024-10-07 13:35:15.295985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.296009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.296033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.296047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.296060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.296082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.305243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.305519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.305566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.511 [2024-10-07 13:35:15.305585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.305611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.305636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.305652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.305666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.305690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.305783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.306051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.306079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.511 [2024-10-07 13:35:15.306095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.306119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.511 [2024-10-07 13:35:15.306142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.511 [2024-10-07 13:35:15.306157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.511 [2024-10-07 13:35:15.306170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.511 [2024-10-07 13:35:15.306193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.511 [2024-10-07 13:35:15.319126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.320028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.511 [2024-10-07 13:35:15.320205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.511 [2024-10-07 13:35:15.320232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.511 [2024-10-07 13:35:15.320253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.511 [2024-10-07 13:35:15.320885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.320916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.512 [2024-10-07 13:35:15.320933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.320953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.321158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.321182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.321196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.321209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.321672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.321700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.321715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.321729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.321953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.329641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.329990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.330021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.512 [2024-10-07 13:35:15.330038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.330144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.333884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.333912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.333927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.334734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.334765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.335522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.335552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.512 [2024-10-07 13:35:15.335570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.335787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.336017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.336042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.336063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.336115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.339910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.340159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.340187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.512 [2024-10-07 13:35:15.340204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.340228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.340253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.340269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.340281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.340305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.348289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.348699] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.348731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.512 [2024-10-07 13:35:15.348749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.348960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.349018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.349038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.349053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.349077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.349992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.350180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.350208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.512 [2024-10-07 13:35:15.350224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.350247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.350270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.350285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.350299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.350322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.361908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.361946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.362196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.362225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.512 [2024-10-07 13:35:15.362242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.362392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.362419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.512 [2024-10-07 13:35:15.362434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.362464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.362511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.362541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.362557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.362571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.362588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.362603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.362615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.362639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.362655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.512 [2024-10-07 13:35:15.372232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.372264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.512 [2024-10-07 13:35:15.374202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.374233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.512 [2024-10-07 13:35:15.374251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.374394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.512 [2024-10-07 13:35:15.374418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.512 [2024-10-07 13:35:15.374433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.512 [2024-10-07 13:35:15.376651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.376684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.512 [2024-10-07 13:35:15.377551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.377576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.377591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.512 [2024-10-07 13:35:15.377610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.512 [2024-10-07 13:35:15.377633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.512 [2024-10-07 13:35:15.377648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.377953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.377977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.383167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.383199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.383453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.383503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.513 [2024-10-07 13:35:15.383522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.383687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.383714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.513 [2024-10-07 13:35:15.383731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.383756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.383792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.383813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.383828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.383841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.383858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.383872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.383884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.383907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.383928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.393626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.393660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.393868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.393896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.513 [2024-10-07 13:35:15.393912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.394094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.394119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.513 [2024-10-07 13:35:15.394136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.394419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.394447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.394707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.394733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.394750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.394768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.394783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.394812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.394860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.394880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.405966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.406005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.406279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.406310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.513 [2024-10-07 13:35:15.406327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.406411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.406436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.513 [2024-10-07 13:35:15.406456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.406697] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.406745] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.407234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.407261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.407277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.407296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.407311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.407324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.407580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.407604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.421120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.421154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.421347] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.421379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.513 [2024-10-07 13:35:15.421398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.421613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.421640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.513 [2024-10-07 13:35:15.421658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.422134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.422166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.422386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.422411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.422427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.422445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.422460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.422502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.513 [2024-10-07 13:35:15.422823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.422848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.513 [2024-10-07 13:35:15.435911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.435945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.513 [2024-10-07 13:35:15.436510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.436541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.513 [2024-10-07 13:35:15.436558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.436688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.513 [2024-10-07 13:35:15.436725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.513 [2024-10-07 13:35:15.436741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.513 [2024-10-07 13:35:15.436961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.436990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.513 [2024-10-07 13:35:15.437180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.513 [2024-10-07 13:35:15.437205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.513 [2024-10-07 13:35:15.437219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.437237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.437251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.437270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.437321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.437341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.446237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.446270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.446576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.446607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.514 [2024-10-07 13:35:15.446624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.446749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.446780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.514 [2024-10-07 13:35:15.446811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.446920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.446945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.447079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.447102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.447115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.447133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.447148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.447160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.451063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.451091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.456953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.456985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.457305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.457336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.514 [2024-10-07 13:35:15.457353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.457538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.457564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.514 [2024-10-07 13:35:15.457580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.457690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.457723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.457842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.457863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.457877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.457894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.457909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.457921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.458056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.458079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.467063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.467111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.467306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.467338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.514 [2024-10-07 13:35:15.467354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.467563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.467589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.514 [2024-10-07 13:35:15.467606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.467625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.467651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.467669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.467684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.467698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.467724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.467740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.467753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.467766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.467804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.479389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.479422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.479654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.479683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.514 [2024-10-07 13:35:15.479706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.479836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.479862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.514 [2024-10-07 13:35:15.479888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.479912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.479933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.479954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.479969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.479982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.479998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.480013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.480025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.480050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.480066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.493203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.493235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.514 [2024-10-07 13:35:15.493477] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.493528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.514 [2024-10-07 13:35:15.493546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.493773] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.514 [2024-10-07 13:35:15.493815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.514 [2024-10-07 13:35:15.493831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.514 [2024-10-07 13:35:15.493856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.493876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.514 [2024-10-07 13:35:15.493897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.493912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.493926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.493942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.514 [2024-10-07 13:35:15.493956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.514 [2024-10-07 13:35:15.493968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.514 [2024-10-07 13:35:15.493997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.514 [2024-10-07 13:35:15.494014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.503423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.503455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.503723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.503752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.515 [2024-10-07 13:35:15.503768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.503958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.503982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.515 [2024-10-07 13:35:15.503998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.507081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.507113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.507861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.507886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.507900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.507917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.507931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.507944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.509171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.509196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.513567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.513598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.513852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.513880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.515 [2024-10-07 13:35:15.513897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.514017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.514042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.515 [2024-10-07 13:35:15.514057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.514266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.514295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.514351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.514371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.514384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.514400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.514415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.514427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.514451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.514481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.525851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.525885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.526325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.526356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.515 [2024-10-07 13:35:15.526372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.526563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.526589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.515 [2024-10-07 13:35:15.526605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.526946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.526976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.527034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.527053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.527067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.527083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.527098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.527111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.527282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.527304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.541894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.541927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.542232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.542261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.515 [2024-10-07 13:35:15.542278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.542494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.542530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.515 [2024-10-07 13:35:15.542547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.515 [2024-10-07 13:35:15.542572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.542594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.515 [2024-10-07 13:35:15.542614] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.542629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.542643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.542659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.515 [2024-10-07 13:35:15.542675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.515 [2024-10-07 13:35:15.542688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.515 [2024-10-07 13:35:15.542713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.542730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.515 [2024-10-07 13:35:15.555988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.556020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.515 [2024-10-07 13:35:15.556242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.515 [2024-10-07 13:35:15.556271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.516 [2024-10-07 13:35:15.556288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.556401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.556427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.516 [2024-10-07 13:35:15.556442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.556482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.556515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.556538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.556553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.556566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.556593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.556608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.556621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.556645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.556666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.566098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.566144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.566382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.566408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.516 [2024-10-07 13:35:15.566424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.571007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.571037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.516 [2024-10-07 13:35:15.571054] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.571072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.571350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.571378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.571392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.571406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.572078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.572104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.572118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.572131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.572548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.576182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.576423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.576453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.516 [2024-10-07 13:35:15.576552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.576758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.576990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.577026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.577043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.577055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.577103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.577244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.577271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.516 [2024-10-07 13:35:15.577303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.577521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.577579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.577600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.577614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.577639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.589797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.589831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.590000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.590028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.516 [2024-10-07 13:35:15.590045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.590217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.590242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.516 [2024-10-07 13:35:15.590258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.590284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.590304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.590325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.590341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.590354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.590371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.590385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.590398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.590422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.590438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.600968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.601002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.601300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.601331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.516 [2024-10-07 13:35:15.601348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.601575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.601606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.516 [2024-10-07 13:35:15.601623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.601742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.601769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.601906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.601928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.601942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.601959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.516 [2024-10-07 13:35:15.601974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.516 [2024-10-07 13:35:15.601986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.516 [2024-10-07 13:35:15.602096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.602117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.516 [2024-10-07 13:35:15.611128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.611162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.516 [2024-10-07 13:35:15.611362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.611390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.516 [2024-10-07 13:35:15.611407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.611627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.516 [2024-10-07 13:35:15.611654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.516 [2024-10-07 13:35:15.611670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.516 [2024-10-07 13:35:15.611695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.611718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.516 [2024-10-07 13:35:15.611739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.611753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.611767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.611799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.611814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.611827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.611850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.611867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.621241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.621438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.621673] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.621704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.517 [2024-10-07 13:35:15.621721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.621941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.621967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.517 [2024-10-07 13:35:15.621984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.622002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.622242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.622267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.622280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.622294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.622343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.622363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.622376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.622389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.622412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.635142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.635176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.635572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.635604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.517 [2024-10-07 13:35:15.635621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.635813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.635839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.517 [2024-10-07 13:35:15.635855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.636053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.636082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.636207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.636230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.636250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.636268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.636282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.636295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.636338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.636358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.647510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.647554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.647841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.647871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.517 [2024-10-07 13:35:15.647889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.647996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.648020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.517 [2024-10-07 13:35:15.648038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.648084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.648109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.648130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.648146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.648159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.648175] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.648191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.648203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.648227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.648242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.662836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.662871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.663009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.663037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.517 [2024-10-07 13:35:15.663053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.663182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.663208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.517 [2024-10-07 13:35:15.663229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.663254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.663275] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.663295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.663311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.663323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.663340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.663354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.663366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.663389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.663406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.674804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.674838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.517 [2024-10-07 13:35:15.675082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.675112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.517 [2024-10-07 13:35:15.675129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.675258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.517 [2024-10-07 13:35:15.675284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.517 [2024-10-07 13:35:15.675300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.517 [2024-10-07 13:35:15.677286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.677316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.517 [2024-10-07 13:35:15.678311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.678336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.678350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.678368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.517 [2024-10-07 13:35:15.678382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.517 [2024-10-07 13:35:15.678395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.517 [2024-10-07 13:35:15.678794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.678819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.517 [2024-10-07 13:35:15.684915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.686146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.686395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.686423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.518 [2024-10-07 13:35:15.686440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.686808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.686851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.518 [2024-10-07 13:35:15.686868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.686886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.687012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.687038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.687052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.687081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.687214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.687238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.687253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.687268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.687396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.695331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.695463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.695519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.518 [2024-10-07 13:35:15.695539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.695564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.695589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.695604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.695617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.695641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.696410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.696587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.696616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.518 [2024-10-07 13:35:15.696634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.696659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.696689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.696705] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.696719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.696750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.706452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.706611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.706642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.518 [2024-10-07 13:35:15.706660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.706696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.706728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.706760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.706793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.706807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.706831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.707012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.707038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.518 [2024-10-07 13:35:15.707054] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.707078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.707101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.707116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.707131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.707155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.722358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.722390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.722731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.722775] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.518 [2024-10-07 13:35:15.722808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.722940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.722967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.518 [2024-10-07 13:35:15.722998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.723267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.723296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.723347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.723367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.723390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.723406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.723421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.723434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.518 [2024-10-07 13:35:15.723642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.723667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.518 [2024-10-07 13:35:15.737871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.737905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.518 [2024-10-07 13:35:15.738196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.738226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.518 [2024-10-07 13:35:15.738242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.738383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.518 [2024-10-07 13:35:15.738410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.518 [2024-10-07 13:35:15.738438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.518 [2024-10-07 13:35:15.738652] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.738682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.518 [2024-10-07 13:35:15.738730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.518 [2024-10-07 13:35:15.738750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.518 [2024-10-07 13:35:15.738765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.738783] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.738798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.738812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.738837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.738854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.750721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.750756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.751135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.751165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.519 [2024-10-07 13:35:15.751182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.751309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.751335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.519 [2024-10-07 13:35:15.751351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.751715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.751746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.751807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.751827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.751841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.751858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.751873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.751887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.752114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.752137] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.760857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.760904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.761057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.761086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.519 [2024-10-07 13:35:15.761102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.761229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.761254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.519 [2024-10-07 13:35:15.761270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.761288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.763826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.763865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.763880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.763893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.764874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.764902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.764922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.764937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.765177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.770942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.771164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.771195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.519 [2024-10-07 13:35:15.771213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.771438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.771523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.771559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.771577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.771591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.771616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.771760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.771804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.519 [2024-10-07 13:35:15.771833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.771873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.771898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.771914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.771943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.771966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 8610.46 IOPS, 33.63 MiB/s [2024-10-07T11:35:19.452Z] [2024-10-07 13:35:15.784684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.784714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.519 [2024-10-07 13:35:15.786144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.786174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.519 [2024-10-07 13:35:15.786190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.786338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.519 [2024-10-07 13:35:15.786363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.519 [2024-10-07 13:35:15.786393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.519 [2024-10-07 13:35:15.787117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.787170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.519 [2024-10-07 13:35:15.787457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.787481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.787504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.787539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.519 [2024-10-07 13:35:15.787554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.519 [2024-10-07 13:35:15.787568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.519 [2024-10-07 13:35:15.787621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.787642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.519 [2024-10-07 13:35:15.796286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.796333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.796627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.796659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.520 [2024-10-07 13:35:15.796677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.796812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.796853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.520 [2024-10-07 13:35:15.796868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.796984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.797010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.799496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.799523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.799539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.799558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.799573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.799585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.800560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.800586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.806413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.806460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.806633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.806660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.520 [2024-10-07 13:35:15.806682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.806852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.806879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.520 [2024-10-07 13:35:15.806895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.806913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.806938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.806957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.806970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.806983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.807007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.807024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.807037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.807061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.807083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.816576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.816625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.816790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.816820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.520 [2024-10-07 13:35:15.816838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.817209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.817238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.520 [2024-10-07 13:35:15.817254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.817272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.817482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.817519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.817533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.817547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.817614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.817637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.817650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.817669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.817693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.831013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.831063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.831249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.831279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.520 [2024-10-07 13:35:15.831297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.831434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.831463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.520 [2024-10-07 13:35:15.831503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.831546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.831569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.831591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.831606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.831620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.831637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.520 [2024-10-07 13:35:15.831652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.520 [2024-10-07 13:35:15.831665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.520 [2024-10-07 13:35:15.831690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.831707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.520 [2024-10-07 13:35:15.841146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.841197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.520 [2024-10-07 13:35:15.841427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.841456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.520 [2024-10-07 13:35:15.841496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.842565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.520 [2024-10-07 13:35:15.842595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.520 [2024-10-07 13:35:15.842613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.520 [2024-10-07 13:35:15.842633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.842671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.520 [2024-10-07 13:35:15.842698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.842713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.842726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.842752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.842785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.842798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.842816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.842838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.851231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.851570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.851603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.521 [2024-10-07 13:35:15.851622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.851688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.851722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.851752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.851769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.851799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.851977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.852157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.852184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.521 [2024-10-07 13:35:15.852201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.852248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.852275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.852290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.852303] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.852327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.864816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.864850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.865100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.865130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.521 [2024-10-07 13:35:15.865148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.865363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.865390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.521 [2024-10-07 13:35:15.865406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.865858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.865888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.866128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.866153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.866168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.866185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.866200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.866214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.866430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.866452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.879309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.879343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.879570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.879600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.521 [2024-10-07 13:35:15.879617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.879851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.879877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.521 [2024-10-07 13:35:15.879893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.879917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.879938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.879959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.879974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.879988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.880004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.880018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.880031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.880060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.880088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.889422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.889473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.889729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.889758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.521 [2024-10-07 13:35:15.889776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.892413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.892444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.521 [2024-10-07 13:35:15.892475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.892511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.893759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.893802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.893817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.893830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.894153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.894178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.894192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.894208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.894340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.521 [2024-10-07 13:35:15.899674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.899707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.521 [2024-10-07 13:35:15.899847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.899874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.521 [2024-10-07 13:35:15.899891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.900061] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.521 [2024-10-07 13:35:15.900088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.521 [2024-10-07 13:35:15.900104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.521 [2024-10-07 13:35:15.900128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.900149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.521 [2024-10-07 13:35:15.900169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.521 [2024-10-07 13:35:15.900190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.521 [2024-10-07 13:35:15.900205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.521 [2024-10-07 13:35:15.900221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.900236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.900248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.900272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.900300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.911431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.911463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.911732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.911762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.522 [2024-10-07 13:35:15.911794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.911933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.911960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.522 [2024-10-07 13:35:15.911976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.912002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.912023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.912044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.912059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.912072] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.912090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.912105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.912118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.912142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.912159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.926815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.926848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.927037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.927076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.522 [2024-10-07 13:35:15.927093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.927233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.927268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.522 [2024-10-07 13:35:15.927284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.927308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.927328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.927348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.927363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.927376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.927392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.927406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.927418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.927441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.927469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.942164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.942206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.943300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.943341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.522 [2024-10-07 13:35:15.943359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.943502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.943528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.522 [2024-10-07 13:35:15.943544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.943943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.943972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.944422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.944447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.944461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.944478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.944518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.944533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.944748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.944771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.956409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.956441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.956710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.956740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.522 [2024-10-07 13:35:15.956757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.956993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.957020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.522 [2024-10-07 13:35:15.957036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.522 [2024-10-07 13:35:15.957061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.957082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.522 [2024-10-07 13:35:15.957102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.957116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.957130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.957146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.522 [2024-10-07 13:35:15.957160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.522 [2024-10-07 13:35:15.957173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.522 [2024-10-07 13:35:15.957196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.957212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.522 [2024-10-07 13:35:15.972242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.972275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.522 [2024-10-07 13:35:15.972518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.522 [2024-10-07 13:35:15.972547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.522 [2024-10-07 13:35:15.972565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:15.972727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:15.972752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.523 [2024-10-07 13:35:15.972782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:15.972807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:15.972827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:15.972848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:15.972863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:15.972881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:15.972898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:15.972913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:15.972925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:15.972949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:15.972964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:15.986522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:15.986557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:15.986814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:15.986842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.523 [2024-10-07 13:35:15.986860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:15.987049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:15.987074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.523 [2024-10-07 13:35:15.987090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:15.987114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:15.987135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:15.987155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:15.987170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:15.987183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:15.987199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:15.987240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:15.987254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:15.987310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:15.987332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:15.998680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:15.998715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:15.999047] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:15.999077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.523 [2024-10-07 13:35:15.999094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:15.999214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:15.999239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.523 [2024-10-07 13:35:15.999262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:16.003088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:16.003122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:16.003637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:16.003664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:16.003678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:16.003696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:16.003711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:16.003724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:16.003956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:16.003979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:16.008808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:16.008854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:16.009071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:16.009099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.523 [2024-10-07 13:35:16.009116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:16.009417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:16.009444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.523 [2024-10-07 13:35:16.009460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:16.009501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:16.009661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:16.009687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:16.009701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:16.009714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:16.009880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:16.009902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:16.009916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:16.009930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:16.010068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:16.018890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:16.019186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:16.019216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.523 [2024-10-07 13:35:16.019233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:16.019271] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:16.019302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:16.019329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:16.019345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:16.019358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:16.019381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:16.019616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:16.019642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.523 [2024-10-07 13:35:16.019658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.523 [2024-10-07 13:35:16.019683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.523 [2024-10-07 13:35:16.019707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.523 [2024-10-07 13:35:16.019722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.523 [2024-10-07 13:35:16.019736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.523 [2024-10-07 13:35:16.019760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.523 [2024-10-07 13:35:16.031535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:16.031581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.523 [2024-10-07 13:35:16.031809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.523 [2024-10-07 13:35:16.031837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.523 [2024-10-07 13:35:16.031853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.032085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.032109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.524 [2024-10-07 13:35:16.032125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.032149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.032171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.032193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.032208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.032220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.032242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.032258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.032270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.032294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.032310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.045997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.046030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.046447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.046501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.524 [2024-10-07 13:35:16.046521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.046652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.046680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.524 [2024-10-07 13:35:16.046696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.046918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.046946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.046992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.047012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.047026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.047044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.047059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.047071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.047243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.047265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.058975] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.059009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.060276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.060307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.524 [2024-10-07 13:35:16.060324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.060442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.060467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.524 [2024-10-07 13:35:16.060482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.060981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.061011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.061461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.061508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.061526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.061546] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.061561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.061575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.061790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.061827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.074401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.074434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.074663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.074692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.524 [2024-10-07 13:35:16.074708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.074898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.074922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.524 [2024-10-07 13:35:16.074937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.074962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.074982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.524 [2024-10-07 13:35:16.075003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.075018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.075031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.075048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.524 [2024-10-07 13:35:16.075062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.524 [2024-10-07 13:35:16.075074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.524 [2024-10-07 13:35:16.075110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.075126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.524 [2024-10-07 13:35:16.089074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.089107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.524 [2024-10-07 13:35:16.089315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.089342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.524 [2024-10-07 13:35:16.089360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.524 [2024-10-07 13:35:16.089565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.524 [2024-10-07 13:35:16.089591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.524 [2024-10-07 13:35:16.089607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.089633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.089654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.089674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.089689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.089703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.089720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.089735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.089747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.089771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.089788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.104674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.104708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.105048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.105077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.525 [2024-10-07 13:35:16.105095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.105286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.105310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.525 [2024-10-07 13:35:16.105326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.105670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.105701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.105996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.106021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.106036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.106053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.106073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.106087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.106142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.106162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.119825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.119859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.120352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.120383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.525 [2024-10-07 13:35:16.120400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.120597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.120623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.525 [2024-10-07 13:35:16.120639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.120990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.121020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.121077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.121096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.121110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.121126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.121141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.121154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.121325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.121348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.133983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.134016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.134234] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.134261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.525 [2024-10-07 13:35:16.134277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.134434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.134460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.525 [2024-10-07 13:35:16.134476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.134526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.134555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.134591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.134610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.134623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.134641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.134655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.134672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.134697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.134715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.148408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.148441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.149072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.149102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.525 [2024-10-07 13:35:16.149119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.149286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.149312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.525 [2024-10-07 13:35:16.149327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.149726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.149758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.149979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.150002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.150017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.150034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.150049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.150062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.150254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.150278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.525 [2024-10-07 13:35:16.158786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.158821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.525 [2024-10-07 13:35:16.159129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.159165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.525 [2024-10-07 13:35:16.159184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.159307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.525 [2024-10-07 13:35:16.159334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.525 [2024-10-07 13:35:16.159350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.525 [2024-10-07 13:35:16.159375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.159400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.525 [2024-10-07 13:35:16.159426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.525 [2024-10-07 13:35:16.159440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.525 [2024-10-07 13:35:16.159453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.525 [2024-10-07 13:35:16.159469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.159484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.159524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.162206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.162233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.168918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.168967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.169232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.169259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.526 [2024-10-07 13:35:16.169275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.169773] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.169804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.526 [2024-10-07 13:35:16.169821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.169855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.170049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.170076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.170090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.170104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.170153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.170173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.170192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.170207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.170231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.180928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.180961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.181147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.181174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.526 [2024-10-07 13:35:16.181190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.181360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.181385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.526 [2024-10-07 13:35:16.181402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.181426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.181448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.181468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.181484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.181506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.181525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.181540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.181553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.181577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.181593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.191945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.191978] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.192264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.192294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.526 [2024-10-07 13:35:16.192311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.192428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.192454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.526 [2024-10-07 13:35:16.192496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.192614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.192642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.192755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.192803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.192817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.192835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.192850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.192863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.192971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.192992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.202585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.202620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.203022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.203052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.526 [2024-10-07 13:35:16.203070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.203264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.203289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.526 [2024-10-07 13:35:16.203305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.203411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.203438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.203653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.203679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.203694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.203713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.203727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.203740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.203790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.203826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.212731] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.212780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.212969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.212997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.526 [2024-10-07 13:35:16.213019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.213305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.213334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.526 [2024-10-07 13:35:16.213350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.526 [2024-10-07 13:35:16.213370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.213420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.526 [2024-10-07 13:35:16.213442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.213455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.213468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.213670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.213694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.526 [2024-10-07 13:35:16.213709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.526 [2024-10-07 13:35:16.213723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.526 [2024-10-07 13:35:16.213773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.526 [2024-10-07 13:35:16.225625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.225659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.526 [2024-10-07 13:35:16.226508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.526 [2024-10-07 13:35:16.226540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.527 [2024-10-07 13:35:16.226557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.226685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.226710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.527 [2024-10-07 13:35:16.226726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.227093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.227122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.227180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.227199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.227213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.227229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.227244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.227257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.227287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.227304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.239502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.239536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.239893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.239923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.527 [2024-10-07 13:35:16.239940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.240087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.240113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.527 [2024-10-07 13:35:16.240130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.240322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.240350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.240567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.240592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.240607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.240625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.240640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.240654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.240705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.240725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.252279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.252312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.252650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.252682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.527 [2024-10-07 13:35:16.252700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.252842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.252868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.527 [2024-10-07 13:35:16.252884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.253518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.253557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.253846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.253876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.253892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.253909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.253924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.253937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.253990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.254011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.267324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.267356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.267872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.267901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.527 [2024-10-07 13:35:16.267918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.268010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.268035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.527 [2024-10-07 13:35:16.268051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.268269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.268297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.268344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.268363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.268376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.268393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.268408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.268420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.268444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.268460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.280148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.280182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.281120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.281150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.527 [2024-10-07 13:35:16.281167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.281326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.281352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.527 [2024-10-07 13:35:16.281368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.281810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.281840] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.282044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.282067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.282082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.282099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.282114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.282126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.282264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.282286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.290258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.290305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.527 [2024-10-07 13:35:16.290446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.290494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.527 [2024-10-07 13:35:16.290513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.293113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.527 [2024-10-07 13:35:16.293143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.527 [2024-10-07 13:35:16.293160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.527 [2024-10-07 13:35:16.293179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.295751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.527 [2024-10-07 13:35:16.295795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.527 [2024-10-07 13:35:16.295810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.527 [2024-10-07 13:35:16.295823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.527 [2024-10-07 13:35:16.296160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.527 [2024-10-07 13:35:16.296186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.296200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.296213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.296417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.300343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.300538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.300568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.528 [2024-10-07 13:35:16.300586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.300624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.300656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.300685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.300702] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.300716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.300739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.300905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.300931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.528 [2024-10-07 13:35:16.300948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.300972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.300995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.301010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.301023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.301047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.310427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.310705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.310735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.528 [2024-10-07 13:35:16.310753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.310779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.310830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.310849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.310862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.310887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.310920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.311127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.311154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.528 [2024-10-07 13:35:16.311179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.311205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.311228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.311243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.311256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.311280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.325021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.325054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.325269] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.325298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.528 [2024-10-07 13:35:16.325315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.325476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.325511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.528 [2024-10-07 13:35:16.325528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.326566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.326605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.327210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.327235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.327249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.327266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.327281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.327293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.327599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.327625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.336926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.336958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.337168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.337198] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.528 [2024-10-07 13:35:16.337216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.337392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.337418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.528 [2024-10-07 13:35:16.337440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.337556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.337583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.337685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.337706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.337719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.337740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.337754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.337767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.337882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.337902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.347039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.347086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.347299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.347327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.528 [2024-10-07 13:35:16.347344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.347463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.528 [2024-10-07 13:35:16.347513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.528 [2024-10-07 13:35:16.347531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.528 [2024-10-07 13:35:16.347550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.347576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.528 [2024-10-07 13:35:16.347594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.347608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.347621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.347646] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.347663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.528 [2024-10-07 13:35:16.347676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.528 [2024-10-07 13:35:16.347696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.528 [2024-10-07 13:35:16.347718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.528 [2024-10-07 13:35:16.357318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.357356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.528 [2024-10-07 13:35:16.357523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.357554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.529 [2024-10-07 13:35:16.357571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.357669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.357696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.529 [2024-10-07 13:35:16.357712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.357903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.357931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.358127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.358151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.358166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.358184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.358199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.358211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.358268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.358287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.371184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.371217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.371595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.371626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.529 [2024-10-07 13:35:16.371644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.371739] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.371766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.529 [2024-10-07 13:35:16.371782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.372016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.372044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.372091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.372110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.372123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.372145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.372160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.372173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.372345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.372372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.385602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.385635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.385828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.385856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.529 [2024-10-07 13:35:16.385874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.385966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.385992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.529 [2024-10-07 13:35:16.386007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.386032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.386053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.386074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.386095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.386108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.386125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.386139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.386151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.386174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.386190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.395722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.398234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.398407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.398435] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.529 [2024-10-07 13:35:16.398451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.400372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.400402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.529 [2024-10-07 13:35:16.400418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.400442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.400549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.400573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.400587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.400600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.400626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.400643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.400657] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.400670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.400693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.407239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.407531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.407577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.529 [2024-10-07 13:35:16.407596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.407751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.407903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.407926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.407941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.408054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.408568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.408761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.408791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.529 [2024-10-07 13:35:16.408824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.408852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.408878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.408893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.408907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.408931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.417326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.417500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.417535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.529 [2024-10-07 13:35:16.417553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.417732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.417812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.417844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.417858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.417883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.529 [2024-10-07 13:35:16.418667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.529 [2024-10-07 13:35:16.418867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.529 [2024-10-07 13:35:16.418894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.529 [2024-10-07 13:35:16.418910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.529 [2024-10-07 13:35:16.418934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.529 [2024-10-07 13:35:16.418958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.529 [2024-10-07 13:35:16.418972] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.529 [2024-10-07 13:35:16.418985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.529 [2024-10-07 13:35:16.419008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.431310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.431342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.431686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.431717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.530 [2024-10-07 13:35:16.431735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.431866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.431892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.530 [2024-10-07 13:35:16.431908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.432100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.432128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.432183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.432202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.432216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.432237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.432256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.432270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.432441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.432496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.444874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.444905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.445118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.445147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.530 [2024-10-07 13:35:16.445164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.445256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.445282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.530 [2024-10-07 13:35:16.445297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.445322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.445342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.445363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.445378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.445391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.445407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.445428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.445440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.445463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.445516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.455336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.455368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.455636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.455667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.530 [2024-10-07 13:35:16.455684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.455838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.455864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.530 [2024-10-07 13:35:16.455880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.455988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.456026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.456140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.456160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.456174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.456191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.456210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.456223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.459081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.459107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.465610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.465642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.466874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.466904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.530 [2024-10-07 13:35:16.466921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.467070] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.467094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.530 [2024-10-07 13:35:16.467109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.467208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.467234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.467270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.467288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.467302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.467319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.467333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.467349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.467372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.467388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.475981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.476012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.476190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.476224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.530 [2024-10-07 13:35:16.476241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.476327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.476353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.530 [2024-10-07 13:35:16.476369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.476393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.476414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.476435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.476450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.476463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.476504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.476521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.476534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.476685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.476709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.488913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.488945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.530 [2024-10-07 13:35:16.489337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.489367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.530 [2024-10-07 13:35:16.489384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.489483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.530 [2024-10-07 13:35:16.489518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.530 [2024-10-07 13:35:16.489534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.530 [2024-10-07 13:35:16.489797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.489826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.530 [2024-10-07 13:35:16.490038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.490062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.490076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.490093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.530 [2024-10-07 13:35:16.490108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.530 [2024-10-07 13:35:16.490126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.530 [2024-10-07 13:35:16.490318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.490351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.530 [2024-10-07 13:35:16.503216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.503249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.503664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.503696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.531 [2024-10-07 13:35:16.503713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.503855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.503880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.531 [2024-10-07 13:35:16.503896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.504089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.504117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.504307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.504330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.504344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.504361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.504380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.504392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.504450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.504494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.519378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.519411] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.519800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.519831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.531 [2024-10-07 13:35:16.519848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.519963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.519988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.531 [2024-10-07 13:35:16.520004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.520196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.520224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.520423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.520450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.520464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.520516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.520532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.520546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.520604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.520634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.533429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.533461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.533680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.533722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.531 [2024-10-07 13:35:16.533740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.533867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.533893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.531 [2024-10-07 13:35:16.533909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.533933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.533961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.533981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.533996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.534009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.534025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.534039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.534063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.534088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.534104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.546100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.546132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.548774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.548821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.531 [2024-10-07 13:35:16.548843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.548954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.548979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.531 [2024-10-07 13:35:16.548995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.550342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.550372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.550903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.550927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.550949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.550966] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.550980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.550992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.551208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.551231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.556211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.556258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.556411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.556439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.531 [2024-10-07 13:35:16.556455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.556621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.556660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.531 [2024-10-07 13:35:16.556676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.556694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.556731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.556749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.556762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.556775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.556840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.556859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.556879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.556897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.556920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.566328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.566374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.566627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.566657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.531 [2024-10-07 13:35:16.566674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.567149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.567177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.531 [2024-10-07 13:35:16.567194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.567212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.567269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.531 [2024-10-07 13:35:16.567291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.567304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.567316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.567355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.567374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.531 [2024-10-07 13:35:16.567387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.531 [2024-10-07 13:35:16.567400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.531 [2024-10-07 13:35:16.567428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.531 [2024-10-07 13:35:16.578513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.578546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.531 [2024-10-07 13:35:16.578973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.579002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.531 [2024-10-07 13:35:16.579019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.531 [2024-10-07 13:35:16.579102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.531 [2024-10-07 13:35:16.579127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.532 [2024-10-07 13:35:16.579143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.579346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.579377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.579596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.579625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.579640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.579658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.579675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.579688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.579748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.579769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.593759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.593817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.594105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.594134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.532 [2024-10-07 13:35:16.594150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.594260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.594285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.532 [2024-10-07 13:35:16.594301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.594564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.594603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.594651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.594670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.594684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.594701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.594719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.594731] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.595155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.595179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.606842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.606874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.607232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.607263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.532 [2024-10-07 13:35:16.607280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.607366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.607392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.532 [2024-10-07 13:35:16.607408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.607627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.607668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.608181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.608204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.608218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.608235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.608249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.608261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.608515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.608542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.617121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.617152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.617360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.617388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.532 [2024-10-07 13:35:16.617404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.617533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.617560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.532 [2024-10-07 13:35:16.617576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.620123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.620153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.621025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.621049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.621063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.621080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.621094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.621106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.621765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.621814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.627231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.627277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.627531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.627561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.532 [2024-10-07 13:35:16.627578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.627731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.627758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.532 [2024-10-07 13:35:16.627773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.627806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.629746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.629774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.629814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.629827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.630040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.630064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.630078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.630100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.630841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.637314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.637550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.637581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.532 [2024-10-07 13:35:16.637599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.637637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.637685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.532 [2024-10-07 13:35:16.637718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.637734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.637758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.637782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.637995] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.532 [2024-10-07 13:35:16.638021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.532 [2024-10-07 13:35:16.638042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.532 [2024-10-07 13:35:16.638067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.532 [2024-10-07 13:35:16.638105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.532 [2024-10-07 13:35:16.638122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.532 [2024-10-07 13:35:16.638135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.532 [2024-10-07 13:35:16.638157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.532 [2024-10-07 13:35:16.648877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.648910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.649135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.649164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.533 [2024-10-07 13:35:16.649181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.649304] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.649329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.533 [2024-10-07 13:35:16.649345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.649555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.649596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.650083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.650107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.650121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.650138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.650153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.650166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.650419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.650443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.659635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.659669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.659975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.660007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.533 [2024-10-07 13:35:16.660025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.660118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.660148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.533 [2024-10-07 13:35:16.660172] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.660285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.660328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.660447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.660503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.660521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.660543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.660561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.660575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.663929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.663956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.670016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.670064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.670369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.670398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.533 [2024-10-07 13:35:16.670415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.670554] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.670581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.533 [2024-10-07 13:35:16.670597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.670654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.670678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.670700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.670716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.670729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.670746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.670761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.670792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.670817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.670833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.680150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.680203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.680349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.680375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.533 [2024-10-07 13:35:16.680392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.680809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.680838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.533 [2024-10-07 13:35:16.680854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.680872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.681066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.681100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.681114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.681127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.681177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.681197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.681210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.681223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.681392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.692236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.692274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.692421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.692450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.533 [2024-10-07 13:35:16.692465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.692671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.692699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.533 [2024-10-07 13:35:16.692715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.692905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.692933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.693153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.693176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.693190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.693221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.693236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.693249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.693299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.693318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.702708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.702742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.703066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.703096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.533 [2024-10-07 13:35:16.703112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.703203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.703227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.533 [2024-10-07 13:35:16.703243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.703350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.703387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.533 [2024-10-07 13:35:16.703532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.703555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.703570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.703587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.533 [2024-10-07 13:35:16.703602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.533 [2024-10-07 13:35:16.703614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.533 [2024-10-07 13:35:16.706652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.706679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.533 [2024-10-07 13:35:16.713099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.713130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.533 [2024-10-07 13:35:16.713403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.713432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.533 [2024-10-07 13:35:16.713449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.533 [2024-10-07 13:35:16.713609] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.533 [2024-10-07 13:35:16.713637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.534 [2024-10-07 13:35:16.713653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.713767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.713806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.713936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.713957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.713971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.713988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.714003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.714015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.714122] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.714142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.723550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.723583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.723735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.723762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.534 [2024-10-07 13:35:16.723778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.723881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.723905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.534 [2024-10-07 13:35:16.723920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.723944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.723963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.723983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.723997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.724010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.724026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.724039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.724058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.724081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.724096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.736624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.736657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.736870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.736899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.534 [2024-10-07 13:35:16.736915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.737054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.737079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.534 [2024-10-07 13:35:16.737095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.737226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.737264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.737624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.737649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.737664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.737682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.737697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.737719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.737950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.737974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.748849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.748881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.749155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.749184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.534 [2024-10-07 13:35:16.749201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.749315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.749340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.534 [2024-10-07 13:35:16.749356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.751319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.751349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.752151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.752175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.752189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.752207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.752225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.752238] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.752514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.752540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.759251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.759294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.759508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.759538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.534 [2024-10-07 13:35:16.759555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.759666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.759693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.534 [2024-10-07 13:35:16.759709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.759734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.759755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.759777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.759807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.759820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.759836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.759851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.759863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.759897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.759914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.769403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.769456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.769619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.769649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.534 [2024-10-07 13:35:16.769667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.770007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.770035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.534 [2024-10-07 13:35:16.770051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.770074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.770135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.770157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.770171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.770184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.770208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.770225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.770238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.534 [2024-10-07 13:35:16.770251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.534 [2024-10-07 13:35:16.770272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.534 [2024-10-07 13:35:16.780842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.780875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.534 [2024-10-07 13:35:16.781097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.781126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.534 [2024-10-07 13:35:16.781142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.781282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.534 [2024-10-07 13:35:16.781308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.534 [2024-10-07 13:35:16.781324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.534 [2024-10-07 13:35:16.781348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.781369] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.534 [2024-10-07 13:35:16.781390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.534 [2024-10-07 13:35:16.781404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.781417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.781434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.781447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.781460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.781511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.781529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 8613.36 IOPS, 33.65 MiB/s [2024-10-07T11:35:19.468Z] [2024-10-07 13:35:16.795610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.795644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.796462] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.796524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.535 [2024-10-07 13:35:16.796545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.796662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.796689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.535 [2024-10-07 13:35:16.796705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.797206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.797235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.797303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.797323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.797337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.797365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.797380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.797392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.797426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.797442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.808772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.808822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.809085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.809114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.535 [2024-10-07 13:35:16.809130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.809227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.809253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.535 [2024-10-07 13:35:16.809269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.811546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.811579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.812502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.812528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.812544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.812562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.812578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.812597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.813022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.813046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.818901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.818947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.819154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.819183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.535 [2024-10-07 13:35:16.819199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.819321] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.819347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.535 [2024-10-07 13:35:16.819363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.819380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.821516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.821545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.821560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.821573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.822190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.822216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.822240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.822253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.822396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.828985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.829143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.829172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.535 [2024-10-07 13:35:16.829189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.829226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.829257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.829285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.829301] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.829314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.829342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.829464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.829512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.535 [2024-10-07 13:35:16.829531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.829556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.829580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.829596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.829609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.829633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.840952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.840984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.841116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.841143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.535 [2024-10-07 13:35:16.841159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.841276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.841303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.535 [2024-10-07 13:35:16.841318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.841343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.841364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.841384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.841399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.841412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.841428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.841443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.841456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.841479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.841521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.853767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.853801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.855429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.855461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.535 [2024-10-07 13:35:16.855484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.855611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.855637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.535 [2024-10-07 13:35:16.855654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.535 [2024-10-07 13:35:16.855713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.855737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.535 [2024-10-07 13:35:16.855760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.855777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.855791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.855823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.535 [2024-10-07 13:35:16.855838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.535 [2024-10-07 13:35:16.855850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.535 [2024-10-07 13:35:16.855874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.855891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.535 [2024-10-07 13:35:16.868450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.868483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.535 [2024-10-07 13:35:16.869534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.535 [2024-10-07 13:35:16.869566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.535 [2024-10-07 13:35:16.869584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.869697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.869724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.536 [2024-10-07 13:35:16.869741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.870251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.870279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.870515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.870540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.870554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.870572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.870586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.870600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.870673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.870695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.879281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.879315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.879558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.879589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.536 [2024-10-07 13:35:16.879606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.879699] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.879725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.536 [2024-10-07 13:35:16.879741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.879864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.879891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.879993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.880025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.880039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.880056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.880070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.880090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.880194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.880214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.889394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.889440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.889585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.889614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.536 [2024-10-07 13:35:16.889630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.889719] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.889746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.536 [2024-10-07 13:35:16.889763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.889781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.889822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.889846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.889859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.889872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.889896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.889912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.889924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.889937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.889959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.900326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.900358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.900550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.900578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.536 [2024-10-07 13:35:16.900595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.900691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.900716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.536 [2024-10-07 13:35:16.900733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.900759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.900780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.900816] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.900831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.900844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.900861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.900875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.900887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.900911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.900927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.915532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.915566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.915756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.915802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.536 [2024-10-07 13:35:16.915819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.915934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.915960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.536 [2024-10-07 13:35:16.915976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.916001] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.916021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.916042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.916057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.916070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.916086] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.916101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.916113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.916136] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.916157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.536 [2024-10-07 13:35:16.930178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.930211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.536 [2024-10-07 13:35:16.930556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.930588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.536 [2024-10-07 13:35:16.930605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.930702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.536 [2024-10-07 13:35:16.930728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.536 [2024-10-07 13:35:16.930744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.536 [2024-10-07 13:35:16.930953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.930991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.536 [2024-10-07 13:35:16.931179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.536 [2024-10-07 13:35:16.931202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.536 [2024-10-07 13:35:16.931217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.536 [2024-10-07 13:35:16.931233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.931248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.931260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.931320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.931345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.944690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.944734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.944900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.944929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.537 [2024-10-07 13:35:16.944946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.945109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.945135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.537 [2024-10-07 13:35:16.945150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.945174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.945194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.945215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.945230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.945243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.945259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.945282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.945295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.945318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.945345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.959795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.959828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.960202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.960232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.537 [2024-10-07 13:35:16.960248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.960343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.960368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.537 [2024-10-07 13:35:16.960384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.960608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.960638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.960858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.960886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.960901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.960918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.960932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.960945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.961147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.961170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.974840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.974872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.975006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.975034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.537 [2024-10-07 13:35:16.975051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.975189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.975214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.537 [2024-10-07 13:35:16.975230] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.975255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.975275] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.975296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.975311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.975324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.975341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.975355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.975374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.975397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.975413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.990378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.990412] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:16.990774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.990818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.537 [2024-10-07 13:35:16.990835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.990947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:16.990979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.537 [2024-10-07 13:35:16.990995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:16.991194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.991231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:16.991419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.991449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.991464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.991506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:16.991523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:16.991545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:16.991755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:16.991794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:17.004876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:17.004909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:17.005074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:17.005103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.537 [2024-10-07 13:35:17.005120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:17.005235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:17.005261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.537 [2024-10-07 13:35:17.005277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:17.005301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:17.005322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:17.005342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:17.005357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:17.005370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:17.005386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:17.005401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:17.005413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:17.005446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:17.005462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:17.019708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:17.019743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:17.020290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:17.020320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.537 [2024-10-07 13:35:17.020337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:17.020515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.537 [2024-10-07 13:35:17.020543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.537 [2024-10-07 13:35:17.020559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.537 [2024-10-07 13:35:17.020848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:17.020888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.537 [2024-10-07 13:35:17.020948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:17.020969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:17.020983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:17.021008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.537 [2024-10-07 13:35:17.021023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.537 [2024-10-07 13:35:17.021036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.537 [2024-10-07 13:35:17.021208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:17.021231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.537 [2024-10-07 13:35:17.032087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.537 [2024-10-07 13:35:17.032127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.032376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.032405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.538 [2024-10-07 13:35:17.032422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.032568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.032596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.538 [2024-10-07 13:35:17.032612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.032723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.032756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.034885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.034910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.034930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.034949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.034963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.034975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.035781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.035807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.042589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.042628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.042779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.042824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.538 [2024-10-07 13:35:17.042840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.042955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.042981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.538 [2024-10-07 13:35:17.042997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.043021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.043042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.043062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.043077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.043090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.043106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.043121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.043133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.043157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.043185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.052819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.052858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.053068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.053097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.538 [2024-10-07 13:35:17.053114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.053225] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.053251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.538 [2024-10-07 13:35:17.053272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.053446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.053510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.053562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.053587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.053601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.053618] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.053634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.053647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.053671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.053687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.064791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.064849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.065058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.065085] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.538 [2024-10-07 13:35:17.065101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.065227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.065260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.538 [2024-10-07 13:35:17.065276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.538 [2024-10-07 13:35:17.065300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.065332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.538 [2024-10-07 13:35:17.065352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.065367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.065380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.065397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.538 [2024-10-07 13:35:17.065412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.538 [2024-10-07 13:35:17.065425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.538 [2024-10-07 13:35:17.065448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.065494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.538 [2024-10-07 13:35:17.079874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.079913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.538 [2024-10-07 13:35:17.080355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.538 [2024-10-07 13:35:17.080386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.538 [2024-10-07 13:35:17.080403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.080599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.080625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.539 [2024-10-07 13:35:17.080641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.080986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.081015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.081073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.081092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.081106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.081123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.081137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.081150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.081321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.081345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.095077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.095110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.095331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.095359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.539 [2024-10-07 13:35:17.095376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.095529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.095566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.539 [2024-10-07 13:35:17.095582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.095607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.095627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.095647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.095662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.095676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.095698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.095714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.095727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.095750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.095766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.108698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.108733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.109164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.109194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.539 [2024-10-07 13:35:17.109212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.109343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.109368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.539 [2024-10-07 13:35:17.109392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.109619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.109647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.109857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.109881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.109895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.109913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.109928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.109941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.109990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.110009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.123085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.123118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.123380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.123409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.539 [2024-10-07 13:35:17.123425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.123640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.123666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.539 [2024-10-07 13:35:17.123682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.123713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.123737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.123758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.123773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.123787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.123818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.123833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.123845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.539 [2024-10-07 13:35:17.123869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.123884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.539 [2024-10-07 13:35:17.135008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.135041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.539 [2024-10-07 13:35:17.135401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.135430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.539 [2024-10-07 13:35:17.135448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.135648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.539 [2024-10-07 13:35:17.135675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.539 [2024-10-07 13:35:17.135691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.539 [2024-10-07 13:35:17.135822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.135863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.539 [2024-10-07 13:35:17.136023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.539 [2024-10-07 13:35:17.136045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.539 [2024-10-07 13:35:17.136059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.136077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.136092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.136105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.136171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.136192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.148606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.148640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.150056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.150087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.540 [2024-10-07 13:35:17.150103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.150283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.150308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.540 [2024-10-07 13:35:17.150336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.150616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.150645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.150780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.150816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.150830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.150848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.150863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.150876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.150983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.151004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.161576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.161612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.162230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.162260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.540 [2024-10-07 13:35:17.162277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.162408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.162433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.540 [2024-10-07 13:35:17.162453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.162592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.162637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.162695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.162716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.162730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.162748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.162764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.162799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.162829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.162847] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.176672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.176706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.176946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.176973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.540 [2024-10-07 13:35:17.176989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.177087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.177122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.540 [2024-10-07 13:35:17.177138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.177510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.177542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.177751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.177775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.177804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.177823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.177837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.177850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.178281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.178306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.191598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.191631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.191849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.191877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.540 [2024-10-07 13:35:17.191894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.192010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.192046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.540 [2024-10-07 13:35:17.192062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.192508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.192544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.192764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.192802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.192818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.192836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.192850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.192862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.193092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.193115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.206207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.206239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.206393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.206430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.540 [2024-10-07 13:35:17.206446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.206625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.540 [2024-10-07 13:35:17.206652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.540 [2024-10-07 13:35:17.206669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.540 [2024-10-07 13:35:17.206693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.206714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.540 [2024-10-07 13:35:17.206735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.206751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.206763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.206780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.540 [2024-10-07 13:35:17.206819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.540 [2024-10-07 13:35:17.206832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.540 [2024-10-07 13:35:17.207382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.207405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.540 [2024-10-07 13:35:17.219878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.540 [2024-10-07 13:35:17.219910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.220124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.220152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.541 [2024-10-07 13:35:17.220173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.220297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.220334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.541 [2024-10-07 13:35:17.220349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.220374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.220394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.220414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.220429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.220441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.220457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.220508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.220524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.220550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.220567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.233371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.233405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.235130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.235161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.541 [2024-10-07 13:35:17.235178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.235394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.235418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.541 [2024-10-07 13:35:17.235433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.236094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.236125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.236501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.236527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.236541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.236560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.236575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.236593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.236805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.236842] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.243634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.243667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.244286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.244315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.541 [2024-10-07 13:35:17.244332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.244443] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.244467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.541 [2024-10-07 13:35:17.244483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.244545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.244566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.244586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.244601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.244614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.244631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.244646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.244658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.244691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.244707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.254344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.254377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.254585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.254614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.541 [2024-10-07 13:35:17.254631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.254827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.254851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.541 [2024-10-07 13:35:17.254866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.254891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.254914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.254959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.254977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.254991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.255007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.255022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.255035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.255059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.255075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.265276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.265309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.265557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.265586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.541 [2024-10-07 13:35:17.265602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.265711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.265736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.541 [2024-10-07 13:35:17.265752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.265776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.265798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.541 [2024-10-07 13:35:17.265834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.265849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.265861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.265877] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.541 [2024-10-07 13:35:17.265891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.541 [2024-10-07 13:35:17.265914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.541 [2024-10-07 13:35:17.265937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.265953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.541 [2024-10-07 13:35:17.280907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.280940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.541 [2024-10-07 13:35:17.281232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.281260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.541 [2024-10-07 13:35:17.281277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.281400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.541 [2024-10-07 13:35:17.281438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.541 [2024-10-07 13:35:17.281454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.541 [2024-10-07 13:35:17.281479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.281526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.281549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.281564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.281577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.281601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.281615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.281628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.282731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.282757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.292699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.292733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.293072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.293101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.542 [2024-10-07 13:35:17.293118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.293274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.293299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.542 [2024-10-07 13:35:17.293314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.296407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.296439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.297182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.297208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.297222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.297239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.297254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.297267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.297648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.297677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.302831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.302877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.303090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.303118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.542 [2024-10-07 13:35:17.303134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.303263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.303293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.542 [2024-10-07 13:35:17.303309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.303327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.303351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.303368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.303381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.303394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.303417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.303433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.303446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.303459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.303505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.313030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.313063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.313272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.313299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.542 [2024-10-07 13:35:17.313316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.313467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.313531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.542 [2024-10-07 13:35:17.313549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.313728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.313757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.313964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.313993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.314008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.314026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.314040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.314054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.314102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.314121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.327027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.327060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.327247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.327273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.542 [2024-10-07 13:35:17.327290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.327405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.327431] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.542 [2024-10-07 13:35:17.327447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.327494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.327519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.327540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.327556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.327577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.327594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.327608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.327620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.327645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.327662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.542 [2024-10-07 13:35:17.337508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.337542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.542 [2024-10-07 13:35:17.337785] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.337827] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.542 [2024-10-07 13:35:17.337844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.338023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.542 [2024-10-07 13:35:17.338052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.542 [2024-10-07 13:35:17.338069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.542 [2024-10-07 13:35:17.340555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.340589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.542 [2024-10-07 13:35:17.342671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.342698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.342713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.342732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.542 [2024-10-07 13:35:17.342748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.542 [2024-10-07 13:35:17.342761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.542 [2024-10-07 13:35:17.343615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.343642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.347623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.347670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.347884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.347913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.543 [2024-10-07 13:35:17.347929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.348106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.348132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.543 [2024-10-07 13:35:17.348157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.348175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.348200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.348218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.348230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.348244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.348268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.348285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.348298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.348310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.348572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.358862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.358895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.359091] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.359129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.543 [2024-10-07 13:35:17.359146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.359386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.359413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.543 [2024-10-07 13:35:17.359435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.359461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.359507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.359537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.359552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.359566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.359583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.359602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.359614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.359639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.359655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.374145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.374178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.374331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.374360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.543 [2024-10-07 13:35:17.374377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.374508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.374536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.543 [2024-10-07 13:35:17.374553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.375049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.375078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.375289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.375312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.375332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.375351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.375366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.375379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.375602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.375627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.387461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.387518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.387751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.387782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.543 [2024-10-07 13:35:17.387817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.387976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.388001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.543 [2024-10-07 13:35:17.388017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.388042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.388062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.388083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.388098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.388111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.388129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.388144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.543 [2024-10-07 13:35:17.388156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.543 [2024-10-07 13:35:17.388180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.388197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.543 [2024-10-07 13:35:17.402583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.402617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.543 [2024-10-07 13:35:17.402788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.402831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.543 [2024-10-07 13:35:17.402848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.402938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.543 [2024-10-07 13:35:17.402964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.543 [2024-10-07 13:35:17.402985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.543 [2024-10-07 13:35:17.403010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.403031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.543 [2024-10-07 13:35:17.403052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.543 [2024-10-07 13:35:17.403067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.403080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.403097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.403111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.403123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.403147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.403163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.416645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.416679] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.418034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.418065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.544 [2024-10-07 13:35:17.418081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.418187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.418211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.544 [2024-10-07 13:35:17.418226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.418678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.418709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.418772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.418793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.418822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.418839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.418853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.418866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.418890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.418906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.426760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.426828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.426992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.427021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.544 [2024-10-07 13:35:17.427038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.427164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.427190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.544 [2024-10-07 13:35:17.427206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.427225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.427250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.427268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.427280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.427293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.427317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.427333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.427346] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.427358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.427379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.436953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.436986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.437161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.437191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.544 [2024-10-07 13:35:17.437208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.437334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.437359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.544 [2024-10-07 13:35:17.437375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.437413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.437437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.437458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.437473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.437495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.437535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.437551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.437564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.437589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.437605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.449387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.449420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.449613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.449643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.544 [2024-10-07 13:35:17.449661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.449802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.449828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.544 [2024-10-07 13:35:17.449845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.450054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.450082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.450274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.450297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.450311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.450329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.450343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.450357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.450581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.450607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.463836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.463869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.464184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.464214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.544 [2024-10-07 13:35:17.464231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.464354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.544 [2024-10-07 13:35:17.464381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.544 [2024-10-07 13:35:17.464397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.544 [2024-10-07 13:35:17.464628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.464658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.544 [2024-10-07 13:35:17.464720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.464741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.464755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.464773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.544 [2024-10-07 13:35:17.464803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.544 [2024-10-07 13:35:17.464817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.544 [2024-10-07 13:35:17.464989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.465013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.544 [2024-10-07 13:35:17.478112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.544 [2024-10-07 13:35:17.478144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.478343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.478372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.545 [2024-10-07 13:35:17.478389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.478543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.478571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.545 [2024-10-07 13:35:17.478587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.478612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.478633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.478655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.478670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.478684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.478701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.478715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.478728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.478763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.478795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.488542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.488577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.492757] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.492804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.545 [2024-10-07 13:35:17.492822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.492905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.492929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.545 [2024-10-07 13:35:17.492944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.493016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.493042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.493065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.493079] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.493093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.493110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.493124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.493140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.493163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.493179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.498691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.498723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.498921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.498951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.545 [2024-10-07 13:35:17.498968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.499088] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.499114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.545 [2024-10-07 13:35:17.499129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.499153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.499174] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.499194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.499209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.499222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.499239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.499258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.499272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.500286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.500312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.508815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.508864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.509116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.509146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.545 [2024-10-07 13:35:17.509163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.509747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.509792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.545 [2024-10-07 13:35:17.509809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.509828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.510167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.510193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.510207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.510220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.510280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.510301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.510313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.510326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.510365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.521515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.521549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.522155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.522185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.545 [2024-10-07 13:35:17.522201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.522327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.522352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.545 [2024-10-07 13:35:17.522367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.522603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.522638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.545 [2024-10-07 13:35:17.522848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.522872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.522887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.522905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.545 [2024-10-07 13:35:17.522920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.545 [2024-10-07 13:35:17.522933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.545 [2024-10-07 13:35:17.523138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.523160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.545 [2024-10-07 13:35:17.536373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.536406] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.545 [2024-10-07 13:35:17.536666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.536695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.545 [2024-10-07 13:35:17.536712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.536860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.545 [2024-10-07 13:35:17.536888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.545 [2024-10-07 13:35:17.536903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.545 [2024-10-07 13:35:17.536928] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.536949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.536969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.536984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.536997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.537018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.537033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.537045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.537068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.537084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.550677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.550712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.551055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.551085] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.546 [2024-10-07 13:35:17.551108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.551327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.551354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.546 [2024-10-07 13:35:17.551370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.551395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.551416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.551436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.551451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.551465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.551482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.551523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.551537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.551565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.551582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.561065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.561099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.561436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.561466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.546 [2024-10-07 13:35:17.561484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.561706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.561732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.546 [2024-10-07 13:35:17.561749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.561870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.561909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.562025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.562045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.562060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.562077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.562091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.562113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.562221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.562243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.571177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.571225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.571495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.571530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.546 [2024-10-07 13:35:17.571546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.572481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.572518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.546 [2024-10-07 13:35:17.572535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.572554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.572729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.572754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.572768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.572797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.572907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.572928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.572943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.572955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.573054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.581405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.581437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.581707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.581736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.546 [2024-10-07 13:35:17.581753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.581863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.581889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.546 [2024-10-07 13:35:17.581905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.582078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.582115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.582168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.582189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.582203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.582220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.582234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.582247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.582271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.582288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.546 [2024-10-07 13:35:17.592755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.592790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.546 [2024-10-07 13:35:17.595949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.595982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.546 [2024-10-07 13:35:17.596001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.596184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.546 [2024-10-07 13:35:17.596209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.546 [2024-10-07 13:35:17.596225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.546 [2024-10-07 13:35:17.597154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.597185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.546 [2024-10-07 13:35:17.597621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.597647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.597663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.597682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.546 [2024-10-07 13:35:17.597698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.546 [2024-10-07 13:35:17.597711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.546 [2024-10-07 13:35:17.597935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.597958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.602886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.602932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.603130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.603158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.547 [2024-10-07 13:35:17.603174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.603366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.603391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.547 [2024-10-07 13:35:17.603407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.603426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.603589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.603616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.603630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.603643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.603785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.603808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.603822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.603835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.603970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.612968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.613180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.613209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.547 [2024-10-07 13:35:17.613226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.613263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.613295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.613323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.613338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.613352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.613374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.613561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.613588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.547 [2024-10-07 13:35:17.613605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.613630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.613654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.613669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.613682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.613713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.625851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.625884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.626295] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.626325] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.547 [2024-10-07 13:35:17.626342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.626548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.626575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.547 [2024-10-07 13:35:17.626591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.626640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.626666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.626688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.626704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.626717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.626734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.626749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.626763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.626787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.626818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.636297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.636330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.636650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.636679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.547 [2024-10-07 13:35:17.636697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.636876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.636902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.547 [2024-10-07 13:35:17.636918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.639147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.639178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.640007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.640038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.640054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.640071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.640086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.640100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.640337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.640361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.547 [2024-10-07 13:35:17.646409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.646455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.547 [2024-10-07 13:35:17.646728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.646755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.547 [2024-10-07 13:35:17.646772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.647103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.547 [2024-10-07 13:35:17.647131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.547 [2024-10-07 13:35:17.647148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.547 [2024-10-07 13:35:17.647167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.647291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.547 [2024-10-07 13:35:17.647316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.547 [2024-10-07 13:35:17.647329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.547 [2024-10-07 13:35:17.647342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.547 [2024-10-07 13:35:17.647454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.647502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.647518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.647531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.647666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.658106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.658139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.658544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.658575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.548 [2024-10-07 13:35:17.658593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.658746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.658776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.548 [2024-10-07 13:35:17.658808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.659242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.659273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.659334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.659355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.659369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.659387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.659402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.659414] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.659438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.659453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.670000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.670034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.670224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.670254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.548 [2024-10-07 13:35:17.670274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.670366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.670391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.548 [2024-10-07 13:35:17.670406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.670433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.670459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.670481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.670522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.670537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.670555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.670570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.670584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.670609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.670627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.681521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.681557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.681905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.681939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.548 [2024-10-07 13:35:17.681957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.682101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.682128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.548 [2024-10-07 13:35:17.682152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.682284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.682312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.682419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.682440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.682453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.682493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.682512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.682536] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.682650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.682671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.691640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.691690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.691929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.691956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.548 [2024-10-07 13:35:17.691973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.692173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.692198] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.548 [2024-10-07 13:35:17.692214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.692233] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.692641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.692668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.692683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.692701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.692886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.692910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.692924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.692938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.693059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.701973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.702007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.702351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.702382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.548 [2024-10-07 13:35:17.702399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.702583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.702610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.548 [2024-10-07 13:35:17.702627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.548 [2024-10-07 13:35:17.703080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.703111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.548 [2024-10-07 13:35:17.703317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.703342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.703356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.703373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.548 [2024-10-07 13:35:17.703389] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.548 [2024-10-07 13:35:17.703402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.548 [2024-10-07 13:35:17.703624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.703649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.548 [2024-10-07 13:35:17.715150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.715182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.548 [2024-10-07 13:35:17.715422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.548 [2024-10-07 13:35:17.715450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.549 [2024-10-07 13:35:17.715480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.715674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.715699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.549 [2024-10-07 13:35:17.715720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.715746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.715767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.715803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.715817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.715830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.715845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.715860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.715873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.715912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.715940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.727098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.727131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.727433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.727461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.549 [2024-10-07 13:35:17.727503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.727663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.727689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.549 [2024-10-07 13:35:17.727705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.730754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.730787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.731444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.731483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.731510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.731529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.731544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.731557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.731941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.731964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.737206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.737258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.737518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.737547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.549 [2024-10-07 13:35:17.737564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.737824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.737851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.549 [2024-10-07 13:35:17.737866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.737885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.737910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.737928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.737940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.737953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.737977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.737993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.738004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.738017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.738039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.747339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.747387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.747580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.747609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.549 [2024-10-07 13:35:17.747626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.748041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.748071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.549 [2024-10-07 13:35:17.748087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.748106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.748303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.748327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.748342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.748355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.748409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.748430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.748443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.748456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.748672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.762284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.762316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.762635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.762664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.549 [2024-10-07 13:35:17.762682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.762816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.762841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.549 [2024-10-07 13:35:17.762857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.762881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.762902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.762922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.762936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.762949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.762965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.549 [2024-10-07 13:35:17.762979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.549 [2024-10-07 13:35:17.762998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.549 [2024-10-07 13:35:17.763020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.763037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.549 [2024-10-07 13:35:17.772395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.774923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.549 [2024-10-07 13:35:17.775164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.775194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.549 [2024-10-07 13:35:17.775210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.777243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.549 [2024-10-07 13:35:17.777273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.549 [2024-10-07 13:35:17.777290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.549 [2024-10-07 13:35:17.777314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.777400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.549 [2024-10-07 13:35:17.777423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.777436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.777449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.777474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.777519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.777536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.777550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.777573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.782595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.782727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.782757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.550 [2024-10-07 13:35:17.782775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.782815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.782840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.782855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.782868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.782892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.785020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.785172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.785199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.550 [2024-10-07 13:35:17.785216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.785241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.785263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.785279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.785292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.785315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 00:24:23.550 Latency(us) 00:24:23.550 [2024-10-07T11:35:19.483Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:23.550 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:24:23.550 Verification LBA range: start 0x0 length 0x4000 00:24:23.550 NVMe0n1 : 15.01 8614.54 33.65 0.00 0.00 14831.43 2791.35 31068.92 00:24:23.550 [2024-10-07T11:35:19.483Z] =================================================================================================================== 00:24:23.550 [2024-10-07T11:35:19.483Z] Total : 8614.54 33.65 0.00 0.00 14831.43 2791.35 31068.92 00:24:23.550 [2024-10-07 13:35:17.792673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.792851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.792885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.550 [2024-10-07 13:35:17.792902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.792924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.792944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.792958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.792971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.792990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.795093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.795283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.795310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.550 [2024-10-07 13:35:17.795327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.795348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.795368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.795384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.795397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.795416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.802752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.802996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.803023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.550 [2024-10-07 13:35:17.803040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.803061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.803080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.803094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.803107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.803126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.805162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.805371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.805398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.550 [2024-10-07 13:35:17.805416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.805436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.805455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.805503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.805531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.805550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.812854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.813012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.813039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.550 [2024-10-07 13:35:17.813056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.813076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.813095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.813109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.813122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.813140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.815230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.815380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.815406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.550 [2024-10-07 13:35:17.815422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.815442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.815476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.815500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.815515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.815533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.822924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.550 [2024-10-07 13:35:17.823066] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.550 [2024-10-07 13:35:17.823092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.550 [2024-10-07 13:35:17.823108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.550 [2024-10-07 13:35:17.823134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.550 [2024-10-07 13:35:17.823154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.550 [2024-10-07 13:35:17.823167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.550 [2024-10-07 13:35:17.823180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.550 [2024-10-07 13:35:17.823197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.550 [2024-10-07 13:35:17.825297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.551 [2024-10-07 13:35:17.825459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.551 [2024-10-07 13:35:17.825508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.551 [2024-10-07 13:35:17.825526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.551 [2024-10-07 13:35:17.825547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.551 [2024-10-07 13:35:17.825568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.551 [2024-10-07 13:35:17.825582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.551 [2024-10-07 13:35:17.825595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.551 [2024-10-07 13:35:17.825614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.551 [2024-10-07 13:35:17.832993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.551 [2024-10-07 13:35:17.833156] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.551 [2024-10-07 13:35:17.833182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.551 [2024-10-07 13:35:17.833197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.551 [2024-10-07 13:35:17.833217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.551 [2024-10-07 13:35:17.833237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.551 [2024-10-07 13:35:17.833250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.551 [2024-10-07 13:35:17.833262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.551 [2024-10-07 13:35:17.833280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.551 [2024-10-07 13:35:17.835364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.551 [2024-10-07 13:35:17.835537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.551 [2024-10-07 13:35:17.835564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.551 [2024-10-07 13:35:17.835581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.551 [2024-10-07 13:35:17.835602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.551 [2024-10-07 13:35:17.835622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.551 [2024-10-07 13:35:17.835637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.551 [2024-10-07 13:35:17.835656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.551 [2024-10-07 13:35:17.835686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.551 [2024-10-07 13:35:17.843061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.551 [2024-10-07 13:35:17.843216] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.551 [2024-10-07 13:35:17.843242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7c2630 with addr=10.0.0.2, port=4422 00:24:23.551 [2024-10-07 13:35:17.843258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7c2630 is same with the state(6) to be set 00:24:23.551 [2024-10-07 13:35:17.843279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7c2630 (9): Bad file descriptor 00:24:23.551 [2024-10-07 13:35:17.843298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.551 [2024-10-07 13:35:17.843312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.551 [2024-10-07 13:35:17.843324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.551 [2024-10-07 13:35:17.843342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.551 [2024-10-07 13:35:17.845431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:23.551 [2024-10-07 13:35:17.845620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:23.551 [2024-10-07 13:35:17.845649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x68b340 with addr=10.0.0.2, port=4421 00:24:23.551 [2024-10-07 13:35:17.845667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x68b340 is same with the state(6) to be set 00:24:23.551 [2024-10-07 13:35:17.845688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x68b340 (9): Bad file descriptor 00:24:23.551 [2024-10-07 13:35:17.845708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:23.551 [2024-10-07 13:35:17.845722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:23.551 [2024-10-07 13:35:17.845736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:23.551 [2024-10-07 13:35:17.845755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:23.551 Received shutdown signal, test time was about 15.000000 seconds 00:24:23.551 00:24:23.551 Latency(us) 00:24:23.551 [2024-10-07T11:35:19.484Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:23.551 [2024-10-07T11:35:19.484Z] =================================================================================================================== 00:24:23.551 [2024-10-07T11:35:19.484Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # killprocess 709749 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 709749 ']' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 709749 00:24:23.551 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 954: kill: (709749) - No such process 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@977 -- # echo 'Process with pid 709749 is not found' 00:24:23.551 Process with pid 709749 is not found 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # nvmftestfini 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@514 -- # nvmfcleanup 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@121 -- # sync 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@124 -- # set +e 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@125 -- # for i in {1..20} 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:24:23.551 rmmod nvme_tcp 00:24:23.551 rmmod nvme_fabrics 00:24:23.551 rmmod nvme_keyring 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@128 -- # set -e 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@129 -- # return 0 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@515 -- # '[' -n 709458 ']' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@516 -- # killprocess 709458 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 709458 ']' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 709458 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 709458 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 709458' 00:24:23.551 killing process with pid 709458 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 709458 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 709458 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@297 -- # iptr 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-save 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-restore 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@298 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@302 -- # remove_spdk_ns 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:24:23.551 13:35:18 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@303 -- # ip -4 addr flush cvl_0_1 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # exit 1 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # trap - ERR 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # print_backtrace 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh' 'nvmf_failover' '--transport=tcp') 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:24:24.967 ========== Backtrace start: ========== 00:24:24.967 00:24:24.967 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_failover"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh"],["--transport=tcp"]) 00:24:24.967 ... 00:24:24.967 1120 timing_enter $test_name 00:24:24.967 1121 echo "************************************" 00:24:24.967 1122 echo "START TEST $test_name" 00:24:24.967 1123 echo "************************************" 00:24:24.967 1124 xtrace_restore 00:24:24.967 1125 time "$@" 00:24:24.967 1126 xtrace_disable 00:24:24.967 1127 echo "************************************" 00:24:24.967 1128 echo "END TEST $test_name" 00:24:24.967 1129 echo "************************************" 00:24:24.967 1130 timing_exit $test_name 00:24:24.967 ... 00:24:24.967 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh:25 -> main(["--transport=tcp"]) 00:24:24.967 ... 00:24:24.967 20 fi 00:24:24.967 21 00:24:24.967 22 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 00:24:24.967 23 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 00:24:24.967 24 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:24:24.967 => 25 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:24:24.967 26 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 00:24:24.967 27 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:24:24.967 28 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:24:24.967 29 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:24:24.967 30 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:24:24.967 ... 00:24:24.967 00:24:24.967 ========== Backtrace end ========== 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:24:24.967 00:24:24.967 real 0m23.919s 00:24:24.967 user 1m15.800s 00:24:24.967 sys 0m5.364s 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1 -- # exit 1 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # trap - ERR 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # print_backtrace 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh' 'nvmf_host' '--transport=tcp') 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # local args 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1157 -- # xtrace_disable 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:24:24.967 ========== Backtrace start: ========== 00:24:24.967 00:24:24.967 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:24:24.967 ... 00:24:24.967 1120 timing_enter $test_name 00:24:24.967 1121 echo "************************************" 00:24:24.967 1122 echo "START TEST $test_name" 00:24:24.967 1123 echo "************************************" 00:24:24.967 1124 xtrace_restore 00:24:24.967 1125 time "$@" 00:24:24.967 1126 xtrace_disable 00:24:24.967 1127 echo "************************************" 00:24:24.967 1128 echo "END TEST $test_name" 00:24:24.967 1129 echo "************************************" 00:24:24.967 1130 timing_exit $test_name 00:24:24.967 ... 00:24:24.967 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:16 -> main(["--transport=tcp"]) 00:24:24.967 ... 00:24:24.967 11 exit 0 00:24:24.967 12 fi 00:24:24.967 13 00:24:24.967 14 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.967 15 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.967 => 16 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.967 17 00:24:24.967 18 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:24:24.967 19 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:24:24.967 20 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:24:24.967 21 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:24:24.967 ... 00:24:24.967 00:24:24.967 ========== Backtrace end ========== 00:24:24.967 13:35:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1194 -- # return 0 00:24:24.967 00:24:24.967 real 1m23.338s 00:24:24.967 user 3m22.102s 00:24:24.967 sys 0m24.079s 00:24:24.967 13:35:20 nvmf_tcp -- common/autotest_common.sh@1125 -- # trap - ERR 00:24:24.967 13:35:20 nvmf_tcp -- common/autotest_common.sh@1125 -- # print_backtrace 00:24:24.967 13:35:20 nvmf_tcp -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:24:24.967 13:35:20 nvmf_tcp -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh' 'nvmf_tcp' '/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf') 00:24:24.967 13:35:20 nvmf_tcp -- common/autotest_common.sh@1155 -- # local args 00:24:24.967 13:35:20 nvmf_tcp -- common/autotest_common.sh@1157 -- # xtrace_disable 00:24:24.967 13:35:20 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:24:24.967 ========== Backtrace start: ========== 00:24:24.967 00:24:24.967 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:24:24.967 ... 00:24:24.968 1120 timing_enter $test_name 00:24:24.968 1121 echo "************************************" 00:24:24.968 1122 echo "START TEST $test_name" 00:24:24.968 1123 echo "************************************" 00:24:24.968 1124 xtrace_restore 00:24:24.968 1125 time "$@" 00:24:24.968 1126 xtrace_disable 00:24:24.968 1127 echo "************************************" 00:24:24.968 1128 echo "END TEST $test_name" 00:24:24.968 1129 echo "************************************" 00:24:24.968 1130 timing_exit $test_name 00:24:24.968 ... 00:24:24.968 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"]) 00:24:24.968 ... 00:24:24.968 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:24:24.968 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:24:24.968 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.968 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.968 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:24:24.968 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.968 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:24:24.968 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.968 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:24:24.968 284 fi 00:24:24.968 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:24:24.968 ... 00:24:24.968 00:24:24.968 ========== Backtrace end ========== 00:24:24.968 13:35:20 nvmf_tcp -- common/autotest_common.sh@1194 -- # return 0 00:24:24.968 00:24:24.968 real 17m0.765s 00:24:24.968 user 41m19.477s 00:24:24.968 sys 4m30.576s 00:24:24.968 13:35:20 nvmf_tcp -- common/autotest_common.sh@1 -- # autotest_cleanup 00:24:24.968 13:35:20 nvmf_tcp -- common/autotest_common.sh@1392 -- # local autotest_es=1 00:24:24.968 13:35:20 nvmf_tcp -- common/autotest_common.sh@1393 -- # xtrace_disable 00:24:24.968 13:35:20 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:24:37.892 INFO: APP EXITING 00:24:37.892 INFO: killing all VMs 00:24:37.892 INFO: killing vhost app 00:24:37.892 INFO: EXIT DONE 00:24:37.892 Waiting for block devices as requested 00:24:37.892 0000:82:00.0 (8086 0a54): vfio-pci -> nvme 00:24:37.892 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:24:38.150 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:24:38.150 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:24:38.150 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:24:38.407 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:24:38.407 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:24:38.407 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:24:38.664 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:24:38.664 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:24:38.664 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:24:38.664 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:24:38.664 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:24:38.922 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:24:38.922 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:24:38.922 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:24:38.922 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:24:40.300 Cleaning 00:24:40.300 Removing: /var/run/dpdk/spdk0/config 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:24:40.300 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:24:40.300 Removing: /var/run/dpdk/spdk0/hugepage_info 00:24:40.300 Removing: /var/run/dpdk/spdk1/config 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:24:40.300 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:24:40.300 Removing: /var/run/dpdk/spdk1/hugepage_info 00:24:40.300 Removing: /var/run/dpdk/spdk1/mp_socket 00:24:40.300 Removing: /var/run/dpdk/spdk2/config 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:24:40.300 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:24:40.300 Removing: /var/run/dpdk/spdk2/hugepage_info 00:24:40.300 Removing: /var/run/dpdk/spdk3/config 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:24:40.560 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:24:40.560 Removing: /var/run/dpdk/spdk3/hugepage_info 00:24:40.560 Removing: /var/run/dpdk/spdk4/config 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:24:40.560 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:24:40.560 Removing: /var/run/dpdk/spdk4/hugepage_info 00:24:40.560 Removing: /dev/shm/bdev_svc_trace.1 00:24:40.560 Removing: /dev/shm/nvmf_trace.0 00:24:40.560 Removing: /dev/shm/spdk_tgt_trace.pid511937 00:24:40.560 Removing: /var/run/dpdk/spdk0 00:24:40.560 Removing: /var/run/dpdk/spdk1 00:24:40.560 Removing: /var/run/dpdk/spdk2 00:24:40.560 Removing: /var/run/dpdk/spdk3 00:24:40.560 Removing: /var/run/dpdk/spdk4 00:24:40.560 Removing: /var/run/dpdk/spdk_pid510252 00:24:40.560 Removing: /var/run/dpdk/spdk_pid510995 00:24:40.560 Removing: /var/run/dpdk/spdk_pid511937 00:24:40.560 Removing: /var/run/dpdk/spdk_pid512384 00:24:40.560 Removing: /var/run/dpdk/spdk_pid513013 00:24:40.560 Removing: /var/run/dpdk/spdk_pid513221 00:24:40.560 Removing: /var/run/dpdk/spdk_pid513933 00:24:40.560 Removing: /var/run/dpdk/spdk_pid513949 00:24:40.560 Removing: /var/run/dpdk/spdk_pid514210 00:24:40.560 Removing: /var/run/dpdk/spdk_pid515535 00:24:40.560 Removing: /var/run/dpdk/spdk_pid516450 00:24:40.560 Removing: /var/run/dpdk/spdk_pid516651 00:24:40.560 Removing: /var/run/dpdk/spdk_pid516961 00:24:40.560 Removing: /var/run/dpdk/spdk_pid517182 00:24:40.560 Removing: /var/run/dpdk/spdk_pid517378 00:24:40.560 Removing: /var/run/dpdk/spdk_pid517543 00:24:40.560 Removing: /var/run/dpdk/spdk_pid517813 00:24:40.560 Removing: /var/run/dpdk/spdk_pid518003 00:24:40.560 Removing: /var/run/dpdk/spdk_pid518468 00:24:40.560 Removing: /var/run/dpdk/spdk_pid520962 00:24:40.560 Removing: /var/run/dpdk/spdk_pid521124 00:24:40.560 Removing: /var/run/dpdk/spdk_pid521390 00:24:40.560 Removing: /var/run/dpdk/spdk_pid521498 00:24:40.560 Removing: /var/run/dpdk/spdk_pid521959 00:24:40.560 Removing: /var/run/dpdk/spdk_pid521962 00:24:40.560 Removing: /var/run/dpdk/spdk_pid522512 00:24:40.560 Removing: /var/run/dpdk/spdk_pid522654 00:24:40.560 Removing: /var/run/dpdk/spdk_pid523201 00:24:40.560 Removing: /var/run/dpdk/spdk_pid523212 00:24:40.560 Removing: /var/run/dpdk/spdk_pid523376 00:24:40.560 Removing: /var/run/dpdk/spdk_pid523512 00:24:40.560 Removing: /var/run/dpdk/spdk_pid523889 00:24:40.560 Removing: /var/run/dpdk/spdk_pid524119 00:24:40.560 Removing: /var/run/dpdk/spdk_pid524369 00:24:40.560 Removing: /var/run/dpdk/spdk_pid526624 00:24:40.560 Removing: /var/run/dpdk/spdk_pid529159 00:24:40.560 Removing: /var/run/dpdk/spdk_pid536302 00:24:40.560 Removing: /var/run/dpdk/spdk_pid536722 00:24:40.560 Removing: /var/run/dpdk/spdk_pid539256 00:24:40.560 Removing: /var/run/dpdk/spdk_pid539538 00:24:40.560 Removing: /var/run/dpdk/spdk_pid542188 00:24:40.560 Removing: /var/run/dpdk/spdk_pid545934 00:24:40.560 Removing: /var/run/dpdk/spdk_pid548116 00:24:40.561 Removing: /var/run/dpdk/spdk_pid554719 00:24:40.561 Removing: /var/run/dpdk/spdk_pid560614 00:24:40.561 Removing: /var/run/dpdk/spdk_pid561931 00:24:40.561 Removing: /var/run/dpdk/spdk_pid562604 00:24:40.561 Removing: /var/run/dpdk/spdk_pid573043 00:24:40.561 Removing: /var/run/dpdk/spdk_pid575473 00:24:40.561 Removing: /var/run/dpdk/spdk_pid603774 00:24:40.561 Removing: /var/run/dpdk/spdk_pid607085 00:24:40.561 Removing: /var/run/dpdk/spdk_pid610929 00:24:40.561 Removing: /var/run/dpdk/spdk_pid614930 00:24:40.561 Removing: /var/run/dpdk/spdk_pid614932 00:24:40.561 Removing: /var/run/dpdk/spdk_pid615595 00:24:40.561 Removing: /var/run/dpdk/spdk_pid616264 00:24:40.561 Removing: /var/run/dpdk/spdk_pid616803 00:24:40.561 Removing: /var/run/dpdk/spdk_pid617201 00:24:40.561 Removing: /var/run/dpdk/spdk_pid617324 00:24:40.561 Removing: /var/run/dpdk/spdk_pid617464 00:24:40.561 Removing: /var/run/dpdk/spdk_pid617603 00:24:40.561 Removing: /var/run/dpdk/spdk_pid617605 00:24:40.561 Removing: /var/run/dpdk/spdk_pid618266 00:24:40.561 Removing: /var/run/dpdk/spdk_pid618805 00:24:40.561 Removing: /var/run/dpdk/spdk_pid619460 00:24:40.561 Removing: /var/run/dpdk/spdk_pid619859 00:24:40.561 Removing: /var/run/dpdk/spdk_pid619868 00:24:40.561 Removing: /var/run/dpdk/spdk_pid620119 00:24:40.561 Removing: /var/run/dpdk/spdk_pid621024 00:24:40.561 Removing: /var/run/dpdk/spdk_pid621863 00:24:40.561 Removing: /var/run/dpdk/spdk_pid627248 00:24:40.561 Removing: /var/run/dpdk/spdk_pid655830 00:24:40.561 Removing: /var/run/dpdk/spdk_pid658861 00:24:40.561 Removing: /var/run/dpdk/spdk_pid659933 00:24:40.561 Removing: /var/run/dpdk/spdk_pid661364 00:24:40.561 Removing: /var/run/dpdk/spdk_pid661505 00:24:40.561 Removing: /var/run/dpdk/spdk_pid661650 00:24:40.561 Removing: /var/run/dpdk/spdk_pid661791 00:24:40.561 Removing: /var/run/dpdk/spdk_pid662298 00:24:40.561 Removing: /var/run/dpdk/spdk_pid663673 00:24:40.561 Removing: /var/run/dpdk/spdk_pid664541 00:24:40.561 Removing: /var/run/dpdk/spdk_pid664891 00:24:40.561 Removing: /var/run/dpdk/spdk_pid666598 00:24:40.561 Removing: /var/run/dpdk/spdk_pid667019 00:24:40.561 Removing: /var/run/dpdk/spdk_pid667590 00:24:40.561 Removing: /var/run/dpdk/spdk_pid670065 00:24:40.561 Removing: /var/run/dpdk/spdk_pid673438 00:24:40.561 Removing: /var/run/dpdk/spdk_pid673439 00:24:40.561 Removing: /var/run/dpdk/spdk_pid673440 00:24:40.561 Removing: /var/run/dpdk/spdk_pid675676 00:24:40.561 Removing: /var/run/dpdk/spdk_pid680546 00:24:40.561 Removing: /var/run/dpdk/spdk_pid683312 00:24:40.561 Removing: /var/run/dpdk/spdk_pid687738 00:24:40.561 Removing: /var/run/dpdk/spdk_pid688680 00:24:40.561 Removing: /var/run/dpdk/spdk_pid689778 00:24:40.561 Removing: /var/run/dpdk/spdk_pid690861 00:24:40.561 Removing: /var/run/dpdk/spdk_pid693699 00:24:40.561 Removing: /var/run/dpdk/spdk_pid696083 00:24:40.561 Removing: /var/run/dpdk/spdk_pid700356 00:24:40.561 Removing: /var/run/dpdk/spdk_pid700387 00:24:40.561 Removing: /var/run/dpdk/spdk_pid703285 00:24:40.561 Removing: /var/run/dpdk/spdk_pid703418 00:24:40.561 Removing: /var/run/dpdk/spdk_pid703609 00:24:40.561 Removing: /var/run/dpdk/spdk_pid703942 00:24:40.561 Removing: /var/run/dpdk/spdk_pid703947 00:24:40.561 Removing: /var/run/dpdk/spdk_pid706731 00:24:40.561 Removing: /var/run/dpdk/spdk_pid707061 00:24:40.561 Removing: /var/run/dpdk/spdk_pid709749 00:24:40.561 Clean 00:27:02.015 13:37:43 nvmf_tcp -- common/autotest_common.sh@1451 -- # return 1 00:27:02.015 13:37:43 nvmf_tcp -- common/autotest_common.sh@1 -- # : 00:27:02.015 13:37:43 nvmf_tcp -- common/autotest_common.sh@1 -- # exit 1 00:27:02.027 [Pipeline] } 00:27:02.042 [Pipeline] // stage 00:27:02.048 [Pipeline] } 00:27:02.064 [Pipeline] // timeout 00:27:02.070 [Pipeline] } 00:27:02.073 ERROR: script returned exit code 1 00:27:02.073 Setting overall build result to FAILURE 00:27:02.086 [Pipeline] // catchError 00:27:02.090 [Pipeline] } 00:27:02.103 [Pipeline] // wrap 00:27:02.108 [Pipeline] } 00:27:02.120 [Pipeline] // catchError 00:27:02.128 [Pipeline] stage 00:27:02.130 [Pipeline] { (Epilogue) 00:27:02.141 [Pipeline] catchError 00:27:02.142 [Pipeline] { 00:27:02.154 [Pipeline] echo 00:27:02.156 Cleanup processes 00:27:02.161 [Pipeline] sh 00:27:02.447 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:27:02.447 735702 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:27:02.458 [Pipeline] sh 00:27:02.740 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:27:02.740 ++ grep -v 'sudo pgrep' 00:27:02.740 ++ awk '{print $1}' 00:27:02.740 + sudo kill -9 00:27:02.740 + true 00:27:02.752 [Pipeline] sh 00:27:03.036 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:27:08.333 [Pipeline] sh 00:27:08.622 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:27:08.622 Artifacts sizes are good 00:27:08.637 [Pipeline] archiveArtifacts 00:27:08.644 Archiving artifacts 00:27:08.890 [Pipeline] sh 00:27:09.227 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:27:09.242 [Pipeline] cleanWs 00:27:09.252 [WS-CLEANUP] Deleting project workspace... 00:27:09.252 [WS-CLEANUP] Deferred wipeout is used... 00:27:09.260 [WS-CLEANUP] done 00:27:09.262 [Pipeline] } 00:27:09.280 [Pipeline] // catchError 00:27:09.290 [Pipeline] echo 00:27:09.291 Tests finished with errors. Please check the logs for more info. 00:27:09.294 [Pipeline] echo 00:27:09.296 Execution node will be rebooted. 00:27:09.310 [Pipeline] build 00:27:09.313 Scheduling project: reset-job 00:27:09.325 [Pipeline] sh 00:27:09.604 + logger -p user.info -t JENKINS-CI 00:27:09.612 [Pipeline] } 00:27:09.625 [Pipeline] // stage 00:27:09.630 [Pipeline] } 00:27:09.645 [Pipeline] // node 00:27:09.650 [Pipeline] End of Pipeline 00:27:09.688 Finished: FAILURE